-- Logs begin at Wed 2022-09-07 15:54:26 UTC, end at Wed 2022-09-07 17:08:07 UTC. -- Sep 07 16:26:29.621194 dv-cinder-847732-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 07 16:26:29.631232 dv-cinder-847732-5-smb devstack@keystone.service[81864]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 07 16:26:29.635518 dv-cinder-847732-5-smb devstack@keystone.service[81864]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 16:26:29 2022] *** Sep 07 16:26:29.635518 dv-cinder-847732-5-smb devstack@keystone.service[81864]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 16:26:29.635518 dv-cinder-847732-5-smb devstack@keystone.service[81864]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 16:26:29.635518 dv-cinder-847732-5-smb devstack@keystone.service[81864]: nodename: dv-cinder-847732-5-smb Sep 07 16:26:29.635518 dv-cinder-847732-5-smb devstack@keystone.service[81864]: machine: x86_64 Sep 07 16:26:29.635518 dv-cinder-847732-5-smb devstack@keystone.service[81864]: clock source: unix Sep 07 16:26:29.635518 dv-cinder-847732-5-smb devstack@keystone.service[81864]: pcre jit disabled Sep 07 16:26:29.635518 dv-cinder-847732-5-smb devstack@keystone.service[81864]: detected number of CPU cores: 4 Sep 07 16:26:29.635518 dv-cinder-847732-5-smb devstack@keystone.service[81864]: current working directory: / Sep 07 16:26:29.635518 dv-cinder-847732-5-smb devstack@keystone.service[81864]: detected binary path: /usr/bin/uwsgi-core Sep 07 16:26:29.635518 dv-cinder-847732-5-smb devstack@keystone.service[81864]: your processes number limit is 47680 Sep 07 16:26:29.635518 dv-cinder-847732-5-smb devstack@keystone.service[81864]: your memory page size is 4096 bytes Sep 07 16:26:29.635518 dv-cinder-847732-5-smb devstack@keystone.service[81864]: detected max file descriptor number: 2048 Sep 07 16:26:29.635518 dv-cinder-847732-5-smb devstack@keystone.service[81864]: lock engine: pthread robust mutexes Sep 07 16:26:29.635518 dv-cinder-847732-5-smb devstack@keystone.service[81864]: thunder lock: enabled Sep 07 16:26:29.635518 dv-cinder-847732-5-smb devstack@keystone.service[81864]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 07 16:26:29.635518 dv-cinder-847732-5-smb devstack@keystone.service[81864]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 16:26:29.672960 dv-cinder-847732-5-smb devstack@keystone.service[81864]: Python main interpreter initialized at 0x5593545be9c0 Sep 07 16:26:29.672960 dv-cinder-847732-5-smb devstack@keystone.service[81864]: python threads support enabled Sep 07 16:26:29.672960 dv-cinder-847732-5-smb devstack@keystone.service[81864]: your server socket listen backlog is limited to 100 connections Sep 07 16:26:29.672960 dv-cinder-847732-5-smb devstack@keystone.service[81864]: your mercy for graceful operations on workers is 90 seconds Sep 07 16:26:29.673321 dv-cinder-847732-5-smb devstack@keystone.service[81864]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 16:26:29.673400 dv-cinder-847732-5-smb devstack@keystone.service[81864]: *** Operational MODE: preforking *** Sep 07 16:26:29.673675 dv-cinder-847732-5-smb devstack@keystone.service[81864]: *** uWSGI is running in multiple interpreter mode *** Sep 07 16:26:29.673675 dv-cinder-847732-5-smb devstack@keystone.service[81864]: spawned uWSGI master process (pid: 81864) Sep 07 16:26:29.673879 dv-cinder-847732-5-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 07 16:26:29.678106 dv-cinder-847732-5-smb devstack@keystone.service[81864]: spawned uWSGI worker 1 (pid: 81876, cores: 1) Sep 07 16:26:29.678106 dv-cinder-847732-5-smb devstack@keystone.service[81864]: spawned uWSGI worker 2 (pid: 81877, cores: 1) Sep 07 16:26:29.678106 dv-cinder-847732-5-smb devstack@keystone.service[81864]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 16:26:34.038568 dv-cinder-847732-5-smb devstack@keystone.service[81876]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 16:26:34.038568 dv-cinder-847732-5-smb devstack@keystone.service[81876]: from cryptography.utils import int_from_bytes Sep 07 16:26:34.039373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 16:26:34.039373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: from cryptography.utils import int_from_bytes Sep 07 16:26:34.081806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 16:26:34.081806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: from cryptography.utils import int_from_bytes Sep 07 16:26:34.082417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 16:26:34.082417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: from cryptography.utils import int_from_bytes Sep 07 16:26:34.089289 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 16:26:34.089485 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 16:26:34.089679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] command line args: [] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 16:26:34.089949 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 16:26:34.090125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ================================================================================ {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 16:26:34.090380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] admin_token = **** {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.090625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] config_dir = [] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.090811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.091005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] config_source = [] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.091176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] debug = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.091375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.091885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.091971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.092179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.092427 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.092657 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] list_limit = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.092837 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] log_config_append = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.093014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.093242 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] log_dir = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.093362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] log_file = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.093589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.093837 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.094083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.094331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.094508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.094685 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.094928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.095174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.095407 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.095667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.095904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.096131 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.096905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.097145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.097615 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.098070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.098251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] publish_errors = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.098484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.098716 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.098892 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.099140 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.099375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.099635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] standard_threads = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.099868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.100112 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.100288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.100464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] use_journal = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.100640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] use_json = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.100815 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] use_stderr = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.100990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] use_syslog = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.101222 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.101480 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.101720 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.101985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.102223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.102472 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.102710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.102956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.103192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.103438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.103711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.103961 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.104196 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.104440 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.104678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.104925 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.105173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.105411 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.105666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.105918 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.106166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.106402 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.106658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.106919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.107174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.107424 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.107687 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.108188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.108422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.108660 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.108910 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.109161 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.109391 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.109621 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.109869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.110114 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.110352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.110600 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.110832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.111069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.111304 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.111558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.111791 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.112643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.112880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.113099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.113352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.113584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.113821 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.114069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.114289 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.114526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.114776 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.115008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.115244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.115491 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.115739 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.115969 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.116206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.116437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.116689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.116928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.117170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.117404 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.117667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.117910 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.118146 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.118385 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.118623 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.118896 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.119135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.119384 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.119666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.119906 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.120141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.120378 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.120627 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.120892 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.121131 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.121375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.121613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.121860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.122097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.122334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.122570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.122805 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.123043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.123307 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.123572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.123823 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.124065 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.124302 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.124541 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.124777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.125015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.125253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.125484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.125715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.125946 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.126182 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.126412 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.126651 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.126889 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.127141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.127379 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.127693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.127958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.128203 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.128437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] auth.external = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.128672 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.128972 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.129207 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.129442 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] auth.password = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.129676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] auth.token = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.129917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.130154 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.130404 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.130636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.130886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.131135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.131369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.131630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] credential.caching = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.131881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.132130 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.132379 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.132623 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.132869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.133106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.133353 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.133606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.133844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.134097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.134214 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 16:26:34.134331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 16:26:34.134444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.134567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] command line args: [] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 16:26:34.134682 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.134779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 16:26:34.134874 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.134970 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ================================================================================ {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 16:26:34.135099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.135212 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] admin_token = **** {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.135358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.135503 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] config_dir = [] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.135621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.135736 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] federation.caching = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.135835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] config_source = [] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.135980 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.136089 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] debug = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.136207 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.136318 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.136468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.136591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.136714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.136821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.136940 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.137055 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.137159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.137271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.137391 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.137497 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] list_limit = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.137497 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] log_config_append = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.137711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.137823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.137928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.138049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] log_dir = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.138163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.138267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] log_file = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.138378 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.138500 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.138605 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] identity.caching = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.138726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.138841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.138944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.139056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.139169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.139169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.139402 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.139625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.139748 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.139862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.139967 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.140088 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.140204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.140320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.140433 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.140551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.140666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.140791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.140906 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.141019 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.141133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.141245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.141358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.141479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.141606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.141721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.141835 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.141835 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.142053 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.142248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.142366 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] publish_errors = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.142480 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.142593 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.142719 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.142847 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.142964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.143077 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.143195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.143386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.143575 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.143713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.143831 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.143945 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] standard_threads = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.144065 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.144065 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.144065 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.144386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.144503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.144617 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.144731 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.144850 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.144965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.145087 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] use_journal = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.145087 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] use_json = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.145301 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.145414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] use_stderr = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.145528 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.145641 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] use_syslog = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.145762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.145877 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 16:26:34.146024 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.146142 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.146263 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.146382 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.146504 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.146628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.146744 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.146857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.146970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.147084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.147206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.147320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.147433 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.147558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.147673 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.147802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.147927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.148041 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.148156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.148269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.148389 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.148504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.148625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.148739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.148853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.148966 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.149080 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.149194 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.149315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.149436 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.149551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.149664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.149777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.149891 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.150035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.150159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.150284 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.150400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.150514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.150628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.150742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.150855 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.150981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.151097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.151212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.151212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.151427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.151582 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.151709 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.151825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.151939 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.152053 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.152168 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.152282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.152408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.152524 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.152645 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.152761 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.152876 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.153003 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.153120 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.153244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.153361 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.153475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.153607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.153730 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.153847 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.153962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.154076 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.154190 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.154304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.154427 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.154543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.154657 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.154771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.154885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.154999 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.155122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.155237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.155351 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.155466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.155599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.155714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.155903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.156049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.156166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.156281 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.156395 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.156510 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.156632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.156748 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.156861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.156975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.157089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.157202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.157330 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.157446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.157561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.157675 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.157789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.157908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.158032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.158147 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.158261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.158383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.158502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.158618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.158732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.159378 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.159522 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.159624 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.159702 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.159773 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.159856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] resource.caching = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.159930 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.160006 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.160006 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.160006 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.160196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.160275 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.160347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.160473 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.160552 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.160712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.160790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.160960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.161046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.161196 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.161274 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.161434 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.161514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.161669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] role.caching = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.161749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.161916 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] role.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.161993 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.162145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.162222 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.162394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.162479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.162642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.162720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.162890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.162967 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.163137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.163216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.163386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.163462 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.163654 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.163741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.163896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.163975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.164137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.164214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.164368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.164451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.164615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.164693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.164857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.164935 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.165106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.165194 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.165349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.165429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.165610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.165774 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.165852 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.166016 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.166102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.166269 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.166348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.166522 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.166605 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.166760 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.166845 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.167010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.167087 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.167247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.167324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.167545 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.167629 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.167768 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.167845 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.168005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.168085 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.168243 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.168322 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.168474 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.168552 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.168705 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.168782 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.168955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.169039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.169208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.169286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.169456 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.169532 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.169690 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.169769 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.169922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.169998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.170152 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.170230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.170388 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] token.caching = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.170473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.170626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.170704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.170879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.171003 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.171098 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.171177 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.171354 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.171438 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.171625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.171708 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.171863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.171945 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.172099 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] auth.external = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.172178 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.172335 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.172416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.172579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.172661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.172816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.172896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.173056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.173141 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] auth.password = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.173291 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.173374 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] auth.token = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.173538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.173617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.173779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.173858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.174029 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.174118 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.174262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.174338 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.175146 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.175248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.175536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.connection = **** {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.175796 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.175941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.176044 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.176202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.176285 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.176436 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] credential.caching = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.176527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.176695 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.176775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.176953 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.177033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.177187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.177344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.177422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.177496 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.177657 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.177736 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.177894 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.177982 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.178145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.178225 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.178381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.178460 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.178627 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.178715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.178890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.178979 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.179109 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.179189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.179338 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.179433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.179609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.179804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.179886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.180003 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 16:26:34.180089 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.180307 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.180549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] federation.caching = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.180792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.181043 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.181294 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.181528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.181781 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.182022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.182320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.182580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.182839 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.183081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.183333 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.183595 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] identity.caching = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.183849 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.184099 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.184338 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.184577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.184827 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.185061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.185326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.185628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.185889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.186128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.186365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.186600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.186870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.187123 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.187374 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.187666 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.187920 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.188195 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.188437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.188679 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.188914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.189175 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.189411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.189650 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.189898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.190168 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.190947 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.191194 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.191453 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.191730 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.191974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.192228 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.192482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.192718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.192961 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.193197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.193466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.193712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.193962 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.194203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.194444 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.194695 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.194947 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.195184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.195417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.195695 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.195948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.196242 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.196429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.196669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.196969 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.197221 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.197486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.197722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.197972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.198221 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.198473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.198714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.198947 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.199186 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.199496 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.199745 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.199979 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.200229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.200479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.200728 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.200976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.201225 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.201457 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.201709 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.201951 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.202192 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.202429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.202670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.202921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.203306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.203586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.203962 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.204209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.204461 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.204705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.204946 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.205189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.205440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.205686 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.206991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.207249 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.207524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] resource.caching = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.207786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.208040 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.208283 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.208538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.208793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.209051 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.209302 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.209543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.209621 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.209786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.209865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.210025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] role.caching = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.210107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.210276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] role.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.210543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.210799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.211052 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.211304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.211582 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.211835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.212085 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.212334 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.212586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.212824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.213074 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.213329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.213579 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.213827 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.214253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.214493 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.214745 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.214998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.215250 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.215526 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.215765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.216023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.216277 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.216544 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.216778 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.217013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.217246 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.217499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.217755 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.218004 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.218244 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.218482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.218570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.218715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.218953 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] token.caching = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.219193 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.219443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.220629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.220629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.220629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.220629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.220629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.220918 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.221115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.221382 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.222742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.223013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.223275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.223611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.223853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.224130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.224406 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.224678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.connection = **** {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.224955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.225214 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.225480 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.225730 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.225974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.226218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.226458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.226700 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.226949 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.227190 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.227439 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.227703 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.227956 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.228197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.228446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.228680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.228925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.229164 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 16:26:34.229336 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 16:26:34.248616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.248847 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.256432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.256674 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.256902 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.265540 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.287382 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.287657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.303908 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.332592 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.354211 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.354443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.370131 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.370366 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.512895 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.513121 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.513342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.513559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.513776 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.513990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.514756 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.514994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.515220 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.515441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.515687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.515904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.537930 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.538158 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.538386 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.538607 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.538822 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.539033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.539113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.539244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.539336 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.539507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.539735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.539952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.540224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.540443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.550590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.551723 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.563330 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.563530 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.563764 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.563988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.564070 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.564210 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.564291 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.564424 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.564524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.564637 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81876) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.564718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.564856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.565588 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.566350 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 16:26:34.582619 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.582819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 16:26:34.583156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.583357 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 16:26:34.583664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.583931 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.584112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.584243 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.584378 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 16:26:34.584511 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.584652 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.584845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 16:26:34.585124 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.585389 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.585652 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.585913 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.593918 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.594202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.594477 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.594762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.595776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.616238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.616238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.616238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.616456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.616456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.616456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.616456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.616456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.616765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.616849 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.616849 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.616849 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.616849 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.616849 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.616849 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.617195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.617275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.617275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.617275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.617275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.617275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.617275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.617275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.617699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.617699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.617699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.617699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.630676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.632176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.632474 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.635816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.637098 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.637294 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.637378 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.637587 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.637711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.642437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.642719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.643023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.644596 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.644885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.650604 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.650906 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.651154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.651238 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.651459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.651554 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.651762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.654419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.654419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.654419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.655732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.656083 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.660392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.660392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.660392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.660392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.660392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.660392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.668408 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.668709 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.672569 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.676105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.676413 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.676840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.677147 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.680616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.681060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.683745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.684210 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.684547 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.687277 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.687603 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.691409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.691409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.691409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.691409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.691872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.693895 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.697295 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.697603 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.697950 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.698191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.698474 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.698881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.705101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.705394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.705682 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.706587 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.713609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.715141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.716280 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.716630 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.723449 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.723569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.723639 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.723716 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.723790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.723790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.723790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.723790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.723790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.724462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.726268 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.727857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.728147 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.730924 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.731212 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.731517 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.731816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.732050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.732134 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.732338 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.732628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.733169 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.733557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.733849 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.734144 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.744435 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.744722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.745006 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.745291 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.745587 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.745875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.746173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.749355 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.752279 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.755730 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.757160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.758637 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.758922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.759327 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.762868 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.765653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.765946 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.767112 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.770118 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.770647 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.771050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.771343 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.771652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.771809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.773308 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.773596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.773881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.779373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.779708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.780004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.780463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.781942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.785534 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.785830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.786137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.786425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.787061 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81876) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.787351 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.787662 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.787952 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.788234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.788513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.788793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.789070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.789341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.789616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.789901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.790172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.790436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.790706 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81876) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.794556 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.794903 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.795193 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.802961 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 16:26:34.803267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.803585 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.803868 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.804142 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.804416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.804709 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.805068 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.805348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.805633 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.805910 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.806174 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.806448 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.806727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 16:26:34.825566 dv-cinder-847732-5-smb devstack@keystone.service[81876]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5593545be9c0 pid: 81876 (default app) Sep 07 16:26:34.828928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d071ee-ff86-4a1c-8306-accd57d7b153 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:34.829213 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d071ee-ff86-4a1c-8306-accd57d7b153 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:34.829483 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d071ee-ff86-4a1c-8306-accd57d7b153 None None] PATH_INFO: `/v3` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:34.834325 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Wed Sep 7 16:26:34 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:26:34.844280 dv-cinder-847732-5-smb devstack@keystone.service[81877]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5593545be9c0 pid: 81877 (default app) Sep 07 16:26:42.665366 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6549621-335d-4d10-aeed-b0b67a5864e5 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:42.665831 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6549621-335d-4d10-aeed-b0b67a5864e5 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:42.665923 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6549621-335d-4d10-aeed-b0b67a5864e5 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:42.667190 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:26:42.674932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebd73e-6dda-4529-8fa9-a98cb90d8c45 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:42.675540 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebd73e-6dda-4529-8fa9-a98cb90d8c45 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:42.675540 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebd73e-6dda-4529-8fa9-a98cb90d8c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:42.758339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: INFO dbcounter [None req-15ebd73e-6dda-4529-8fa9-a98cb90d8c45 None None] Registered counter for database keystone Sep 07 16:26:42.780165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG oslo_db.sqlalchemy.engines [None req-15ebd73e-6dda-4529-8fa9-a98cb90d8c45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 16:26:42.787153 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writer thread running {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 16:26:42.973982 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG passlib.handlers.bcrypt [None req-15ebd73e-6dda-4529-8fa9-a98cb90d8c45 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81877) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 07 16:26:42.974291 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG passlib.handlers.bcrypt [None req-15ebd73e-6dda-4529-8fa9-a98cb90d8c45 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81877) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 07 16:26:43.036264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-15ebd73e-6dda-4529-8fa9-a98cb90d8c45 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:26:43.038331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-15ebd73e-6dda-4529-8fa9-a98cb90d8c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:26:43.185023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1/3] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:26:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 07 16:26:43.508430 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6549621-335d-4d10-aeed-b0b67a5864e5 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:43.579010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: INFO dbcounter [None req-b6549621-335d-4d10-aeed-b0b67a5864e5 None None] Registered counter for database keystone Sep 07 16:26:43.599060 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG oslo_db.sqlalchemy.engines [None req-b6549621-335d-4d10-aeed-b0b67a5864e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 16:26:43.605431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writer thread running {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 16:26:43.725056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6549621-335d-4d10-aeed-b0b67a5864e5 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:43.730544 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6421374-1c53-4e05-b473-54e9c8518419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:43.731188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6421374-1c53-4e05-b473-54e9c8518419 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:43.731468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6421374-1c53-4e05-b473-54e9c8518419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:43.731765 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6421374-1c53-4e05-b473-54e9c8518419 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:43.741152 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6421374-1c53-4e05-b473-54e9c8518419 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:43.793087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d6421374-1c53-4e05-b473-54e9c8518419 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 07 16:26:43.793335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6421374-1c53-4e05-b473-54e9c8518419 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:43.805427 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Sep 7 16:26:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:26:43.811444 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebd73e-6dda-4529-8fa9-a98cb90d8c45 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:43.826206 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebd73e-6dda-4529-8fa9-a98cb90d8c45 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:43.830832 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36ba51-f697-4f67-9371-e4ab2fbd1e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:43.831974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36ba51-f697-4f67-9371-e4ab2fbd1e70 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:43.832255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36ba51-f697-4f67-9371-e4ab2fbd1e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:43.832526 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36ba51-f697-4f67-9371-e4ab2fbd1e70 admin admin] PATH_INFO: `/v3/projects/ef7d1dd858dc44ab80c0562c9d3c8b52` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:43.833963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36ba51-f697-4f67-9371-e4ab2fbd1e70 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef7d1dd858dc44ab80c0562c9d3c8b52)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:43.887192 dv-cinder-847732-5-smb devstack@keystone.service[81877]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2f36ba51-f697-4f67-9371-e4ab2fbd1e70 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 07 16:26:43.887556 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36ba51-f697-4f67-9371-e4ab2fbd1e70 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:43.892089 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 2/5] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Sep 7 16:26:43 2022] GET /identity/v3/projects/ef7d1dd858dc44ab80c0562c9d3c8b52 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:26:46.054227 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8741f-96a7-4e72-a695-713636a0ebce None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:46.054777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8741f-96a7-4e72-a695-713636a0ebce None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:46.054777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8741f-96a7-4e72-a695-713636a0ebce None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:46.058975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 4/6] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:26:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:26:46.065490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa0c45-bcc4-46aa-82c3-39da9eafcfbe None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:46.065949 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa0c45-bcc4-46aa-82c3-39da9eafcfbe None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:46.066146 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa0c45-bcc4-46aa-82c3-39da9eafcfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:46.086555 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-daaa0c45-bcc4-46aa-82c3-39da9eafcfbe None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:26:46.088123 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-daaa0c45-bcc4-46aa-82c3-39da9eafcfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:26:46.095964 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 3/7] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:26:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 07 16:26:46.369199 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8741f-96a7-4e72-a695-713636a0ebce None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:46.382313 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8741f-96a7-4e72-a695-713636a0ebce None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:46.386716 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e52bb8-eb8b-435f-bc64-4e6feac331b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:46.387346 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e52bb8-eb8b-435f-bc64-4e6feac331b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:46.387657 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e52bb8-eb8b-435f-bc64-4e6feac331b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:46.387924 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e52bb8-eb8b-435f-bc64-4e6feac331b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:46.397397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e52bb8-eb8b-435f-bc64-4e6feac331b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:46.399167 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e52bb8-eb8b-435f-bc64-4e6feac331b1 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:46.409609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 5/8] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Sep 7 16:26:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:26:46.415541 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa0c45-bcc4-46aa-82c3-39da9eafcfbe None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:46.425619 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa0c45-bcc4-46aa-82c3-39da9eafcfbe None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:46.430159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1a780-20d2-46bc-b5cd-54eaeb110850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:46.430822 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1a780-20d2-46bc-b5cd-54eaeb110850 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:46.431098 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1a780-20d2-46bc-b5cd-54eaeb110850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:46.431368 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1a780-20d2-46bc-b5cd-54eaeb110850 admin admin] PATH_INFO: `/v3/users/f8a8b3ea701948c68e339fb34dbfff3f` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:46.432844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1a780-20d2-46bc-b5cd-54eaeb110850 admin admin] RBAC: Authorizing `identity:get_user(user_id=f8a8b3ea701948c68e339fb34dbfff3f)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:46.434738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1a780-20d2-46bc-b5cd-54eaeb110850 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:46.436423 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 4/9] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Sep 7 16:26:46 2022] GET /identity/v3/users/f8a8b3ea701948c68e339fb34dbfff3f => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:26:48.714706 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472333f6-b7c6-4a27-8ee5-4a11be179a18 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:48.715306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472333f6-b7c6-4a27-8ee5-4a11be179a18 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:48.715618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472333f6-b7c6-4a27-8ee5-4a11be179a18 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:48.717295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:26:48.724910 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbc87f-ed0c-4be7-bb67-bba35b252df9 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:48.725485 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbc87f-ed0c-4be7-bb67-bba35b252df9 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:48.725485 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbc87f-ed0c-4be7-bb67-bba35b252df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:48.751429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-3adbc87f-ed0c-4be7-bb67-bba35b252df9 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:26:48.753692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3adbc87f-ed0c-4be7-bb67-bba35b252df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:26:48.827782 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63236f1c-3468-4b4d-9b75-f80af89a5214 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:48.828063 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63236f1c-3468-4b4d-9b75-f80af89a5214 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:48.828339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63236f1c-3468-4b4d-9b75-f80af89a5214 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:48.829674 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 7/11] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:26:48.835675 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138eec4-edd4-491f-af0f-a003ce3e64ca None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:48.836079 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138eec4-edd4-491f-af0f-a003ce3e64ca None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:48.836375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138eec4-edd4-491f-af0f-a003ce3e64ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:48.881005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 5/12] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:26:48.884450 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG passlib.handlers.bcrypt [None req-e138eec4-edd4-491f-af0f-a003ce3e64ca None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81876) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 07 16:26:48.885017 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG passlib.handlers.bcrypt [None req-e138eec4-edd4-491f-af0f-a003ce3e64ca None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81876) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 07 16:26:48.934474 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-e138eec4-edd4-491f-af0f-a003ce3e64ca None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:26:48.936051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e138eec4-edd4-491f-af0f-a003ce3e64ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:26:49.047271 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 8/13] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:26:49.162020 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbc87f-ed0c-4be7-bb67-bba35b252df9 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:49.191771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:49.284577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbc87f-ed0c-4be7-bb67-bba35b252df9 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:49.321005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138eec4-edd4-491f-af0f-a003ce3e64ca None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:49.323339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b2961-3363-459a-b25e-b7c0e32ecebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:49.324100 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b2961-3363-459a-b25e-b7c0e32ecebc None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:49.324381 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b2961-3363-459a-b25e-b7c0e32ecebc None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:49.324653 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b2961-3363-459a-b25e-b7c0e32ecebc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:49.337461 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b2961-3363-459a-b25e-b7c0e32ecebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:26:49.346573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-fd9b2961-3363-459a-b25e-b7c0e32ecebc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:26:49.346573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:26:49.346573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:26:49.346573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:26:49.346573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:26:49.346573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:26:49.346573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:26:49.346573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:26:49.346573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:26:49.346573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:26:49.346573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:26:49.346573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:26:49.346573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:26:49.346573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:26:49.346573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:26:49.346573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:26:49.347692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:26:49.347692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:26:49.347692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:26:49.347692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:26:49.347692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:26:49.347692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:26:49.347692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:26:49.347692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:26:49.347692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:26:49.347692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:26:49.347692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:26:49.347692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:26:49.347692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:26:49.347692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:26:49.347692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:26:49.347692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:26:49.348862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:26:49.348862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:26:49.348862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:26:49.348862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:26:49.348862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:26:49.348862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:26:49.348862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:26:49.348862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:26:49.348862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:26:49.348862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:26:49.348862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:26:49.348862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:26:49.348862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 6/14] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:26:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:26:49.354009 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b2961-3363-459a-b25e-b7c0e32ecebc None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:49.450241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138eec4-edd4-491f-af0f-a003ce3e64ca None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:49.452667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:49.465591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:49.490831 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b688d-84d4-4621-a0fa-bb5d41b3014f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:49.491743 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b688d-84d4-4621-a0fa-bb5d41b3014f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:49.492024 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b688d-84d4-4621-a0fa-bb5d41b3014f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:49.492293 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b688d-84d4-4621-a0fa-bb5d41b3014f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:49.492818 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b2961-3363-459a-b25e-b7c0e32ecebc None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:49.536367 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9bb9f-08ef-47b5-9320-f8190d0d6637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:49.537140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9bb9f-08ef-47b5-9320-f8190d0d6637 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:49.537498 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9bb9f-08ef-47b5-9320-f8190d0d6637 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:49.537850 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9bb9f-08ef-47b5-9320-f8190d0d6637 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:49.538701 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9bb9f-08ef-47b5-9320-f8190d0d6637 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:26:49.539104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9bb9f-08ef-47b5-9320-f8190d0d6637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:49.540656 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9bb9f-08ef-47b5-9320-f8190d0d6637 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:49.556219 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 7/15] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:26:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:26:49.562207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9bb9f-08ef-47b5-9320-f8190d0d6637 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:49.574538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b688d-84d4-4621-a0fa-bb5d41b3014f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:49.576104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b688d-84d4-4621-a0fa-bb5d41b3014f None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:49.692471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9bb9f-08ef-47b5-9320-f8190d0d6637 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:49.713886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 9/16] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:26:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 16:26:49.723087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b688d-84d4-4621-a0fa-bb5d41b3014f None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:49.728223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:49.732263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951bb5c-364c-4454-bd39-ea4db518f7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:49.732911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951bb5c-364c-4454-bd39-ea4db518f7ca None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:49.733186 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951bb5c-364c-4454-bd39-ea4db518f7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:49.733453 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951bb5c-364c-4454-bd39-ea4db518f7ca None admin] PATH_INFO: `/v3/users/f8a8b3ea701948c68e339fb34dbfff3f` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:49.734728 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951bb5c-364c-4454-bd39-ea4db518f7ca None admin] RBAC: Authorizing `identity:get_user(user_id=f8a8b3ea701948c68e339fb34dbfff3f)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:49.736451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951bb5c-364c-4454-bd39-ea4db518f7ca None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:49.738282 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 8/17] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:26:49 2022] GET /identity/v3/users/f8a8b3ea701948c68e339fb34dbfff3f => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:26:49.746784 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951bb5c-364c-4454-bd39-ea4db518f7ca None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:49.766278 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:49.853604 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b688d-84d4-4621-a0fa-bb5d41b3014f None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:49.881961 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951bb5c-364c-4454-bd39-ea4db518f7ca None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:49.899788 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd67181-92d3-43a9-bb07-04bc7ebec8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:49.900648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd67181-92d3-43a9-bb07-04bc7ebec8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:49.900938 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd67181-92d3-43a9-bb07-04bc7ebec8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:49.901348 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd67181-92d3-43a9-bb07-04bc7ebec8c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:49.931996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd67181-92d3-43a9-bb07-04bc7ebec8c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:49.934100 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd67181-92d3-43a9-bb07-04bc7ebec8c2 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:49.938177 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f102c-7dc6-44f2-bc5b-fbfa30f47ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:49.938992 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f102c-7dc6-44f2-bc5b-fbfa30f47ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:49.939973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f102c-7dc6-44f2-bc5b-fbfa30f47ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:49.940336 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f102c-7dc6-44f2-bc5b-fbfa30f47ba4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:49.941854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f102c-7dc6-44f2-bc5b-fbfa30f47ba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:49.943647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f102c-7dc6-44f2-bc5b-fbfa30f47ba4 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:49.945410 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:26:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:26:49.952569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f102c-7dc6-44f2-bc5b-fbfa30f47ba4 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:49.967962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-4bd67181-92d3-43a9-bb07-04bc7ebec8c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:26:49.967962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:26:49.967962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:26:49.967962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:26:49.967962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:26:49.967962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:26:49.967962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:26:49.967962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:26:49.967962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:26:49.967962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:26:49.967962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:26:49.967962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:26:49.967962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:26:49.967962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:26:49.967962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:26:49.967962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:26:49.969036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:26:49.969036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:26:49.969036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:26:49.969036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:26:49.969036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:26:49.969036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:26:49.969036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:26:49.969036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:26:49.969036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:26:49.969036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:26:49.969036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:26:49.969036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:26:49.969036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:26:49.969036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:26:49.969036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:26:49.969036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:26:49.969036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:26:49.970185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:26:49.970185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:26:49.970185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:26:49.970185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:26:49.979450 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd67181-92d3-43a9-bb07-04bc7ebec8c2 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:50.053444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:50.069324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:50.090801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f102c-7dc6-44f2-bc5b-fbfa30f47ba4 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:50.115160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd67181-92d3-43a9-bb07-04bc7ebec8c2 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:50.140357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b6b1f-9618-4925-97f6-808ac9a74009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:50.141146 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b6b1f-9618-4925-97f6-808ac9a74009 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:50.141473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b6b1f-9618-4925-97f6-808ac9a74009 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:50.141786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b6b1f-9618-4925-97f6-808ac9a74009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:50.143315 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b6b1f-9618-4925-97f6-808ac9a74009 None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.domain.id=default, user.id=f8a8b3ea701948c68e339fb34dbfff3f) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:26:50.143703 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b6b1f-9618-4925-97f6-808ac9a74009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:50.145311 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b6b1f-9618-4925-97f6-808ac9a74009 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:50.153036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1322 bytes} [Wed Sep 7 16:26:49 2022] GET /identity/v3/role_assignments?user.id=f8a8b3ea701948c68e339fb34dbfff3f&scope.domain.id=default&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 233 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:26:50.163806 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343d22e-44fe-440c-ac93-df13e54ee0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:50.164731 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343d22e-44fe-440c-ac93-df13e54ee0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:50.165218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343d22e-44fe-440c-ac93-df13e54ee0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:50.165592 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343d22e-44fe-440c-ac93-df13e54ee0a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:50.166454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343d22e-44fe-440c-ac93-df13e54ee0a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:26:50.166904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343d22e-44fe-440c-ac93-df13e54ee0a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:50.168761 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343d22e-44fe-440c-ac93-df13e54ee0a3 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:50.192304 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 11/21] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:26:53.370809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6360bf-cfcc-4b88-bdce-5a46e966abe8 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:53.370809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6360bf-cfcc-4b88-bdce-5a46e966abe8 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:53.370809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6360bf-cfcc-4b88-bdce-5a46e966abe8 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:53.370809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 11/22] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:26:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:26:53.382900 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dcad5-d9ed-415d-b8ed-4882d423802d None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:53.384425 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dcad5-d9ed-415d-b8ed-4882d423802d None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:53.385193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dcad5-d9ed-415d-b8ed-4882d423802d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:53.425560 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-837dcad5-d9ed-415d-b8ed-4882d423802d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:26:53.428068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-837dcad5-d9ed-415d-b8ed-4882d423802d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:26:53.558956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:26:54.068715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de034bd-15eb-4af6-95a2-f075c5bd7ce9 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:54.069393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de034bd-15eb-4af6-95a2-f075c5bd7ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:54.069899 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de034bd-15eb-4af6-95a2-f075c5bd7ce9 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:54.071441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 12/24] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:26:54.089587 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b9f59-4338-4616-9db0-60521c829c95 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:54.090231 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b9f59-4338-4616-9db0-60521c829c95 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:54.090717 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b9f59-4338-4616-9db0-60521c829c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:54.108097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de034bd-15eb-4af6-95a2-f075c5bd7ce9 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:54.121529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-cb4b9f59-4338-4616-9db0-60521c829c95 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:26:54.123051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-cb4b9f59-4338-4616-9db0-60521c829c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:26:54.239722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:54.306848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 13/25] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:26:54.308212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c147708-eb38-4b07-a67d-10f5de454c31 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:54.308495 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c147708-eb38-4b07-a67d-10f5de454c31 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:54.308766 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c147708-eb38-4b07-a67d-10f5de454c31 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:54.310220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 14/26] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:26:54.316766 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366a1cd-ebe4-4182-975d-0a234ba8c372 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:54.317068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366a1cd-ebe4-4182-975d-0a234ba8c372 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:54.317309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366a1cd-ebe4-4182-975d-0a234ba8c372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:54.328088 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de034bd-15eb-4af6-95a2-f075c5bd7ce9 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:54.359025 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-7366a1cd-ebe4-4182-975d-0a234ba8c372 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:26:54.360616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7366a1cd-ebe4-4182-975d-0a234ba8c372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:26:54.413504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd422d-56a3-42c3-a522-a51b6f8f1e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:54.414769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd422d-56a3-42c3-a522-a51b6f8f1e9b None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:54.415198 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd422d-56a3-42c3-a522-a51b6f8f1e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:54.415679 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd422d-56a3-42c3-a522-a51b6f8f1e9b None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:54.416548 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd422d-56a3-42c3-a522-a51b6f8f1e9b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:54.419849 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd422d-56a3-42c3-a522-a51b6f8f1e9b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:54.505540 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 15/27] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:26:54.508488 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2d5a1-ff1a-4c7d-bafe-729199cc2b0c None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:54.509171 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2d5a1-ff1a-4c7d-bafe-729199cc2b0c None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:54.509776 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2d5a1-ff1a-4c7d-bafe-729199cc2b0c None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:54.512406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 16/28] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:26:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:26:54.521765 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1836-8fd8-489c-9116-d576a1da44d1 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:54.522479 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1836-8fd8-489c-9116-d576a1da44d1 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:54.523083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1836-8fd8-489c-9116-d576a1da44d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:54.561446 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f54a1836-8fd8-489c-9116-d576a1da44d1 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:26:54.563423 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f54a1836-8fd8-489c-9116-d576a1da44d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:26:54.794014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 17/29] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:26:54.795413 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1836-8fd8-489c-9116-d576a1da44d1 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:54.837878 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 13/30] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Sep 7 16:26:54 2022] POST /identity/v3/roles => generated 219 bytes in 730 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:26:54.863542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:54.884683 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd422d-56a3-42c3-a522-a51b6f8f1e9b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:54.898111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:54.980932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1836-8fd8-489c-9116-d576a1da44d1 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:55.042409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea7b4b-c721-4342-b449-6529c81f9d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:55.043441 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea7b4b-c721-4342-b449-6529c81f9d4c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:55.043909 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea7b4b-c721-4342-b449-6529c81f9d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:55.044332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea7b4b-c721-4342-b449-6529c81f9d4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:55.071842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea7b4b-c721-4342-b449-6529c81f9d4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:26:55.088648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-f5ea7b4b-c721-4342-b449-6529c81f9d4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:26:55.088648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:26:55.088648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:26:55.088648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:26:55.088648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:26:55.088648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:26:55.088648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:26:55.088648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:26:55.088648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:26:55.088648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:26:55.088648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:26:55.088648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:26:55.088648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:26:55.088648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:26:55.088648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:26:55.088648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:26:55.089693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:26:55.089693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:26:55.089693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:26:55.089693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:26:55.089693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:26:55.089693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:26:55.089693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:26:55.089693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:26:55.089693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:26:55.089693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:26:55.089693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:26:55.089693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:26:55.089693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:26:55.089693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:26:55.089693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:26:55.089693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:26:55.090579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:26:55.090579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:26:55.090579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:26:55.090579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:26:55.090579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:26:55.090579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:26:55.090579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:26:55.090579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:26:55.090579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:26:55.090579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:26:55.090579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:26:55.090579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:26:55.092595 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 18/31] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:26:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:26:55.100137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea7b4b-c721-4342-b449-6529c81f9d4c None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:55.176993 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd422d-56a3-42c3-a522-a51b6f8f1e9b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:55.252838 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4e116-fbfe-4ef6-b178-a062ba9947c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:55.254151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4e116-fbfe-4ef6-b178-a062ba9947c4 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:55.254755 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4e116-fbfe-4ef6-b178-a062ba9947c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:55.255418 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4e116-fbfe-4ef6-b178-a062ba9947c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:55.275193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:55.279971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4e116-fbfe-4ef6-b178-a062ba9947c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:55.282981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4e116-fbfe-4ef6-b178-a062ba9947c4 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:55.286692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea7b4b-c721-4342-b449-6529c81f9d4c None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:55.313779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-06b4e116-fbfe-4ef6-b178-a062ba9947c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:26:55.313779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:26:55.313779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:26:55.313779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:26:55.313779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:26:55.313779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:26:55.313779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:26:55.313779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:26:55.313779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:26:55.313779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:26:55.313779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:26:55.313779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:26:55.313779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:26:55.313779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:26:55.313779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:26:55.313779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:26:55.316369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:26:55.316369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:26:55.316369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:26:55.316369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:26:55.316369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:26:55.316369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:26:55.316369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:26:55.316369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:26:55.316369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:26:55.316369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:26:55.316369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:26:55.316369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:26:55.316369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:26:55.316369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:26:55.316369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:26:55.316369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:26:55.316369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:26:55.318220 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:26:55.318220 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:26:55.318220 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:26:55.320773 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 14/32] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:26:55.322274 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4e116-fbfe-4ef6-b178-a062ba9947c4 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:55.337777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9668e48-3857-45a3-8b71-baad7bf5ade1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:55.338393 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9668e48-3857-45a3-8b71-baad7bf5ade1 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:55.338835 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9668e48-3857-45a3-8b71-baad7bf5ade1 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:55.338989 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9668e48-3857-45a3-8b71-baad7bf5ade1 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:55.339635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9668e48-3857-45a3-8b71-baad7bf5ade1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:26:55.339940 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9668e48-3857-45a3-8b71-baad7bf5ade1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:55.341365 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9668e48-3857-45a3-8b71-baad7bf5ade1 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:55.357936 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 19/33] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:26:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:26:55.363749 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9668e48-3857-45a3-8b71-baad7bf5ade1 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:55.437080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:55.481070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9668e48-3857-45a3-8b71-baad7bf5ade1 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:55.498571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4e116-fbfe-4ef6-b178-a062ba9947c4 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:55.522221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc2e32-68f0-48d7-976f-69551480e968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:55.523808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc2e32-68f0-48d7-976f-69551480e968 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:55.524272 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc2e32-68f0-48d7-976f-69551480e968 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:55.524767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc2e32-68f0-48d7-976f-69551480e968 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:55.525608 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc2e32-68f0-48d7-976f-69551480e968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:26:55.526282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc2e32-68f0-48d7-976f-69551480e968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:55.527957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc2e32-68f0-48d7-976f-69551480e968 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:55.542210 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 20/34] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:26:55.543422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc2e32-68f0-48d7-976f-69551480e968 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:55.543807 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdbc11-fed0-479c-911b-8d55960b7559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:55.544523 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdbc11-fed0-479c-911b-8d55960b7559 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:55.544914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdbc11-fed0-479c-911b-8d55960b7559 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:55.545215 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdbc11-fed0-479c-911b-8d55960b7559 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:55.545983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdbc11-fed0-479c-911b-8d55960b7559 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:55.547649 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdbc11-fed0-479c-911b-8d55960b7559 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:55.569295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:55.646439 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 15/35] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Sep 7 16:26:55 2022] POST /identity/v3/roles => generated 225 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:26:55.647106 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdbc11-fed0-479c-911b-8d55960b7559 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:55.672125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc2e32-68f0-48d7-976f-69551480e968 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:55.743349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49acd73-64e3-4de8-abca-a93a3982a5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:55.744206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49acd73-64e3-4de8-abca-a93a3982a5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:55.744490 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49acd73-64e3-4de8-abca-a93a3982a5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:55.744769 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49acd73-64e3-4de8-abca-a93a3982a5a6 None admin] PATH_INFO: `/v3/users/f8a8b3ea701948c68e339fb34dbfff3f` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:55.746554 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49acd73-64e3-4de8-abca-a93a3982a5a6 None admin] RBAC: Authorizing `identity:get_user(user_id=f8a8b3ea701948c68e339fb34dbfff3f)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:55.748298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49acd73-64e3-4de8-abca-a93a3982a5a6 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:55.750141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 21/36] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:26:55 2022] GET /identity/v3/users/f8a8b3ea701948c68e339fb34dbfff3f => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:26:55.751695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae101b-3ead-4117-9719-9c31046f3980 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:55.752083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae101b-3ead-4117-9719-9c31046f3980 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:55.752365 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae101b-3ead-4117-9719-9c31046f3980 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:55.758298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 22/37] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:26:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:26:55.759282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae101b-3ead-4117-9719-9c31046f3980 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:55.884820 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdbc11-fed0-479c-911b-8d55960b7559 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:55.918538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:55.920673 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:55.941608 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae101b-3ead-4117-9719-9c31046f3980 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:55.943395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9b97b-8045-414d-a82b-455e91aadfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:55.943682 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9b97b-8045-414d-a82b-455e91aadfb1 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:55.943965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9b97b-8045-414d-a82b-455e91aadfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:55.944238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9b97b-8045-414d-a82b-455e91aadfb1 None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:55.944905 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9b97b-8045-414d-a82b-455e91aadfb1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:55.946393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9b97b-8045-414d-a82b-455e91aadfb1 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:55.990381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bade099-79fd-4403-bd8d-7b738cffb0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:55.991122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bade099-79fd-4403-bd8d-7b738cffb0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:55.991401 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bade099-79fd-4403-bd8d-7b738cffb0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:55.991733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bade099-79fd-4403-bd8d-7b738cffb0b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:55.993074 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bade099-79fd-4403-bd8d-7b738cffb0b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:55.995593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bade099-79fd-4403-bd8d-7b738cffb0b7 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:55.997348 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 23/38] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:26:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:26:55.998631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90e65d-8414-4249-a4e9-662a2aff4055 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:55.998886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90e65d-8414-4249-a4e9-662a2aff4055 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:55.999157 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90e65d-8414-4249-a4e9-662a2aff4055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:56.019425 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-cc90e65d-8414-4249-a4e9-662a2aff4055 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:26:56.020865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-cc90e65d-8414-4249-a4e9-662a2aff4055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:26:56.081485 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 16/39] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Sep 7 16:26:55 2022] POST /identity/v3/projects => generated 301 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:26:56.082968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1542f4-d886-4071-9b4b-e4dc40d5415d None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:56.083250 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1542f4-d886-4071-9b4b-e4dc40d5415d None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:56.083597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1542f4-d886-4071-9b4b-e4dc40d5415d None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:56.085132 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 17/40] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:26:56.088126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1542f4-d886-4071-9b4b-e4dc40d5415d None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:56.109507 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 24/41] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:26:56.111948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d7281-cb71-4f51-9bf5-a75e381164c5 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:56.112495 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d7281-cb71-4f51-9bf5-a75e381164c5 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:56.112903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d7281-cb71-4f51-9bf5-a75e381164c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:56.145798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-e40d7281-cb71-4f51-9bf5-a75e381164c5 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:26:56.147407 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e40d7281-cb71-4f51-9bf5-a75e381164c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:26:56.271029 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 25/42] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:26:56.294031 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1542f4-d886-4071-9b4b-e4dc40d5415d None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:56.332772 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391354c7-2634-4f57-8847-b3035cf69179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:56.333453 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391354c7-2634-4f57-8847-b3035cf69179 None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:56.333733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391354c7-2634-4f57-8847-b3035cf69179 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:56.334299 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391354c7-2634-4f57-8847-b3035cf69179 None admin] PATH_INFO: `/v3/domains/default/users/f8a8b3ea701948c68e339fb34dbfff3f/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:56.336389 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391354c7-2634-4f57-8847-b3035cf69179 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f8a8b3ea701948c68e339fb34dbfff3f, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:56.337943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391354c7-2634-4f57-8847-b3035cf69179 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:56.433370 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d7281-cb71-4f51-9bf5-a75e381164c5 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:56.434381 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 18/43] 10.222.0.25 () {58 vars in 1361 bytes} [Wed Sep 7 16:26:56 2022] PUT /identity/v3/domains/default/users/f8a8b3ea701948c68e339fb34dbfff3f/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:26:56.456946 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:56.544605 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391354c7-2634-4f57-8847-b3035cf69179 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:56.560740 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d7281-cb71-4f51-9bf5-a75e381164c5 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:56.595952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:56.604361 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d568b-fcae-4f5d-8daf-608b5f26037d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:56.605335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d568b-fcae-4f5d-8daf-608b5f26037d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:56.607425 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d568b-fcae-4f5d-8daf-608b5f26037d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:56.607425 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d568b-fcae-4f5d-8daf-608b5f26037d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:56.608261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d568b-fcae-4f5d-8daf-608b5f26037d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:56.609971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d568b-fcae-4f5d-8daf-608b5f26037d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:56.612448 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 26/44] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:26:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:26:56.618229 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d568b-fcae-4f5d-8daf-608b5f26037d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:56.691634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391354c7-2634-4f57-8847-b3035cf69179 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:56.736567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaaaa0-ce09-4b5b-9fdc-71de900e9a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:56.737240 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaaaa0-ce09-4b5b-9fdc-71de900e9a6d None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:56.737521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaaaa0-ce09-4b5b-9fdc-71de900e9a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:56.738014 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaaaa0-ce09-4b5b-9fdc-71de900e9a6d None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:56.738474 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaaaa0-ce09-4b5b-9fdc-71de900e9a6d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:56.741128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaaaa0-ce09-4b5b-9fdc-71de900e9a6d None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:56.742035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:56.761386 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d568b-fcae-4f5d-8daf-608b5f26037d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:56.798908 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c63cb9-9c1b-4170-ab89-8be20a6af88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:56.800165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c63cb9-9c1b-4170-ab89-8be20a6af88c None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:56.800934 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 19/45] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Sep 7 16:26:56 2022] POST /identity/v3/roles => generated 223 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:26:56.801119 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c63cb9-9c1b-4170-ab89-8be20a6af88c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:56.801421 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c63cb9-9c1b-4170-ab89-8be20a6af88c None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:56.802180 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c63cb9-9c1b-4170-ab89-8be20a6af88c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:56.805291 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c63cb9-9c1b-4170-ab89-8be20a6af88c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:57.123926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 27/46] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Sep 7 16:26:56 2022] POST /identity/v3/projects => generated 312 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:26:58.679876 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fd89e-94c7-496e-9340-0b9487ae151b None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:58.680421 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fd89e-94c7-496e-9340-0b9487ae151b None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:58.680421 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fd89e-94c7-496e-9340-0b9487ae151b None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:58.681920 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 20/47] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:26:58.688425 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9484f7-14a5-4567-abbd-d4aea460e0ee None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:58.691194 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9484f7-14a5-4567-abbd-d4aea460e0ee None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:58.691417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9484f7-14a5-4567-abbd-d4aea460e0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:58.713453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-2a9484f7-14a5-4567-abbd-d4aea460e0ee None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:26:58.714949 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2a9484f7-14a5-4567-abbd-d4aea460e0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:26:58.792562 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 28/48] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:26:59.065077 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fd89e-94c7-496e-9340-0b9487ae151b None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:59.170499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:59.189826 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fd89e-94c7-496e-9340-0b9487ae151b None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:59.229213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779b04f-cc78-4a54-809e-4a9ea0958726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:59.229851 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779b04f-cc78-4a54-809e-4a9ea0958726 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:59.230133 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779b04f-cc78-4a54-809e-4a9ea0958726 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:59.230406 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779b04f-cc78-4a54-809e-4a9ea0958726 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:59.309218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556cec9-ccaa-4eaa-ace1-89dc57ee841b None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:59.309505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556cec9-ccaa-4eaa-ace1-89dc57ee841b None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:59.309817 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556cec9-ccaa-4eaa-ace1-89dc57ee841b None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:59.311221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 29/49] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:26:59.317697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe68d4-809d-40cb-8e51-5cc68a29cd53 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:59.317900 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe68d4-809d-40cb-8e51-5cc68a29cd53 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:59.318179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe68d4-809d-40cb-8e51-5cc68a29cd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:59.337983 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-3dbe68d4-809d-40cb-8e51-5cc68a29cd53 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:26:59.339190 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3dbe68d4-809d-40cb-8e51-5cc68a29cd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:26:59.354081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779b04f-cc78-4a54-809e-4a9ea0958726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:26:59.359441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-b779b04f-cc78-4a54-809e-4a9ea0958726 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:26:59.359441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:26:59.359441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:26:59.359441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:26:59.359441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:26:59.359441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:26:59.359441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:26:59.359441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:26:59.359441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:26:59.359441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:26:59.359441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:26:59.359441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:26:59.359441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:26:59.359441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:26:59.359441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:26:59.359441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:26:59.360377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:26:59.360377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:26:59.360377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:26:59.360377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:26:59.360377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:26:59.360377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:26:59.360377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:26:59.360377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:26:59.360377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:26:59.360377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:26:59.360377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:26:59.360377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:26:59.360377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:26:59.360377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:26:59.360377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:26:59.360377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:26:59.361385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:26:59.361385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:26:59.361385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:26:59.361385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:26:59.361385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:26:59.361385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:26:59.361385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:26:59.361385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:26:59.361385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:26:59.361385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:26:59.361385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:26:59.361385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:26:59.361385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 21/50] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:26:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:26:59.366382 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779b04f-cc78-4a54-809e-4a9ea0958726 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:59.401885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:59.409964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 30/51] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:26:59.471260 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779b04f-cc78-4a54-809e-4a9ea0958726 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:59.505646 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad83541-d49b-48ab-923e-7fbeb113cacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:59.506352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad83541-d49b-48ab-923e-7fbeb113cacf None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:59.506585 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad83541-d49b-48ab-923e-7fbeb113cacf None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:59.506858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad83541-d49b-48ab-923e-7fbeb113cacf None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:59.507543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad83541-d49b-48ab-923e-7fbeb113cacf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:26:59.507847 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad83541-d49b-48ab-923e-7fbeb113cacf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:59.509232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad83541-d49b-48ab-923e-7fbeb113cacf None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:59.518439 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 22/52] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:26:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:26:59.524210 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe68d4-809d-40cb-8e51-5cc68a29cd53 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:59.623191 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe68d4-809d-40cb-8e51-5cc68a29cd53 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:59.656965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1747fc3-e3bc-49ee-8676-c7457960c5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:59.657651 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1747fc3-e3bc-49ee-8676-c7457960c5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:59.657970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1747fc3-e3bc-49ee-8676-c7457960c5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:59.658309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1747fc3-e3bc-49ee-8676-c7457960c5e1 None admin] PATH_INFO: `/v3/users/f8a8b3ea701948c68e339fb34dbfff3f` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:59.659438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1747fc3-e3bc-49ee-8676-c7457960c5e1 None admin] RBAC: Authorizing `identity:get_user(user_id=f8a8b3ea701948c68e339fb34dbfff3f)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:59.661041 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1747fc3-e3bc-49ee-8676-c7457960c5e1 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:59.662630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 31/53] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:26:59 2022] GET /identity/v3/users/f8a8b3ea701948c68e339fb34dbfff3f => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:26:59.668132 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad83541-d49b-48ab-923e-7fbeb113cacf None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:59.678599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1747fc3-e3bc-49ee-8676-c7457960c5e1 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:59.682525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:59.741593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:59.773581 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad83541-d49b-48ab-923e-7fbeb113cacf None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:59.782183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1747fc3-e3bc-49ee-8676-c7457960c5e1 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:59.807516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235eb08-d386-4862-8e2a-67a4d2de20d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:59.808151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235eb08-d386-4862-8e2a-67a4d2de20d7 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:59.808430 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235eb08-d386-4862-8e2a-67a4d2de20d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:59.808706 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235eb08-d386-4862-8e2a-67a4d2de20d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:59.809811 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235eb08-d386-4862-8e2a-67a4d2de20d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:59.811257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235eb08-d386-4862-8e2a-67a4d2de20d7 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:59.812853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 23/54] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:26:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:26:59.817174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3189ff2-6a9b-4a07-bd31-16b2fd20067e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:59.817814 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3189ff2-6a9b-4a07-bd31-16b2fd20067e None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:59.818188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3189ff2-6a9b-4a07-bd31-16b2fd20067e None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:59.818468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3189ff2-6a9b-4a07-bd31-16b2fd20067e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:59.819125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235eb08-d386-4862-8e2a-67a4d2de20d7 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:59.819696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3189ff2-6a9b-4a07-bd31-16b2fd20067e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:59.821149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3189ff2-6a9b-4a07-bd31-16b2fd20067e None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:59.822862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 32/55] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:26:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:26:59.828113 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3189ff2-6a9b-4a07-bd31-16b2fd20067e None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:26:59.898324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:59.919809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235eb08-d386-4862-8e2a-67a4d2de20d7 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:59.933165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3189ff2-6a9b-4a07-bd31-16b2fd20067e None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:26:59.955889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a086c09-0d91-4bd5-878f-15ef5172695f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:59.956495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a086c09-0d91-4bd5-878f-15ef5172695f None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:59.956775 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a086c09-0d91-4bd5-878f-15ef5172695f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:59.957049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a086c09-0d91-4bd5-878f-15ef5172695f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:59.957767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a086c09-0d91-4bd5-878f-15ef5172695f None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.domain.id=default, user.id=f8a8b3ea701948c68e339fb34dbfff3f) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:26:59.958073 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a086c09-0d91-4bd5-878f-15ef5172695f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:59.959528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a086c09-0d91-4bd5-878f-15ef5172695f None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:26:59.961455 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:26:59.965261 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 24/56] 10.222.0.25 () {56 vars in 1322 bytes} [Wed Sep 7 16:26:59 2022] GET /identity/v3/role_assignments?user.id=f8a8b3ea701948c68e339fb34dbfff3f&scope.domain.id=default&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:26:59.967583 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14a71f-cafb-465e-bf33-a459955e03c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:26:59.968282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14a71f-cafb-465e-bf33-a459955e03c8 None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:26:59.968506 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14a71f-cafb-465e-bf33-a459955e03c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:26:59.968784 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14a71f-cafb-465e-bf33-a459955e03c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:26:59.969435 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14a71f-cafb-465e-bf33-a459955e03c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:26:59.971559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14a71f-cafb-465e-bf33-a459955e03c8 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:00.052320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 33/57] 10.222.0.25 () {60 vars in 1140 bytes} [Wed Sep 7 16:26:59 2022] POST /identity/v3/projects => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:27:02.354705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af81a0b-b7fc-43a7-a8d6-db57da0f7ce3 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:02.355276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af81a0b-b7fc-43a7-a8d6-db57da0f7ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:02.355276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af81a0b-b7fc-43a7-a8d6-db57da0f7ce3 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:02.356904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 25/58] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:27:02.363402 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e28ec-20d8-4567-8fda-c472e64d3bc4 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:02.363885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e28ec-20d8-4567-8fda-c472e64d3bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:02.364002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e28ec-20d8-4567-8fda-c472e64d3bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:02.382902 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-898e28ec-20d8-4567-8fda-c472e64d3bc4 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:02.384147 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-898e28ec-20d8-4567-8fda-c472e64d3bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:02.452897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 34/59] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:02.727561 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af81a0b-b7fc-43a7-a8d6-db57da0f7ce3 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:02.833805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af81a0b-b7fc-43a7-a8d6-db57da0f7ce3 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:02.869799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ece354-c02e-4d25-a32b-16597930830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:02.870455 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ece354-c02e-4d25-a32b-16597930830d None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:02.870738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ece354-c02e-4d25-a32b-16597930830d None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:02.871012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ece354-c02e-4d25-a32b-16597930830d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:02.872192 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ece354-c02e-4d25-a32b-16597930830d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:02.873677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ece354-c02e-4d25-a32b-16597930830d None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:02.875288 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 26/60] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:27:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:02.881863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e28ec-20d8-4567-8fda-c472e64d3bc4 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:02.992779 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e28ec-20d8-4567-8fda-c472e64d3bc4 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:03.007498 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:03.030897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b39732-35fb-4e9c-af8a-2f1a99f77a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:03.031544 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b39732-35fb-4e9c-af8a-2f1a99f77a34 None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:03.031833 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b39732-35fb-4e9c-af8a-2f1a99f77a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:03.032665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b39732-35fb-4e9c-af8a-2f1a99f77a34 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:03.033337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b39732-35fb-4e9c-af8a-2f1a99f77a34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:03.034814 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b39732-35fb-4e9c-af8a-2f1a99f77a34 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:03.136698 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 35/61] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:27:02 2022] POST /identity/v3/users => generated 275 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:27:06.935965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd03c66-6db1-4ee3-80b4-7d1158460ae1 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:06.936743 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd03c66-6db1-4ee3-80b4-7d1158460ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:06.936743 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd03c66-6db1-4ee3-80b4-7d1158460ae1 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:06.938617 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 27/62] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:06.944593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b620468-b241-4885-8b2f-a6d7387e8d5a None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:06.945317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b620468-b241-4885-8b2f-a6d7387e8d5a None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:06.945317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b620468-b241-4885-8b2f-a6d7387e8d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:06.972554 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8b620468-b241-4885-8b2f-a6d7387e8d5a None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:06.973768 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8b620468-b241-4885-8b2f-a6d7387e8d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:07.069916 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 36/63] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:07.397230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd03c66-6db1-4ee3-80b4-7d1158460ae1 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:07.415670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:07.488127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad85d1e-c5b1-4a60-969e-eef728062c0f None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:07.488638 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad85d1e-c5b1-4a60-969e-eef728062c0f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:07.489056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad85d1e-c5b1-4a60-969e-eef728062c0f None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:07.490588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 37/64] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:27:07.496593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e59b23-9963-48d3-b8e3-bfea860b89f7 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:07.497122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e59b23-9963-48d3-b8e3-bfea860b89f7 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:07.497541 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e59b23-9963-48d3-b8e3-bfea860b89f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:07.547213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd03c66-6db1-4ee3-80b4-7d1158460ae1 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:07.550668 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-59e59b23-9963-48d3-b8e3-bfea860b89f7 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:07.551928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-59e59b23-9963-48d3-b8e3-bfea860b89f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:07.590771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cb692-7da1-4569-8f26-67c2bf467a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:07.591413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cb692-7da1-4569-8f26-67c2bf467a93 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:07.591880 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cb692-7da1-4569-8f26-67c2bf467a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:07.592476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cb692-7da1-4569-8f26-67c2bf467a93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:07.606146 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cb692-7da1-4569-8f26-67c2bf467a93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:07.613011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-371cb692-7da1-4569-8f26-67c2bf467a93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:27:07.613011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:07.613011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:07.613011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:07.613011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:07.613011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:07.613011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:07.613011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:07.613011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:07.613011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:07.613011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:07.613011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:07.613011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:07.613011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:07.613011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:07.613011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:07.613914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:07.613914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:07.613914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:07.613914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:07.613914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:07.613914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:07.613914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:07.613914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:07.613914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:07.613914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:07.613914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:07.613914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:07.613914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:07.613914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:07.613914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:07.613914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:07.614663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:07.614663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:07.614663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:07.614663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:07.614663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:07.614663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:07.614663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:07.614663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:07.614663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:07.614663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:07.614663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:27:07.614663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:07.617142 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 28/65] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:27:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:07.618843 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3991acb-e9e1-439b-a65c-2eb0a9e78d39 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:07.619190 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3991acb-e9e1-439b-a65c-2eb0a9e78d39 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:07.619673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3991acb-e9e1-439b-a65c-2eb0a9e78d39 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:07.621173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 29/66] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:07.628673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74551f0-9de5-4cde-be8e-42928b028789 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:07.629162 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74551f0-9de5-4cde-be8e-42928b028789 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:07.629566 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74551f0-9de5-4cde-be8e-42928b028789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:07.644962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 38/67] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 07 16:27:07.646369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e59b23-9963-48d3-b8e3-bfea860b89f7 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:07.649064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-b74551f0-9de5-4cde-be8e-42928b028789 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:07.650845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b74551f0-9de5-4cde-be8e-42928b028789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:07.699585 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:07.828034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:07.837322 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 30/68] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:07.860834 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e59b23-9963-48d3-b8e3-bfea860b89f7 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:07.878694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac937676-ef17-4516-90ea-35c02213f04c None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:07.878991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac937676-ef17-4516-90ea-35c02213f04c None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:07.879302 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac937676-ef17-4516-90ea-35c02213f04c None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:07.880878 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 31/69] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:27:07.895884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e761724-b33c-4a43-b4ff-56f114bd6dcb None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:07.896667 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e761724-b33c-4a43-b4ff-56f114bd6dcb None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:07.897347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e761724-b33c-4a43-b4ff-56f114bd6dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:07.938209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-3e761724-b33c-4a43-b4ff-56f114bd6dcb None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:07.939355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3e761724-b33c-4a43-b4ff-56f114bd6dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:07.942265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151fe4c-952b-4ee4-8941-d2c5edf8b285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:07.943198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151fe4c-952b-4ee4-8941-d2c5edf8b285 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:07.943737 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151fe4c-952b-4ee4-8941-d2c5edf8b285 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:07.944241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151fe4c-952b-4ee4-8941-d2c5edf8b285 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:07.945396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151fe4c-952b-4ee4-8941-d2c5edf8b285 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:07.945933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151fe4c-952b-4ee4-8941-d2c5edf8b285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:07.949976 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151fe4c-952b-4ee4-8941-d2c5edf8b285 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:07.961723 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 39/70] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:07.962785 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151fe4c-952b-4ee4-8941-d2c5edf8b285 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:08.043301 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 32/71] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:27:08.044803 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e761724-b33c-4a43-b4ff-56f114bd6dcb None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:08.122500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:08.165888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151fe4c-952b-4ee4-8941-d2c5edf8b285 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:08.169820 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e761724-b33c-4a43-b4ff-56f114bd6dcb None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:08.207177 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:08.213433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4ad91-e441-4639-abe3-93b0baefd1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:08.214400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4ad91-e441-4639-abe3-93b0baefd1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:08.214843 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4ad91-e441-4639-abe3-93b0baefd1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:08.215268 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4ad91-e441-4639-abe3-93b0baefd1a5 None admin] PATH_INFO: `/v3/users/f8a8b3ea701948c68e339fb34dbfff3f` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:08.216890 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4ad91-e441-4639-abe3-93b0baefd1a5 None admin] RBAC: Authorizing `identity:get_user(user_id=f8a8b3ea701948c68e339fb34dbfff3f)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:08.218625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4ad91-e441-4639-abe3-93b0baefd1a5 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:08.221715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 33/72] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:08 2022] GET /identity/v3/users/f8a8b3ea701948c68e339fb34dbfff3f => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:08.222921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4ad91-e441-4639-abe3-93b0baefd1a5 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:08.245092 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaf909-b2f6-4a4a-a25e-18612ea83b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:08.246022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaf909-b2f6-4a4a-a25e-18612ea83b06 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:08.246455 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaf909-b2f6-4a4a-a25e-18612ea83b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:08.246908 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaf909-b2f6-4a4a-a25e-18612ea83b06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:08.264016 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaaf909-b2f6-4a4a-a25e-18612ea83b06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:08.273352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-efaaf909-b2f6-4a4a-a25e-18612ea83b06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:08.273352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:08.273352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:08.273352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:08.273352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:08.273352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:08.273352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:08.273352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:08.273352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:08.273352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:08.273352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:08.273352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:08.273352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:08.273352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:08.273352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:08.273352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:08.274762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:08.274762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:08.274762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:08.274762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:08.274762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:08.274762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:08.274762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:08.274762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:08.274762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:08.274762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:08.274762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:08.274762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:08.274762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:08.274762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:08.274762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:08.274762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:08.276001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:08.276001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:08.276001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:08.276001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:08.276001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:08.276001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:08.276001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:08.276001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:08.276001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:08.276001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:08.276001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:08.276001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:27:08.286276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 40/73] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:08.288403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaf909-b2f6-4a4a-a25e-18612ea83b06 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:08.396692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4ad91-e441-4639-abe3-93b0baefd1a5 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:08.434802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85703f3c-3793-4f8e-b50c-0b928b85e7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:08.435468 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85703f3c-3793-4f8e-b50c-0b928b85e7bd None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:08.435788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85703f3c-3793-4f8e-b50c-0b928b85e7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:08.436060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85703f3c-3793-4f8e-b50c-0b928b85e7bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:08.448311 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85703f3c-3793-4f8e-b50c-0b928b85e7bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:08.451770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaf909-b2f6-4a4a-a25e-18612ea83b06 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:08.453383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-85703f3c-3793-4f8e-b50c-0b928b85e7bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:27:08.453383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:08.453383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:08.453383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:08.453383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:08.453383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:08.453383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:08.453383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:08.453383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:08.453383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:08.453383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:08.453383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:08.453383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:08.453383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:08.453383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:08.453383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:08.454881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:08.454881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:08.454881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:08.454881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:08.454881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:08.454881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:08.454881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:08.454881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:08.454881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:08.454881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:08.454881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:08.454881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:08.454881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:08.454881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:08.454881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:08.454881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:08.455824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:08.455824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:08.455824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:08.455824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:08.455824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:08.455824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:08.455824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:08.455824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:08.455824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:08.455824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:08.455824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:27:08.455824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:08.455824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 34/74] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:27:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:08.457032 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85703f3c-3793-4f8e-b50c-0b928b85e7bd None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:08.504374 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183876e-5956-4798-ad2e-2c068361c252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:08.505095 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183876e-5956-4798-ad2e-2c068361c252 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:08.505494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183876e-5956-4798-ad2e-2c068361c252 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:08.505912 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183876e-5956-4798-ad2e-2c068361c252 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:08.527025 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:08.532126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:08.586631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183876e-5956-4798-ad2e-2c068361c252 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:08.588179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183876e-5956-4798-ad2e-2c068361c252 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:08.599164 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85703f3c-3793-4f8e-b50c-0b928b85e7bd None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:08.641644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533da87-951a-4bec-9486-8a8730b03d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:08.642421 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533da87-951a-4bec-9486-8a8730b03d26 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:08.642780 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533da87-951a-4bec-9486-8a8730b03d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:08.643051 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533da87-951a-4bec-9486-8a8730b03d26 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:08.643759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533da87-951a-4bec-9486-8a8730b03d26 None admin] RBAC: Adding query filter params (name=member) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:08.644059 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533da87-951a-4bec-9486-8a8730b03d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:08.645493 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533da87-951a-4bec-9486-8a8730b03d26 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:08.656480 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 35/75] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:08.662894 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd957c77-9e7a-415c-b18d-203dd8a05412 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:08.663175 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd957c77-9e7a-415c-b18d-203dd8a05412 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:08.663448 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd957c77-9e7a-415c-b18d-203dd8a05412 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:08.664867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 36/76] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:08.668546 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd957c77-9e7a-415c-b18d-203dd8a05412 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:08.702241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 41/77] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:27:08.703098 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183876e-5956-4798-ad2e-2c068361c252 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:08.767329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:08.800427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd957c77-9e7a-415c-b18d-203dd8a05412 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:08.832307 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:08.842349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183876e-5956-4798-ad2e-2c068361c252 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:08.848861 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1c039-78bd-4da7-a2e8-5483d044452d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:08.849606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1c039-78bd-4da7-a2e8-5483d044452d None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:08.849925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1c039-78bd-4da7-a2e8-5483d044452d None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:08.850236 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1c039-78bd-4da7-a2e8-5483d044452d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:08.864176 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1c039-78bd-4da7-a2e8-5483d044452d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:08.870063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-3ab1c039-78bd-4da7-a2e8-5483d044452d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:08.870063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:08.870063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:08.870063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:08.870063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:08.870063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:08.870063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:08.870063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:08.870063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:08.870063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:08.870063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:08.870063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:08.870063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:08.870063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:08.870063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:08.870063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:08.870989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:08.870989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:08.870989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:08.870989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:08.870989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:08.870989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:08.870989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:08.870989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:08.870989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:08.870989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:08.870989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:08.870989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:08.870989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:08.870989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:08.870989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:08.870989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:08.871823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:08.871823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:08.871823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:08.871823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:08.871823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:08.871823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:08.871823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:08.871823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:08.871823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:08.871823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:08.871823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:08.871823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:08.871823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 37/78] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:08.872676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1c039-78bd-4da7-a2e8-5483d044452d None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:08.892332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9613f8-4160-4c2f-a093-4415fcef6acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:08.892956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9613f8-4160-4c2f-a093-4415fcef6acf None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:08.893234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9613f8-4160-4c2f-a093-4415fcef6acf None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:08.893512 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9613f8-4160-4c2f-a093-4415fcef6acf None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:08.894181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9613f8-4160-4c2f-a093-4415fcef6acf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:08.894484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9613f8-4160-4c2f-a093-4415fcef6acf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:08.895939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9613f8-4160-4c2f-a093-4415fcef6acf None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:08.905080 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 42/79] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:27:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:08.906347 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81a95f-a209-410b-aa73-0f0af659deba None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:08.907313 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81a95f-a209-410b-aa73-0f0af659deba None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:08.907620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81a95f-a209-410b-aa73-0f0af659deba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:08.927418 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-ef81a95f-a209-410b-aa73-0f0af659deba None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:08.928698 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ef81a95f-a209-410b-aa73-0f0af659deba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:09.003925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1c039-78bd-4da7-a2e8-5483d044452d None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:09.015778 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 43/80] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:09.018185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81a95f-a209-410b-aa73-0f0af659deba None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:09.082029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4f9f1-d576-434b-a8f2-ae6e2455c23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:09.083002 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4f9f1-d576-434b-a8f2-ae6e2455c23c None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:09.083427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4f9f1-d576-434b-a8f2-ae6e2455c23c None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:09.083883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4f9f1-d576-434b-a8f2-ae6e2455c23c None admin] PATH_INFO: `/v3/users/4ba85db5bf4841828041a1a8149cc423` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:09.094974 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:09.112132 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4f9f1-d576-434b-a8f2-ae6e2455c23c None admin] RBAC: Authorizing `identity:get_user(user_id=4ba85db5bf4841828041a1a8149cc423)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:09.118267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4f9f1-d576-434b-a8f2-ae6e2455c23c None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:09.119697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 38/81] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:08 2022] GET /identity/v3/users/4ba85db5bf4841828041a1a8149cc423 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:09.120051 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4f9f1-d576-434b-a8f2-ae6e2455c23c None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:09.190115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:09.190400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81a95f-a209-410b-aa73-0f0af659deba None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:09.248382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67618b-be0d-442b-8bbe-93e4c8dfb616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:09.249414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67618b-be0d-442b-8bbe-93e4c8dfb616 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:09.249823 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67618b-be0d-442b-8bbe-93e4c8dfb616 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:09.250250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67618b-be0d-442b-8bbe-93e4c8dfb616 None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:09.252890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67618b-be0d-442b-8bbe-93e4c8dfb616 None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:09.255385 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67618b-be0d-442b-8bbe-93e4c8dfb616 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:09.263714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 44/82] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:09 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:09.263714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67618b-be0d-442b-8bbe-93e4c8dfb616 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:09.304972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4f9f1-d576-434b-a8f2-ae6e2455c23c None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:09.367501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087b41a-a5c7-4b7c-9ec2-0a5f913cee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:09.368558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087b41a-a5c7-4b7c-9ec2-0a5f913cee3d None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:09.369041 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087b41a-a5c7-4b7c-9ec2-0a5f913cee3d None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:09.369543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087b41a-a5c7-4b7c-9ec2-0a5f913cee3d None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:09.370811 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087b41a-a5c7-4b7c-9ec2-0a5f913cee3d None admin] RBAC: Adding query filter params (name=member) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:09.371344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087b41a-a5c7-4b7c-9ec2-0a5f913cee3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:09.374030 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087b41a-a5c7-4b7c-9ec2-0a5f913cee3d None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:09.390113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 39/83] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:09.396990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087b41a-a5c7-4b7c-9ec2-0a5f913cee3d None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:09.442443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67618b-be0d-442b-8bbe-93e4c8dfb616 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:09.463304 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:09.495443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97722990-6dd5-43d9-891c-cc0ec94c4fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:09.496753 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97722990-6dd5-43d9-891c-cc0ec94c4fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:09.497785 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97722990-6dd5-43d9-891c-cc0ec94c4fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:09.498229 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97722990-6dd5-43d9-891c-cc0ec94c4fb3 None admin] PATH_INFO: `/v3/users/4ba85db5bf4841828041a1a8149cc423` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:09.500253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97722990-6dd5-43d9-891c-cc0ec94c4fb3 None admin] RBAC: Authorizing `identity:get_user(user_id=4ba85db5bf4841828041a1a8149cc423)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:09.502986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97722990-6dd5-43d9-891c-cc0ec94c4fb3 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:09.504918 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 45/84] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:09 2022] GET /identity/v3/users/4ba85db5bf4841828041a1a8149cc423 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:09.505745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97722990-6dd5-43d9-891c-cc0ec94c4fb3 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:09.545892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:09.551450 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087b41a-a5c7-4b7c-9ec2-0a5f913cee3d None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:09.603991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b446c21-35e2-4f50-84c5-8c0d98a1bcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:09.604901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b446c21-35e2-4f50-84c5-8c0d98a1bcb5 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:09.605359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b446c21-35e2-4f50-84c5-8c0d98a1bcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:09.606050 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b446c21-35e2-4f50-84c5-8c0d98a1bcb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:09.647926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97722990-6dd5-43d9-891c-cc0ec94c4fb3 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:09.696546 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c886e3-05ff-4e79-bed9-8b648c85c84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:09.697327 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c886e3-05ff-4e79-bed9-8b648c85c84f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:09.697742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c886e3-05ff-4e79-bed9-8b648c85c84f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:09.698076 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c886e3-05ff-4e79-bed9-8b648c85c84f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:09.698854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c886e3-05ff-4e79-bed9-8b648c85c84f None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=76f48757de234b528b472ca888b7cff8, user.id=f8a8b3ea701948c68e339fb34dbfff3f) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:09.699198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c886e3-05ff-4e79-bed9-8b648c85c84f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:09.700983 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c886e3-05ff-4e79-bed9-8b648c85c84f None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:09.705443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b446c21-35e2-4f50-84c5-8c0d98a1bcb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:09.706988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b446c21-35e2-4f50-84c5-8c0d98a1bcb5 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:09.712292 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 46/85] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:09 2022] GET /identity/v3/role_assignments?user.id=f8a8b3ea701948c68e339fb34dbfff3f&scope.project.id=76f48757de234b528b472ca888b7cff8&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:09.714009 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c886e3-05ff-4e79-bed9-8b648c85c84f None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:09.792522 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:09.864036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:09.870619 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 40/86] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:27:09.876176 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b446c21-35e2-4f50-84c5-8c0d98a1bcb5 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:09.906261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c886e3-05ff-4e79-bed9-8b648c85c84f None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:09.970789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42fed8-9f21-4946-bb47-86173f70a8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:09.971690 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42fed8-9f21-4946-bb47-86173f70a8f9 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:09.971975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42fed8-9f21-4946-bb47-86173f70a8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:09.972248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42fed8-9f21-4946-bb47-86173f70a8f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:09.974176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42fed8-9f21-4946-bb47-86173f70a8f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:09.976002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42fed8-9f21-4946-bb47-86173f70a8f9 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:09.978828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 47/87] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:27:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:09.979999 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42fed8-9f21-4946-bb47-86173f70a8f9 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:10.070665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b446c21-35e2-4f50-84c5-8c0d98a1bcb5 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:10.132233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf69ff-fcca-4e8a-a2cf-2f5c5a63ab8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:10.133126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf69ff-fcca-4e8a-a2cf-2f5c5a63ab8e None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:10.133539 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf69ff-fcca-4e8a-a2cf-2f5c5a63ab8e None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:10.133950 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf69ff-fcca-4e8a-a2cf-2f5c5a63ab8e None admin] PATH_INFO: `/v3/users/4ba85db5bf4841828041a1a8149cc423` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:10.135863 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf69ff-fcca-4e8a-a2cf-2f5c5a63ab8e None admin] RBAC: Authorizing `identity:get_user(user_id=4ba85db5bf4841828041a1a8149cc423)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:10.138265 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf69ff-fcca-4e8a-a2cf-2f5c5a63ab8e None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:10.140752 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 41/88] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:09 2022] GET /identity/v3/users/4ba85db5bf4841828041a1a8149cc423 => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:10.143631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf69ff-fcca-4e8a-a2cf-2f5c5a63ab8e None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:10.158419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42fed8-9f21-4946-bb47-86173f70a8f9 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:10.179032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:10.222072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfad56-f031-416e-a0e8-78eeea06f27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:10.223518 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfad56-f031-416e-a0e8-78eeea06f27e None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:10.224202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfad56-f031-416e-a0e8-78eeea06f27e None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:10.224865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfad56-f031-416e-a0e8-78eeea06f27e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:10.243539 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:10.292989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf69ff-fcca-4e8a-a2cf-2f5c5a63ab8e None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:10.348022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba3554-bfec-4589-babb-4b6c01d84082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:10.348936 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba3554-bfec-4589-babb-4b6c01d84082 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:10.349394 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba3554-bfec-4589-babb-4b6c01d84082 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:10.349816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba3554-bfec-4589-babb-4b6c01d84082 None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:10.351149 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba3554-bfec-4589-babb-4b6c01d84082 None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:10.353006 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba3554-bfec-4589-babb-4b6c01d84082 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:10.355283 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 42/89] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:10 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:10.356368 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba3554-bfec-4589-babb-4b6c01d84082 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:10.366395 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfad56-f031-416e-a0e8-78eeea06f27e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:10.369013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfad56-f031-416e-a0e8-78eeea06f27e None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:10.527980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba3554-bfec-4589-babb-4b6c01d84082 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:10.551541 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 48/90] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:27:10.551541 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfad56-f031-416e-a0e8-78eeea06f27e None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:10.576393 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:10.598141 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72fc5e-b2e7-4b84-8b64-100780b2c6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:10.599104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72fc5e-b2e7-4b84-8b64-100780b2c6b8 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:10.599520 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72fc5e-b2e7-4b84-8b64-100780b2c6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:10.599970 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72fc5e-b2e7-4b84-8b64-100780b2c6b8 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:10.601038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72fc5e-b2e7-4b84-8b64-100780b2c6b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:10.603616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72fc5e-b2e7-4b84-8b64-100780b2c6b8 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:10.621898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:10.729130 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfad56-f031-416e-a0e8-78eeea06f27e None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:10.747518 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 43/91] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:27:10 2022] POST /identity/v3/users => generated 289 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:27:10.747518 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72fc5e-b2e7-4b84-8b64-100780b2c6b8 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:10.806825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502ba02-df14-46a1-86c5-c27f14c27373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:10.808283 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502ba02-df14-46a1-86c5-c27f14c27373 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:10.808874 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502ba02-df14-46a1-86c5-c27f14c27373 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:10.809567 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502ba02-df14-46a1-86c5-c27f14c27373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:10.963753 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502ba02-df14-46a1-86c5-c27f14c27373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:10.967370 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502ba02-df14-46a1-86c5-c27f14c27373 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:10.982045 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72fc5e-b2e7-4b84-8b64-100780b2c6b8 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:10.993800 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:11.057753 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833697c-9e7b-4d90-9283-c623d46a8122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:11.058680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833697c-9e7b-4d90-9283-c623d46a8122 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:11.059377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833697c-9e7b-4d90-9283-c623d46a8122 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:11.059860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833697c-9e7b-4d90-9283-c623d46a8122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:11.061692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833697c-9e7b-4d90-9283-c623d46a8122 None admin] RBAC: Adding query filter params (role.id=b9c5d282a37c489e83eabbdd2b393dbf, scope.project.id=76f48757de234b528b472ca888b7cff8, user.id=4ba85db5bf4841828041a1a8149cc423) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:11.062194 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833697c-9e7b-4d90-9283-c623d46a8122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:11.066048 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833697c-9e7b-4d90-9283-c623d46a8122 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:11.083759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 44/92] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:10 2022] GET /identity/v3/role_assignments?user.id=4ba85db5bf4841828041a1a8149cc423&scope.project.id=76f48757de234b528b472ca888b7cff8&role.id=b9c5d282a37c489e83eabbdd2b393dbf => generated 259 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:11.085224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833697c-9e7b-4d90-9283-c623d46a8122 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:11.191644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 49/93] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:27:11.202944 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502ba02-df14-46a1-86c5-c27f14c27373 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:11.225196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:11.330136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833697c-9e7b-4d90-9283-c623d46a8122 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:11.404304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdb79b-05b1-444c-9597-62c03e091b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:11.405862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdb79b-05b1-444c-9597-62c03e091b78 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:11.407241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdb79b-05b1-444c-9597-62c03e091b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:11.408143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdb79b-05b1-444c-9597-62c03e091b78 None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:11.418447 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdb79b-05b1-444c-9597-62c03e091b78 None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:11.421693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdb79b-05b1-444c-9597-62c03e091b78 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:11.426712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 45/94] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:11 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:11.436969 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdb79b-05b1-444c-9597-62c03e091b78 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:11.456564 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502ba02-df14-46a1-86c5-c27f14c27373 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:11.472093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:11.496318 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03598b-a24e-466f-ac46-a59f30b170b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:11.497497 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03598b-a24e-466f-ac46-a59f30b170b7 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:11.497875 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03598b-a24e-466f-ac46-a59f30b170b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:11.498252 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03598b-a24e-466f-ac46-a59f30b170b7 None admin] PATH_INFO: `/v3/projects/e6a3195fb6d7424ebe9c1c6bfbe3fd93` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:11.499490 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03598b-a24e-466f-ac46-a59f30b170b7 None admin] RBAC: Authorizing `identity:get_project(project_id=e6a3195fb6d7424ebe9c1c6bfbe3fd93)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:11.501679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03598b-a24e-466f-ac46-a59f30b170b7 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:11.503377 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 50/95] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:11 2022] GET /identity/v3/projects/e6a3195fb6d7424ebe9c1c6bfbe3fd93 => generated 312 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:11.509975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03598b-a24e-466f-ac46-a59f30b170b7 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:11.658895 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdb79b-05b1-444c-9597-62c03e091b78 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:11.680272 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03598b-a24e-466f-ac46-a59f30b170b7 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:11.684712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:11.700227 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc16c71-9595-4750-8ee9-5032fc1a79dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:11.701150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc16c71-9595-4750-8ee9-5032fc1a79dc None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:11.701577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc16c71-9595-4750-8ee9-5032fc1a79dc None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:11.701993 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc16c71-9595-4750-8ee9-5032fc1a79dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:11.702873 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc16c71-9595-4750-8ee9-5032fc1a79dc None admin] RBAC: Adding query filter params (role.id=e35c45d51df34051b68fa49475ac7250, scope.project.id=76f48757de234b528b472ca888b7cff8, user.id=4ba85db5bf4841828041a1a8149cc423) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:11.704408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc16c71-9595-4750-8ee9-5032fc1a79dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:11.709064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc16c71-9595-4750-8ee9-5032fc1a79dc None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:11.725000 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 46/96] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:11 2022] GET /identity/v3/role_assignments?user.id=4ba85db5bf4841828041a1a8149cc423&scope.project.id=76f48757de234b528b472ca888b7cff8&role.id=e35c45d51df34051b68fa49475ac7250 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:11.738888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3aa5c2-38e2-4ccd-b52f-48a8bccee658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:11.739886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3aa5c2-38e2-4ccd-b52f-48a8bccee658 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:11.740376 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3aa5c2-38e2-4ccd-b52f-48a8bccee658 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:11.740990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3aa5c2-38e2-4ccd-b52f-48a8bccee658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:11.741957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3aa5c2-38e2-4ccd-b52f-48a8bccee658 None admin] RBAC: Adding query filter params (role.id=b9c5d282a37c489e83eabbdd2b393dbf, scope.project.id=e6a3195fb6d7424ebe9c1c6bfbe3fd93, user.id=4ba85db5bf4841828041a1a8149cc423) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:11.742421 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3aa5c2-38e2-4ccd-b52f-48a8bccee658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:11.744090 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3aa5c2-38e2-4ccd-b52f-48a8bccee658 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:11.752134 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 51/97] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:11 2022] GET /identity/v3/role_assignments?user.id=4ba85db5bf4841828041a1a8149cc423&scope.project.id=e6a3195fb6d7424ebe9c1c6bfbe3fd93&role.id=b9c5d282a37c489e83eabbdd2b393dbf => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:12.790580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2b14e-375a-4df7-b2ea-6b6592f1169e None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:12.791106 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2b14e-375a-4df7-b2ea-6b6592f1169e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:12.791559 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2b14e-375a-4df7-b2ea-6b6592f1169e None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:12.794112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 47/98] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:12.800314 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a628083-30df-4d4b-ad3d-f1957e81ab5a None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:12.801244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a628083-30df-4d4b-ad3d-f1957e81ab5a None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:12.801707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a628083-30df-4d4b-ad3d-f1957e81ab5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:12.831032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-3a628083-30df-4d4b-ad3d-f1957e81ab5a None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:12.833151 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3a628083-30df-4d4b-ad3d-f1957e81ab5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:12.917800 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:12.993422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 52/99] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:13.549257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2b14e-375a-4df7-b2ea-6b6592f1169e None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:13.709940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2b14e-375a-4df7-b2ea-6b6592f1169e None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:13.749856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afc93b-b8dc-49d7-a2c8-1aeb8dddc342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:13.751429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afc93b-b8dc-49d7-a2c8-1aeb8dddc342 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:13.751934 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afc93b-b8dc-49d7-a2c8-1aeb8dddc342 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:13.752393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afc93b-b8dc-49d7-a2c8-1aeb8dddc342 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:13.765173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afc93b-b8dc-49d7-a2c8-1aeb8dddc342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:13.771664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-51afc93b-b8dc-49d7-a2c8-1aeb8dddc342 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:27:13.771664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:13.771664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:13.771664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:13.771664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:13.771664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:13.771664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:13.771664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:13.771664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:13.771664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:13.771664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:13.771664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:13.771664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:13.771664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:13.771664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:13.771664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:13.772583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:13.772583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:13.772583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:13.772583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:13.772583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:13.772583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:13.772583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:13.772583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:13.772583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:13.772583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:13.772583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:13.772583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:13.772583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:13.772583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:13.772583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:13.772583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:13.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:13.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:13.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:13.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:13.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:13.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:13.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:13.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:13.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:13.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:13.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:27:13.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:13.775869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 48/100] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:27:13.782163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a628083-30df-4d4b-ad3d-f1957e81ab5a None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:13.966132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a628083-30df-4d4b-ad3d-f1957e81ab5a None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:14.046014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0d302-a9c6-4e6f-b9bc-6db7d7588844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:14.046650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0d302-a9c6-4e6f-b9bc-6db7d7588844 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:14.047911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0d302-a9c6-4e6f-b9bc-6db7d7588844 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:14.048388 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0d302-a9c6-4e6f-b9bc-6db7d7588844 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:14.049122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0d302-a9c6-4e6f-b9bc-6db7d7588844 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:14.049430 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0d302-a9c6-4e6f-b9bc-6db7d7588844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:14.050875 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0d302-a9c6-4e6f-b9bc-6db7d7588844 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:14.066716 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 53/101] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:14.072774 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afc93b-b8dc-49d7-a2c8-1aeb8dddc342 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:14.197145 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:14.324814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afc93b-b8dc-49d7-a2c8-1aeb8dddc342 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:14.397443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727c24f-e1b5-4e8f-ba3a-3d31c396a800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:14.399227 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727c24f-e1b5-4e8f-ba3a-3d31c396a800 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:14.400078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727c24f-e1b5-4e8f-ba3a-3d31c396a800 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:14.400917 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727c24f-e1b5-4e8f-ba3a-3d31c396a800 None admin] PATH_INFO: `/v3/users/f8a8b3ea701948c68e339fb34dbfff3f` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:14.409000 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727c24f-e1b5-4e8f-ba3a-3d31c396a800 None admin] RBAC: Authorizing `identity:get_user(user_id=f8a8b3ea701948c68e339fb34dbfff3f)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:14.412433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727c24f-e1b5-4e8f-ba3a-3d31c396a800 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:14.416297 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 49/102] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:14 2022] GET /identity/v3/users/f8a8b3ea701948c68e339fb34dbfff3f => generated 247 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:14.423658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0d302-a9c6-4e6f-b9bc-6db7d7588844 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:14.492153 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:14.613024 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0d302-a9c6-4e6f-b9bc-6db7d7588844 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:14.680668 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b23b4-c075-4390-929e-ba6f0be3f764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:14.681394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b23b4-c075-4390-929e-ba6f0be3f764 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:14.681668 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b23b4-c075-4390-929e-ba6f0be3f764 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:14.681954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b23b4-c075-4390-929e-ba6f0be3f764 None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:14.683249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b23b4-c075-4390-929e-ba6f0be3f764 None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:14.684760 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b23b4-c075-4390-929e-ba6f0be3f764 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:14.686863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 54/103] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:14 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:14.693471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727c24f-e1b5-4e8f-ba3a-3d31c396a800 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:14.881371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727c24f-e1b5-4e8f-ba3a-3d31c396a800 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:14.906029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:14.928696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f7d26-6150-4b9c-a45c-b39f2b17918e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:14.929385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f7d26-6150-4b9c-a45c-b39f2b17918e None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:14.929667 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f7d26-6150-4b9c-a45c-b39f2b17918e None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:14.929944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f7d26-6150-4b9c-a45c-b39f2b17918e None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8/users/f8a8b3ea701948c68e339fb34dbfff3f/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:14.931975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f7d26-6150-4b9c-a45c-b39f2b17918e None admin] RBAC: Authorizing `identity:create_grant(project_id=76f48757de234b528b472ca888b7cff8, user_id=f8a8b3ea701948c68e339fb34dbfff3f, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:14.933470 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f7d26-6150-4b9c-a45c-b39f2b17918e None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:15.040314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 50/104] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:27:14 2022] PUT /identity/v3/projects/76f48757de234b528b472ca888b7cff8/users/f8a8b3ea701948c68e339fb34dbfff3f/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:27:15.864836 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29212f7f-702f-4754-9fe8-cb7638d035ef None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:15.865657 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29212f7f-702f-4754-9fe8-cb7638d035ef None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:15.865657 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29212f7f-702f-4754-9fe8-cb7638d035ef None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:15.867018 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 55/105] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:27:15.879197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1e00c-6fd3-4d1b-9481-8cdebc0e1c49 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:15.879966 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1e00c-6fd3-4d1b-9481-8cdebc0e1c49 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:15.879966 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1e00c-6fd3-4d1b-9481-8cdebc0e1c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:15.909202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-d5c1e00c-6fd3-4d1b-9481-8cdebc0e1c49 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:15.910502 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d5c1e00c-6fd3-4d1b-9481-8cdebc0e1c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:15.945903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06751955-8d17-4e63-8411-5361d4edec03 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:15.946311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06751955-8d17-4e63-8411-5361d4edec03 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:15.946573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06751955-8d17-4e63-8411-5361d4edec03 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:15.948432 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 56/106] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:27:15.956809 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced61018-57bb-4b23-8e6c-54df19c8b33a None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:15.957219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced61018-57bb-4b23-8e6c-54df19c8b33a None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:15.957510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced61018-57bb-4b23-8e6c-54df19c8b33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:15.987318 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-ced61018-57bb-4b23-8e6c-54df19c8b33a None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:15.989468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ced61018-57bb-4b23-8e6c-54df19c8b33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:16.083417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 51/107] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:27:16.125866 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 57/108] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:27:16.457586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbbad6-4a38-41a6-858e-47ce85bc6044 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:16.458659 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbbad6-4a38-41a6-858e-47ce85bc6044 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:16.459442 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbbad6-4a38-41a6-858e-47ce85bc6044 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:16.462648 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 52/109] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:16.478682 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f08a81-9038-4a6e-a177-9e662fb0a1a7 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:16.479094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f08a81-9038-4a6e-a177-9e662fb0a1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:16.479257 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f08a81-9038-4a6e-a177-9e662fb0a1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:16.511431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-93f08a81-9038-4a6e-a177-9e662fb0a1a7 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:16.512677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-93f08a81-9038-4a6e-a177-9e662fb0a1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:16.551891 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:16.619902 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 58/110] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:16.759803 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbbad6-4a38-41a6-858e-47ce85bc6044 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:16.920596 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f08a81-9038-4a6e-a177-9e662fb0a1a7 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:16.999015 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbbad6-4a38-41a6-858e-47ce85bc6044 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:17.016417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:17.070858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f8016-17f2-41b9-8679-e418f82ac257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:17.071676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f8016-17f2-41b9-8679-e418f82ac257 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:17.071952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f8016-17f2-41b9-8679-e418f82ac257 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:17.072248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f8016-17f2-41b9-8679-e418f82ac257 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:17.085120 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f8016-17f2-41b9-8679-e418f82ac257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:17.090504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-fe5f8016-17f2-41b9-8679-e418f82ac257 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:17.090504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:17.090504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:17.090504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:17.090504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:17.090504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:17.090504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:17.090504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:17.090504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:17.090504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:17.090504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:17.090504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:17.090504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:17.090504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:17.090504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:17.090504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:17.091422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:17.091422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:17.091422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:17.091422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:17.091422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:17.091422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:17.091422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:17.091422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:17.091422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:17.091422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:17.091422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:17.091422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:17.091422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:17.091422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:17.091422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:17.091422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:17.092230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:17.092230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:17.092230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:17.092230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:17.092230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:17.092230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:17.092230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:17.092230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:17.092230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:17.092230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:17.092230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:17.092230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:17.092230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 53/111] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:17.092886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f8016-17f2-41b9-8679-e418f82ac257 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:17.124159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f08a81-9038-4a6e-a177-9e662fb0a1a7 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:17.163872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da8ad9-af8f-4856-a6be-f8ad0dd67047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:17.164844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da8ad9-af8f-4856-a6be-f8ad0dd67047 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:17.165297 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da8ad9-af8f-4856-a6be-f8ad0dd67047 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:17.165854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da8ad9-af8f-4856-a6be-f8ad0dd67047 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:17.167287 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da8ad9-af8f-4856-a6be-f8ad0dd67047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:17.168791 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da8ad9-af8f-4856-a6be-f8ad0dd67047 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:17.170937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 59/112] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:27:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:17.172799 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226ed4c-5b02-4c7e-b7ed-8702263176df None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:17.173081 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226ed4c-5b02-4c7e-b7ed-8702263176df None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:17.173351 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226ed4c-5b02-4c7e-b7ed-8702263176df None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:17.174711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 60/113] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:17.176709 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b68386-4539-4ee6-8bd8-00ac02067588 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:17.179932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b68386-4539-4ee6-8bd8-00ac02067588 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:17.184988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b68386-4539-4ee6-8bd8-00ac02067588 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:17.184988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 61/114] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:17.184988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b68386-4539-4ee6-8bd8-00ac02067588 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:17.214466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f8016-17f2-41b9-8679-e418f82ac257 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:17.217328 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:17.255040 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b14e3-fca2-4268-b575-9f16e45d093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:17.255726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b14e3-fca2-4268-b575-9f16e45d093c None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:17.256009 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b14e3-fca2-4268-b575-9f16e45d093c None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:17.256282 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b14e3-fca2-4268-b575-9f16e45d093c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:17.269143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b14e3-fca2-4268-b575-9f16e45d093c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:17.274636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-139b14e3-fca2-4268-b575-9f16e45d093c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:27:17.274636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:17.274636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:17.274636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:17.274636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:17.274636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:17.274636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:17.274636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:17.274636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:17.274636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:17.274636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:17.274636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:17.274636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:17.274636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:17.274636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:17.274636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:17.275573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:17.275573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:17.275573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:17.275573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:17.275573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:17.275573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:17.275573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:17.275573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:17.275573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:17.275573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:17.275573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:17.275573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:17.275573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:17.275573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:17.275573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:17.275573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:17.282476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:17.282476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:17.282476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:17.282476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:17.282476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:17.282476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:17.282476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:17.282476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:17.282476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:17.282476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:17.282476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:27:17.282476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:17.282476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 54/115] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:17.282476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b14e3-fca2-4268-b575-9f16e45d093c None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:17.309251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b68386-4539-4ee6-8bd8-00ac02067588 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:17.310074 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:17.351076 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaa787-a0d2-45ad-ba16-ab483fa36a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:17.351727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaa787-a0d2-45ad-ba16-ab483fa36a3e None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:17.352006 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaa787-a0d2-45ad-ba16-ab483fa36a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:17.352276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaa787-a0d2-45ad-ba16-ab483fa36a3e None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:17.352945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caaa787-a0d2-45ad-ba16-ab483fa36a3e None admin] RBAC: Adding query filter params (name=member) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:17.353245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caaa787-a0d2-45ad-ba16-ab483fa36a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:17.354711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caaa787-a0d2-45ad-ba16-ab483fa36a3e None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:17.364802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 62/116] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:17.366085 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba576f-74ef-478e-92fb-38c88b65c1ba None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:17.366372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba576f-74ef-478e-92fb-38c88b65c1ba None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:17.366648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba576f-74ef-478e-92fb-38c88b65c1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:17.385965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-6aba576f-74ef-478e-92fb-38c88b65c1ba None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:17.387176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-6aba576f-74ef-478e-92fb-38c88b65c1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:17.403055 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b14e3-fca2-4268-b575-9f16e45d093c None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:17.445731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705399fd-3061-47f2-b6f7-cb518e44a04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:17.446732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705399fd-3061-47f2-b6f7-cb518e44a04e None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:17.447174 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705399fd-3061-47f2-b6f7-cb518e44a04e None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:17.447443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705399fd-3061-47f2-b6f7-cb518e44a04e None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:17.448141 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705399fd-3061-47f2-b6f7-cb518e44a04e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:17.449685 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705399fd-3061-47f2-b6f7-cb518e44a04e None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:17.475585 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 63/117] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:17.477057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ceca1-9b68-4a61-a04f-ff8999ef6ec5 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:17.477354 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ceca1-9b68-4a61-a04f-ff8999ef6ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:17.477634 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ceca1-9b68-4a61-a04f-ff8999ef6ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:17.499310 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-145ceca1-9b68-4a61-a04f-ff8999ef6ec5 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:17.501020 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-145ceca1-9b68-4a61-a04f-ff8999ef6ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:17.521330 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:17.544567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 55/118] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Sep 7 16:27:17 2022] POST /identity/v3/projects => generated 302 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:27:17.546192 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705399fd-3061-47f2-b6f7-cb518e44a04e None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:17.598641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 64/119] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:17.600896 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ceca1-9b68-4a61-a04f-ff8999ef6ec5 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:17.721670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:17.811065 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705399fd-3061-47f2-b6f7-cb518e44a04e None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:17.854678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ceca1-9b68-4a61-a04f-ff8999ef6ec5 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:17.921072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d3fd9-1e06-4d4a-b629-74467817bcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:17.922647 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d3fd9-1e06-4d4a-b629-74467817bcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:17.923131 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d3fd9-1e06-4d4a-b629-74467817bcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:17.923648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d3fd9-1e06-4d4a-b629-74467817bcf7 None admin] PATH_INFO: `/v3/users/4ba85db5bf4841828041a1a8149cc423` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:17.928435 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d3fd9-1e06-4d4a-b629-74467817bcf7 None admin] RBAC: Authorizing `identity:get_user(user_id=4ba85db5bf4841828041a1a8149cc423)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:17.930292 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d3fd9-1e06-4d4a-b629-74467817bcf7 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:17.932291 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 65/120] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:17 2022] GET /identity/v3/users/4ba85db5bf4841828041a1a8149cc423 => generated 275 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:17.939238 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d3fd9-1e06-4d4a-b629-74467817bcf7 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:17.951464 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd52260-8a0e-4cfd-a029-057d58c1af20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:17.952486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd52260-8a0e-4cfd-a029-057d58c1af20 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:17.953466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd52260-8a0e-4cfd-a029-057d58c1af20 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:17.953904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd52260-8a0e-4cfd-a029-057d58c1af20 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:17.955157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd52260-8a0e-4cfd-a029-057d58c1af20 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:17.955670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd52260-8a0e-4cfd-a029-057d58c1af20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:17.958112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd52260-8a0e-4cfd-a029-057d58c1af20 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:17.991546 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:17.991742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 56/121] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:18.001343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd52260-8a0e-4cfd-a029-057d58c1af20 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:18.117945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d3fd9-1e06-4d4a-b629-74467817bcf7 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:18.168112 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e599a-d81a-41cf-9463-9bc90c612afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:18.168782 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e599a-d81a-41cf-9463-9bc90c612afd None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:18.169066 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e599a-d81a-41cf-9463-9bc90c612afd None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:18.169344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e599a-d81a-41cf-9463-9bc90c612afd None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:18.171317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e599a-d81a-41cf-9463-9bc90c612afd None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:18.173988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e599a-d81a-41cf-9463-9bc90c612afd None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:18.179283 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 66/122] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:17 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:18.183586 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e599a-d81a-41cf-9463-9bc90c612afd None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:18.190888 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd52260-8a0e-4cfd-a029-057d58c1af20 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:18.249869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d683d-6c32-469a-b661-db936fbc0280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:18.251640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d683d-6c32-469a-b661-db936fbc0280 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:18.251929 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d683d-6c32-469a-b661-db936fbc0280 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:18.252213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d683d-6c32-469a-b661-db936fbc0280 None admin] PATH_INFO: `/v3/users/d3d7f47772cf4a23b637e9d4e6b308ef` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:18.276037 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d683d-6c32-469a-b661-db936fbc0280 None admin] RBAC: Authorizing `identity:get_user(user_id=d3d7f47772cf4a23b637e9d4e6b308ef)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:18.278556 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d683d-6c32-469a-b661-db936fbc0280 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:18.280789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 57/123] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:17 2022] GET /identity/v3/users/d3d7f47772cf4a23b637e9d4e6b308ef => generated 289 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:18.283033 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d683d-6c32-469a-b661-db936fbc0280 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:18.301587 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:18.304863 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:18.323605 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e599a-d81a-41cf-9463-9bc90c612afd None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:18.374202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db8a77-1c6f-4ead-a04d-6534b3e209b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:18.374919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db8a77-1c6f-4ead-a04d-6534b3e209b6 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:18.375264 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db8a77-1c6f-4ead-a04d-6534b3e209b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:18.375649 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db8a77-1c6f-4ead-a04d-6534b3e209b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:18.388688 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db8a77-1c6f-4ead-a04d-6534b3e209b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:18.394247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-e5db8a77-1c6f-4ead-a04d-6534b3e209b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:27:18.394247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:18.394247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:18.394247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:18.394247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:18.394247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:18.394247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:18.394247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:18.394247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:18.394247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:18.394247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:18.394247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:18.394247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:18.394247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:18.394247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:18.394247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:18.395195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:18.395195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:18.395195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:18.395195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:18.395195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:18.395195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:18.395195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:18.395195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:18.395195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:18.395195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:18.395195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:18.395195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:18.395195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:18.395195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:18.395195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:18.395195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:18.401911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:18.401911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:18.401911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:18.401911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:18.401911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:18.401911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:18.401911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:18.401911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:18.401911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:18.401911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:18.401911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:27:18.401911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:27:18.401911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 67/124] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:27:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:18.401911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db8a77-1c6f-4ead-a04d-6534b3e209b6 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:18.456682 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d683d-6c32-469a-b661-db936fbc0280 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:18.511721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435103ec-4b96-45aa-b0ca-99578578b8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:18.512697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435103ec-4b96-45aa-b0ca-99578578b8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:18.513158 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435103ec-4b96-45aa-b0ca-99578578b8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:18.513637 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435103ec-4b96-45aa-b0ca-99578578b8f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:18.531950 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435103ec-4b96-45aa-b0ca-99578578b8f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:18.539344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-435103ec-4b96-45aa-b0ca-99578578b8f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:18.539344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:18.539344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:18.539344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:18.539344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:18.539344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:18.539344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:18.539344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:18.539344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:18.539344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:18.539344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:18.539344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:18.539344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:18.539344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:18.539344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:18.539344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:18.540538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:18.540538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:18.540538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:18.540538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:18.540538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:18.540538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:18.540538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:18.540538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:18.540538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:18.540538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:18.540538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:18.540538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:18.540538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:18.540538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:18.540538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:18.540538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:18.541445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:18.541445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:18.541445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:18.541445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:18.541445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:18.541445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:18.541445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:18.541445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:18.541445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:18.541445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:18.541445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:18.541445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:18.542346 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db8a77-1c6f-4ead-a04d-6534b3e209b6 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:18.543624 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 58/125] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:18.544693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435103ec-4b96-45aa-b0ca-99578578b8f1 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:18.626782 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:18.628684 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7a753-7a0b-40b7-9a1b-fc9b912c45e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:18.629648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7a753-7a0b-40b7-9a1b-fc9b912c45e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:18.630306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7a753-7a0b-40b7-9a1b-fc9b912c45e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:18.630919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7a753-7a0b-40b7-9a1b-fc9b912c45e2 None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8/users/4ba85db5bf4841828041a1a8149cc423/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:18.634782 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7a753-7a0b-40b7-9a1b-fc9b912c45e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=76f48757de234b528b472ca888b7cff8, user_id=4ba85db5bf4841828041a1a8149cc423, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:18.637723 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7a753-7a0b-40b7-9a1b-fc9b912c45e2 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:18.694092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435103ec-4b96-45aa-b0ca-99578578b8f1 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:18.746616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e4530-0c60-458c-8d8f-2b1b0324e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:18.747455 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e4530-0c60-458c-8d8f-2b1b0324e1ac None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:18.747888 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e4530-0c60-458c-8d8f-2b1b0324e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:18.748271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e4530-0c60-458c-8d8f-2b1b0324e1ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:18.749191 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 68/126] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:27:18 2022] PUT /identity/v3/projects/76f48757de234b528b472ca888b7cff8/users/4ba85db5bf4841828041a1a8149cc423/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:27:18.756377 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7a753-7a0b-40b7-9a1b-fc9b912c45e2 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:18.789987 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:18.945178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e4530-0c60-458c-8d8f-2b1b0324e1ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:18.948747 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e4530-0c60-458c-8d8f-2b1b0324e1ac None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:19.039597 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7a753-7a0b-40b7-9a1b-fc9b912c45e2 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:19.078696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:19.133033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552c17a-0f6e-48a8-a1fa-578b90724500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:19.135573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552c17a-0f6e-48a8-a1fa-578b90724500 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:19.136478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552c17a-0f6e-48a8-a1fa-578b90724500 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:19.137362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552c17a-0f6e-48a8-a1fa-578b90724500 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:19.144709 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552c17a-0f6e-48a8-a1fa-578b90724500 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:19.145932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552c17a-0f6e-48a8-a1fa-578b90724500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:19.149098 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552c17a-0f6e-48a8-a1fa-578b90724500 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:19.157472 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 59/127] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:27:19.158060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e4530-0c60-458c-8d8f-2b1b0324e1ac None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:19.168059 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 69/128] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:27:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:19.170013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552c17a-0f6e-48a8-a1fa-578b90724500 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:19.293050 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e4530-0c60-458c-8d8f-2b1b0324e1ac None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:19.326323 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:19.334950 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8e86a-7123-46c8-b47a-c5054444561b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:19.335613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8e86a-7123-46c8-b47a-c5054444561b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:19.335897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8e86a-7123-46c8-b47a-c5054444561b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:19.342435 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8e86a-7123-46c8-b47a-c5054444561b None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:19.342435 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8e86a-7123-46c8-b47a-c5054444561b None admin] RBAC: Adding query filter params (name=member) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:19.342435 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8e86a-7123-46c8-b47a-c5054444561b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:19.342435 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8e86a-7123-46c8-b47a-c5054444561b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:19.348566 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 60/129] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:19.349450 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8e86a-7123-46c8-b47a-c5054444561b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:19.381990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:19.399063 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552c17a-0f6e-48a8-a1fa-578b90724500 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:19.472146 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f14ef-615b-474b-bf87-f36e74ddeb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:19.474906 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f14ef-615b-474b-bf87-f36e74ddeb2f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:19.476145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f14ef-615b-474b-bf87-f36e74ddeb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:19.477300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f14ef-615b-474b-bf87-f36e74ddeb2f None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:19.481869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f14ef-615b-474b-bf87-f36e74ddeb2f None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:19.486490 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f14ef-615b-474b-bf87-f36e74ddeb2f None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:19.490040 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8e86a-7123-46c8-b47a-c5054444561b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:19.491828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 70/130] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:19 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:19.495211 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d982e-73dd-421d-b5e3-d6e6791b0bfc None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:19.496188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d982e-73dd-421d-b5e3-d6e6791b0bfc None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:19.497072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d982e-73dd-421d-b5e3-d6e6791b0bfc None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:19.500396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 71/131] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:19.502670 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d982e-73dd-421d-b5e3-d6e6791b0bfc None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:19.538202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001434b-94db-4d8d-af29-e58a516b0dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:19.538916 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001434b-94db-4d8d-af29-e58a516b0dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:19.539201 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001434b-94db-4d8d-af29-e58a516b0dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:19.539564 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001434b-94db-4d8d-af29-e58a516b0dc9 None admin] PATH_INFO: `/v3/users/4ba85db5bf4841828041a1a8149cc423` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:19.540845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001434b-94db-4d8d-af29-e58a516b0dc9 None admin] RBAC: Authorizing `identity:get_user(user_id=4ba85db5bf4841828041a1a8149cc423)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:19.542557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001434b-94db-4d8d-af29-e58a516b0dc9 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:19.549680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 61/132] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:19 2022] GET /identity/v3/users/4ba85db5bf4841828041a1a8149cc423 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:19.559517 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001434b-94db-4d8d-af29-e58a516b0dc9 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:19.643809 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d982e-73dd-421d-b5e3-d6e6791b0bfc None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:19.670989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:19.682160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a088b-9512-4b4c-9937-cde097d31e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:19.682814 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a088b-9512-4b4c-9937-cde097d31e89 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:19.683095 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a088b-9512-4b4c-9937-cde097d31e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:19.683370 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a088b-9512-4b4c-9937-cde097d31e89 None admin] PATH_INFO: `/v3/users/4ba85db5bf4841828041a1a8149cc423` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:19.684642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a088b-9512-4b4c-9937-cde097d31e89 None admin] RBAC: Authorizing `identity:get_user(user_id=4ba85db5bf4841828041a1a8149cc423)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:19.686176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a088b-9512-4b4c-9937-cde097d31e89 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:19.687814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001434b-94db-4d8d-af29-e58a516b0dc9 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:19.688917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 72/133] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:19 2022] GET /identity/v3/users/4ba85db5bf4841828041a1a8149cc423 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:19.690112 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2373f22-d301-4266-9973-06914e69be00 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:19.690397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2373f22-d301-4266-9973-06914e69be00 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:19.690739 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2373f22-d301-4266-9973-06914e69be00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:19.705272 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:19.711371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-e2373f22-d301-4266-9973-06914e69be00 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:19.712682 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e2373f22-d301-4266-9973-06914e69be00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:19.732679 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74908a-a0bd-48b3-9951-444a4e212200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:19.733597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74908a-a0bd-48b3-9951-444a4e212200 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:19.734566 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74908a-a0bd-48b3-9951-444a4e212200 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:19.734992 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74908a-a0bd-48b3-9951-444a4e212200 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:19.735932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74908a-a0bd-48b3-9951-444a4e212200 None admin] RBAC: Adding query filter params (role.id=be4da00ddeb847968d5fdd6a8dd9de0a, scope.project.id=76f48757de234b528b472ca888b7cff8, user.id=d3d7f47772cf4a23b637e9d4e6b308ef) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:19.736468 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74908a-a0bd-48b3-9951-444a4e212200 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:19.738123 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74908a-a0bd-48b3-9951-444a4e212200 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:19.744720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 62/134] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:19 2022] GET /identity/v3/role_assignments?user.id=d3d7f47772cf4a23b637e9d4e6b308ef&scope.project.id=76f48757de234b528b472ca888b7cff8&role.id=be4da00ddeb847968d5fdd6a8dd9de0a => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:19.745843 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74908a-a0bd-48b3-9951-444a4e212200 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:19.793927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 73/135] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:19.794565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2373f22-d301-4266-9973-06914e69be00 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:19.945036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74908a-a0bd-48b3-9951-444a4e212200 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:19.978837 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2373f22-d301-4266-9973-06914e69be00 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:20.032001 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7103fce-d2f4-46cc-9483-aebb775e725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:20.035238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7103fce-d2f4-46cc-9483-aebb775e725b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:20.036027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7103fce-d2f4-46cc-9483-aebb775e725b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:20.037442 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7103fce-d2f4-46cc-9483-aebb775e725b None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:20.042583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7103fce-d2f4-46cc-9483-aebb775e725b None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:20.048540 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7103fce-d2f4-46cc-9483-aebb775e725b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:20.053962 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 63/136] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:19 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:20.077264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7103fce-d2f4-46cc-9483-aebb775e725b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:20.099093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a42ecd-1fc3-41a2-a47f-ddcb821f4aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:20.101125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a42ecd-1fc3-41a2-a47f-ddcb821f4aaf None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:20.101808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a42ecd-1fc3-41a2-a47f-ddcb821f4aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:20.102528 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a42ecd-1fc3-41a2-a47f-ddcb821f4aaf None admin] PATH_INFO: `/v3/projects/e6a3195fb6d7424ebe9c1c6bfbe3fd93` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:20.107146 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a42ecd-1fc3-41a2-a47f-ddcb821f4aaf None admin] RBAC: Authorizing `identity:get_project(project_id=e6a3195fb6d7424ebe9c1c6bfbe3fd93)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:20.115035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a42ecd-1fc3-41a2-a47f-ddcb821f4aaf None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:20.118719 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 74/137] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:19 2022] GET /identity/v3/projects/e6a3195fb6d7424ebe9c1c6bfbe3fd93 => generated 312 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:20.128507 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a42ecd-1fc3-41a2-a47f-ddcb821f4aaf None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:20.141140 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:20.162555 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:20.335011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7103fce-d2f4-46cc-9483-aebb775e725b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:20.413177 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a4b19-56c4-42e8-82f1-ae09bea90835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:20.414708 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a4b19-56c4-42e8-82f1-ae09bea90835 None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:20.416059 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a4b19-56c4-42e8-82f1-ae09bea90835 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:20.418448 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a4b19-56c4-42e8-82f1-ae09bea90835 None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8/users/4ba85db5bf4841828041a1a8149cc423/roles/e35c45d51df34051b68fa49475ac7250` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:20.426433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a4b19-56c4-42e8-82f1-ae09bea90835 None admin] RBAC: Authorizing `identity:create_grant(project_id=76f48757de234b528b472ca888b7cff8, user_id=4ba85db5bf4841828041a1a8149cc423, role_id=e35c45d51df34051b68fa49475ac7250)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:20.431447 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a4b19-56c4-42e8-82f1-ae09bea90835 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:20.477388 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a42ecd-1fc3-41a2-a47f-ddcb821f4aaf None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:20.549009 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e805b-070f-4080-b392-e0115d41318c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:20.550572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e805b-070f-4080-b392-e0115d41318c None admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:20.551273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e805b-070f-4080-b392-e0115d41318c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:20.551998 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e805b-070f-4080-b392-e0115d41318c None admin] PATH_INFO: `/v3/projects/e6a3195fb6d7424ebe9c1c6bfbe3fd93/users/4ba85db5bf4841828041a1a8149cc423/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:20.557737 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e805b-070f-4080-b392-e0115d41318c None admin] RBAC: Authorizing `identity:create_grant(project_id=e6a3195fb6d7424ebe9c1c6bfbe3fd93, user_id=4ba85db5bf4841828041a1a8149cc423, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:20.562752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e805b-070f-4080-b392-e0115d41318c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:20.577286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 64/138] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:27:20 2022] PUT /identity/v3/projects/76f48757de234b528b472ca888b7cff8/users/4ba85db5bf4841828041a1a8149cc423/roles/e35c45d51df34051b68fa49475ac7250 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:27:20.586658 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a4b19-56c4-42e8-82f1-ae09bea90835 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:20.680358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 75/139] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:27:20 2022] PUT /identity/v3/projects/e6a3195fb6d7424ebe9c1c6bfbe3fd93/users/4ba85db5bf4841828041a1a8149cc423/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:27:20.840899 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:20.882110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a4b19-56c4-42e8-82f1-ae09bea90835 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:20.949805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373575d5-cd3e-4333-84b3-ae60f86cb926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:20.951291 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373575d5-cd3e-4333-84b3-ae60f86cb926 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:20.952017 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373575d5-cd3e-4333-84b3-ae60f86cb926 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:20.953313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373575d5-cd3e-4333-84b3-ae60f86cb926 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:20.973936 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373575d5-cd3e-4333-84b3-ae60f86cb926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:20.984137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-373575d5-cd3e-4333-84b3-ae60f86cb926 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:27:20.984137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:20.984137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:20.984137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:20.984137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:20.984137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:20.984137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:20.984137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:20.984137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:20.984137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:20.984137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:20.984137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:20.984137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:20.984137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:20.984137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:20.984137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:20.985881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:20.985881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:20.985881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:20.985881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:20.985881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:20.985881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:20.985881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:20.985881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:20.985881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:20.985881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:20.985881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:20.985881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:20.985881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:20.985881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:20.985881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:20.985881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:20.987522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:20.987522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:20.987522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:20.987522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:20.987522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:20.987522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:20.987522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:20.987522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:20.987522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:20.987522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:20.987522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:27:20.987522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:20.990823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 65/140] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:27:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:21.000312 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e805b-070f-4080-b392-e0115d41318c None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:21.156877 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:21.231500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e805b-070f-4080-b392-e0115d41318c None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:21.300257 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d6a98-d60b-44f5-999a-8fc4c377420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:21.301234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d6a98-d60b-44f5-999a-8fc4c377420f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:21.301712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d6a98-d60b-44f5-999a-8fc4c377420f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:21.302191 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d6a98-d60b-44f5-999a-8fc4c377420f None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:21.303352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d6a98-d60b-44f5-999a-8fc4c377420f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:21.303919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d6a98-d60b-44f5-999a-8fc4c377420f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:21.306469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d6a98-d60b-44f5-999a-8fc4c377420f None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:21.322727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 76/141] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:21.331280 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373575d5-cd3e-4333-84b3-ae60f86cb926 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:21.571060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373575d5-cd3e-4333-84b3-ae60f86cb926 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:21.674110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c74d64-99c3-4d62-800a-b654e9253c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:21.675189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c74d64-99c3-4d62-800a-b654e9253c40 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:21.675712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c74d64-99c3-4d62-800a-b654e9253c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:21.676209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c74d64-99c3-4d62-800a-b654e9253c40 None admin] PATH_INFO: `/v3/users/f8a8b3ea701948c68e339fb34dbfff3f` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:21.678365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c74d64-99c3-4d62-800a-b654e9253c40 None admin] RBAC: Authorizing `identity:get_user(user_id=f8a8b3ea701948c68e339fb34dbfff3f)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:21.681189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c74d64-99c3-4d62-800a-b654e9253c40 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:21.684306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 66/142] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:21 2022] GET /identity/v3/users/f8a8b3ea701948c68e339fb34dbfff3f => generated 247 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:21.695311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d6a98-d60b-44f5-999a-8fc4c377420f None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:21.840706 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907580f4-89e4-46a0-9f84-24ae86ca5491 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:21.841128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907580f4-89e4-46a0-9f84-24ae86ca5491 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:21.841629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907580f4-89e4-46a0-9f84-24ae86ca5491 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:21.845788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 67/143] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:27:21.869962 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0517635-b52d-40d7-a381-c9d40c3ca248 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:21.870476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0517635-b52d-40d7-a381-c9d40c3ca248 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:21.870959 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0517635-b52d-40d7-a381-c9d40c3ca248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:21.896153 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d6a98-d60b-44f5-999a-8fc4c377420f None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:21.928957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:21.943177 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-e0517635-b52d-40d7-a381-c9d40c3ca248 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:21.953444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4e887-bb24-47b2-b11b-bcac15a0b82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:21.953650 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-e0517635-b52d-40d7-a381-c9d40c3ca248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:21.953770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4e887-bb24-47b2-b11b-bcac15a0b82e None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:21.953770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4e887-bb24-47b2-b11b-bcac15a0b82e None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:21.953770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4e887-bb24-47b2-b11b-bcac15a0b82e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:21.953966 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:22.096619 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4e887-bb24-47b2-b11b-bcac15a0b82e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:22.097552 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 68/144] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:22.098799 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4e887-bb24-47b2-b11b-bcac15a0b82e None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:22.256298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 77/145] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:27:22.264585 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0517635-b52d-40d7-a381-c9d40c3ca248 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:22.400093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0517635-b52d-40d7-a381-c9d40c3ca248 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:22.441857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55767e-a56a-4ffd-8412-30b4bc148dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:22.442938 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55767e-a56a-4ffd-8412-30b4bc148dfb None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:22.443427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55767e-a56a-4ffd-8412-30b4bc148dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:22.443934 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55767e-a56a-4ffd-8412-30b4bc148dfb None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:22.445437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55767e-a56a-4ffd-8412-30b4bc148dfb None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:22.447155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55767e-a56a-4ffd-8412-30b4bc148dfb None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:22.449123 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 69/146] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:22 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:22.458920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4e887-bb24-47b2-b11b-bcac15a0b82e None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:22.509804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:22.608956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4e887-bb24-47b2-b11b-bcac15a0b82e None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:22.660604 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56336f45-9330-4bf3-b98a-ec4b73ba7a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:22.661246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56336f45-9330-4bf3-b98a-ec4b73ba7a0c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:22.661538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56336f45-9330-4bf3-b98a-ec4b73ba7a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:22.661820 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56336f45-9330-4bf3-b98a-ec4b73ba7a0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:22.662573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56336f45-9330-4bf3-b98a-ec4b73ba7a0c None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=76f48757de234b528b472ca888b7cff8, user.id=f8a8b3ea701948c68e339fb34dbfff3f) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:22.662889 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56336f45-9330-4bf3-b98a-ec4b73ba7a0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:22.664563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56336f45-9330-4bf3-b98a-ec4b73ba7a0c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:22.675933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 78/147] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:22 2022] GET /identity/v3/role_assignments?user.id=f8a8b3ea701948c68e339fb34dbfff3f&scope.project.id=76f48757de234b528b472ca888b7cff8&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:22.766929 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55767e-a56a-4ffd-8412-30b4bc148dfb None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:22.787640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:22.977871 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55767e-a56a-4ffd-8412-30b4bc148dfb None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:23.043134 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb4f9d-3377-4bca-9678-36871dfd430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:23.044180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb4f9d-3377-4bca-9678-36871dfd430d None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:23.044633 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb4f9d-3377-4bca-9678-36871dfd430d None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:23.045071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb4f9d-3377-4bca-9678-36871dfd430d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:23.047647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb4f9d-3377-4bca-9678-36871dfd430d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:23.050590 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb4f9d-3377-4bca-9678-36871dfd430d None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:23.053494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 70/148] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:27:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:23.059450 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56336f45-9330-4bf3-b98a-ec4b73ba7a0c None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:23.204478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:23.211713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56336f45-9330-4bf3-b98a-ec4b73ba7a0c None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:23.254924 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181d1d8-3e7e-4517-aa86-cb948242f7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:23.258733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181d1d8-3e7e-4517-aa86-cb948242f7d6 None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:23.258733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181d1d8-3e7e-4517-aa86-cb948242f7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:23.258733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181d1d8-3e7e-4517-aa86-cb948242f7d6 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:23.258733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181d1d8-3e7e-4517-aa86-cb948242f7d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:23.258733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181d1d8-3e7e-4517-aa86-cb948242f7d6 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:23.376650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 79/149] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:27:23 2022] POST /identity/v3/users => generated 283 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:27:23.554997 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cbd77-6c93-4d1b-b575-8e917efec9b9 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:23.555820 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cbd77-6c93-4d1b-b575-8e917efec9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:23.555947 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cbd77-6c93-4d1b-b575-8e917efec9b9 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:23.558656 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 71/150] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:23.578068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c81258-3404-4f33-9081-b920970372e7 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:23.578404 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c81258-3404-4f33-9081-b920970372e7 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:23.578643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c81258-3404-4f33-9081-b920970372e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:23.609671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-d0c81258-3404-4f33-9081-b920970372e7 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:23.610995 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-d0c81258-3404-4f33-9081-b920970372e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:23.719939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 80/151] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:24.206543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc568c-609b-4de1-846e-25ac3b41c52c None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:24.207612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc568c-609b-4de1-846e-25ac3b41c52c None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:24.208390 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc568c-609b-4de1-846e-25ac3b41c52c None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:24.211306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 72/152] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:24.217671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecc9e2-f57b-47b6-ac11-a70a8a0794f0 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:24.218988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecc9e2-f57b-47b6-ac11-a70a8a0794f0 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:24.219719 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecc9e2-f57b-47b6-ac11-a70a8a0794f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:24.256788 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-edecc9e2-f57b-47b6-ac11-a70a8a0794f0 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:24.258899 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-edecc9e2-f57b-47b6-ac11-a70a8a0794f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:24.272668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc568c-609b-4de1-846e-25ac3b41c52c None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:24.384620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 81/153] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:27:24.466145 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:24.522055 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc568c-609b-4de1-846e-25ac3b41c52c None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:24.609679 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbf405-bc6a-4128-9c24-0c2ee21c562d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:24.611069 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbf405-bc6a-4128-9c24-0c2ee21c562d None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:24.611572 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbf405-bc6a-4128-9c24-0c2ee21c562d None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:24.612045 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbf405-bc6a-4128-9c24-0c2ee21c562d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:24.636674 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbf405-bc6a-4128-9c24-0c2ee21c562d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:24.664732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-6bdbf405-bc6a-4128-9c24-0c2ee21c562d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:24.664732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:24.664732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:24.664732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:24.664732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:24.664732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:24.664732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:24.664732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:24.664732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:24.664732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:24.664732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:24.664732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:24.664732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:24.664732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:24.664732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:24.664732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:24.666601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:24.666601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:24.666601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:24.666601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:24.666601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:24.666601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:24.666601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:24.666601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:24.666601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:24.666601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:24.666601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:24.666601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:24.666601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:24.666601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:24.666601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:24.666601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:24.669613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:24.669613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:24.669613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:24.669613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:24.669613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:24.669613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:24.669613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:24.669613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:24.669613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:24.669613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:24.669613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:24.669613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:24.669613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 73/154] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:24.675520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecc9e2-f57b-47b6-ac11-a70a8a0794f0 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:24.692592 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:24.732742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbf405-bc6a-4128-9c24-0c2ee21c562d None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:24.817695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecc9e2-f57b-47b6-ac11-a70a8a0794f0 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:24.866962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5fbd9-cd48-4abb-995a-9a8092d71179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:24.868076 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5fbd9-cd48-4abb-995a-9a8092d71179 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:24.869831 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5fbd9-cd48-4abb-995a-9a8092d71179 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:24.870520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5fbd9-cd48-4abb-995a-9a8092d71179 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:24.872168 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5fbd9-cd48-4abb-995a-9a8092d71179 None admin] RBAC: Adding query filter params (name=member) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:24.872835 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5fbd9-cd48-4abb-995a-9a8092d71179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:24.876016 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5fbd9-cd48-4abb-995a-9a8092d71179 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:24.911573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 82/155] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:24.915072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5fbd9-cd48-4abb-995a-9a8092d71179 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:25.039966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:25.054769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbf405-bc6a-4128-9c24-0c2ee21c562d None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:25.074743 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5fbd9-cd48-4abb-995a-9a8092d71179 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:25.117459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58039a-d1d3-42ba-8151-1b3bd9806baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:25.118116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58039a-d1d3-42ba-8151-1b3bd9806baa None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:25.118388 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58039a-d1d3-42ba-8151-1b3bd9806baa None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:25.118679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58039a-d1d3-42ba-8151-1b3bd9806baa None admin] PATH_INFO: `/v3/users/4ba85db5bf4841828041a1a8149cc423` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:25.122947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58039a-d1d3-42ba-8151-1b3bd9806baa None admin] RBAC: Authorizing `identity:get_user(user_id=4ba85db5bf4841828041a1a8149cc423)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:25.126665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58039a-d1d3-42ba-8151-1b3bd9806baa None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:25.130134 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 83/156] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:24 2022] GET /identity/v3/users/4ba85db5bf4841828041a1a8149cc423 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:25.140990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58039a-d1d3-42ba-8151-1b3bd9806baa None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:25.162630 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259089b-e4a3-4b9c-b919-f8d6fa374ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:25.163292 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259089b-e4a3-4b9c-b919-f8d6fa374ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:25.163957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259089b-e4a3-4b9c-b919-f8d6fa374ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:25.164329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259089b-e4a3-4b9c-b919-f8d6fa374ac7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:25.166616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:25.195439 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259089b-e4a3-4b9c-b919-f8d6fa374ac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:25.201705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-e259089b-e4a3-4b9c-b919-f8d6fa374ac7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:27:25.201705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:25.201705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:25.201705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:25.201705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:25.201705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:25.201705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:25.201705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:25.201705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:25.201705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:25.201705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:25.201705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:25.201705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:25.201705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:25.201705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:25.201705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:25.203400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:25.203400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:25.203400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:25.203400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:25.203400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:25.203400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:25.203400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:25.203400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:25.203400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:25.203400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:25.203400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:25.203400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:25.203400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:25.203400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:25.203400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:25.203400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:25.205413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:25.205413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:25.205413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:25.205413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:25.205413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:25.205413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:25.205413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:25.205413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:25.205413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:25.205413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:25.205413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:27:25.205413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:25.205413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 74/157] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 474 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:27:25.205413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eed93c-0a19-48a1-92f6-acdf883ae751 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:25.206763 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eed93c-0a19-48a1-92f6-acdf883ae751 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:25.206763 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eed93c-0a19-48a1-92f6-acdf883ae751 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:25.207007 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 75/158] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:25.223920 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eed93c-0a19-48a1-92f6-acdf883ae751 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:25.356755 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eed93c-0a19-48a1-92f6-acdf883ae751 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:25.372928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58039a-d1d3-42ba-8151-1b3bd9806baa None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:25.397878 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6dce9-4585-4d63-b374-9a8f13450de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:25.398558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6dce9-4585-4d63-b374-9a8f13450de1 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:25.398852 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6dce9-4585-4d63-b374-9a8f13450de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:25.399116 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6dce9-4585-4d63-b374-9a8f13450de1 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:25.399826 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6dce9-4585-4d63-b374-9a8f13450de1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:25.400129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6dce9-4585-4d63-b374-9a8f13450de1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:25.401615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6dce9-4585-4d63-b374-9a8f13450de1 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:25.413262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 76/159] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:25.414449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2d19f-6dfd-4b4b-b65a-459366131f45 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:25.414708 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2d19f-6dfd-4b4b-b65a-459366131f45 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:25.414991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2d19f-6dfd-4b4b-b65a-459366131f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:25.435623 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-34f2d19f-6dfd-4b4b-b65a-459366131f45 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:25.437004 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-34f2d19f-6dfd-4b4b-b65a-459366131f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:25.490851 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396e463-7776-4fa1-a717-fbb7d7ea3601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:25.491923 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396e463-7776-4fa1-a717-fbb7d7ea3601 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:25.492402 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396e463-7776-4fa1-a717-fbb7d7ea3601 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:25.492883 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396e463-7776-4fa1-a717-fbb7d7ea3601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:25.504924 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:25.520189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:25.528091 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 77/160] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:25.529136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2d19f-6dfd-4b4b-b65a-459366131f45 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:25.682738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2d19f-6dfd-4b4b-b65a-459366131f45 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:25.717504 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396e463-7776-4fa1-a717-fbb7d7ea3601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:25.720926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396e463-7776-4fa1-a717-fbb7d7ea3601 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:25.723128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deef449-b420-4046-9b2f-50eac7624a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:25.723812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deef449-b420-4046-9b2f-50eac7624a0f None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:25.724098 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deef449-b420-4046-9b2f-50eac7624a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:25.724357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deef449-b420-4046-9b2f-50eac7624a0f None admin] PATH_INFO: `/v3/users/d3d7f47772cf4a23b637e9d4e6b308ef` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:25.725592 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deef449-b420-4046-9b2f-50eac7624a0f None admin] RBAC: Authorizing `identity:get_user(user_id=d3d7f47772cf4a23b637e9d4e6b308ef)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:25.727072 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deef449-b420-4046-9b2f-50eac7624a0f None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:25.729001 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 78/161] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:25 2022] GET /identity/v3/users/d3d7f47772cf4a23b637e9d4e6b308ef => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:25.730309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a63711-d2f4-4496-a8bf-c73b54dcfe3e None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:25.730650 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a63711-d2f4-4496-a8bf-c73b54dcfe3e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:25.730930 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a63711-d2f4-4496-a8bf-c73b54dcfe3e None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:25.732541 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 79/162] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:25.745959 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d85da6-62a5-45c4-934c-bd07befa9824 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:25.746238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d85da6-62a5-45c4-934c-bd07befa9824 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:25.746539 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d85da6-62a5-45c4-934c-bd07befa9824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:25.768706 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-77d85da6-62a5-45c4-934c-bd07befa9824 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:25.769934 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-77d85da6-62a5-45c4-934c-bd07befa9824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:25.843891 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:25.872242 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 80/163] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:25.875157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d85da6-62a5-45c4-934c-bd07befa9824 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:26.033334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 84/164] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 894 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:27:26.065008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396e463-7776-4fa1-a717-fbb7d7ea3601 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:26.087225 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d85da6-62a5-45c4-934c-bd07befa9824 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:26.108160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:26.161001 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41965641-b127-4f39-82fb-b7fc827e307a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:26.162055 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41965641-b127-4f39-82fb-b7fc827e307a None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:26.162526 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41965641-b127-4f39-82fb-b7fc827e307a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:26.162986 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41965641-b127-4f39-82fb-b7fc827e307a None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:26.165041 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41965641-b127-4f39-82fb-b7fc827e307a None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:26.167824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41965641-b127-4f39-82fb-b7fc827e307a None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:26.170768 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 81/165] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:25 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:26.172327 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41965641-b127-4f39-82fb-b7fc827e307a None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:26.265965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396e463-7776-4fa1-a717-fbb7d7ea3601 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:26.314909 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a677c-07d8-486c-96df-64696ac9d322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:26.316375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a677c-07d8-486c-96df-64696ac9d322 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:26.317783 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a677c-07d8-486c-96df-64696ac9d322 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:26.318681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a677c-07d8-486c-96df-64696ac9d322 None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:26.322109 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a677c-07d8-486c-96df-64696ac9d322 None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:26.325772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a677c-07d8-486c-96df-64696ac9d322 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:26.332664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 85/166] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:26 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:26.335125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a677c-07d8-486c-96df-64696ac9d322 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:26.340026 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:26.451685 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41965641-b127-4f39-82fb-b7fc827e307a None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:26.542649 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec62f3-a05b-4ceb-a0f7-02be5e088f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:26.543728 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec62f3-a05b-4ceb-a0f7-02be5e088f7f None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:26.544201 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec62f3-a05b-4ceb-a0f7-02be5e088f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:26.544665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec62f3-a05b-4ceb-a0f7-02be5e088f7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:26.565691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a677c-07d8-486c-96df-64696ac9d322 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:26.586853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:26.596874 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec62f3-a05b-4ceb-a0f7-02be5e088f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:26.606791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-65ec62f3-a05b-4ceb-a0f7-02be5e088f7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:26.606791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:26.606791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:26.606791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:26.606791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:26.606791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:26.606791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:26.606791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:26.606791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:26.606791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:26.606791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:26.606791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:26.606791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:26.606791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:26.606791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:26.606791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:26.607972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:26.607972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:26.607972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:26.607972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:26.607972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:26.607972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:26.607972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:26.607972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:26.607972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:26.607972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:26.607972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:26.607972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:26.607972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:26.607972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:26.607972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:26.607972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:26.609093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:26.609093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:26.609093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:26.609093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:26.609093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:26.609093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:26.609093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:26.609093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:26.609093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:26.609093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:26.609093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:26.609093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:26.615819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 82/167] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:26.617245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec62f3-a05b-4ceb-a0f7-02be5e088f7f None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:26.680830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be06735-e1c9-4852-a051-6b70bd11a6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:26.681531 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be06735-e1c9-4852-a051-6b70bd11a6a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:26.681808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be06735-e1c9-4852-a051-6b70bd11a6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:26.682078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be06735-e1c9-4852-a051-6b70bd11a6a5 None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8/users/d3d7f47772cf4a23b637e9d4e6b308ef/roles/be4da00ddeb847968d5fdd6a8dd9de0a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:26.687986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be06735-e1c9-4852-a051-6b70bd11a6a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=76f48757de234b528b472ca888b7cff8, user_id=d3d7f47772cf4a23b637e9d4e6b308ef, role_id=be4da00ddeb847968d5fdd6a8dd9de0a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:26.689492 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be06735-e1c9-4852-a051-6b70bd11a6a5 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:26.764536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 86/168] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:27:26 2022] PUT /identity/v3/projects/76f48757de234b528b472ca888b7cff8/users/d3d7f47772cf4a23b637e9d4e6b308ef/roles/be4da00ddeb847968d5fdd6a8dd9de0a => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:27:26.766511 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be06735-e1c9-4852-a051-6b70bd11a6a5 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:26.809854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec62f3-a05b-4ceb-a0f7-02be5e088f7f None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:26.840606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:26.918078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b64abd-ca45-4eae-b53b-76abca7141a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:26.919658 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b64abd-ca45-4eae-b53b-76abca7141a9 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:26.920681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b64abd-ca45-4eae-b53b-76abca7141a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:26.921547 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b64abd-ca45-4eae-b53b-76abca7141a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:26.923150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b64abd-ca45-4eae-b53b-76abca7141a9 None admin] RBAC: Adding query filter params (role.id=b9c5d282a37c489e83eabbdd2b393dbf, scope.project.id=76f48757de234b528b472ca888b7cff8, user.id=4ba85db5bf4841828041a1a8149cc423) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:26.924032 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b64abd-ca45-4eae-b53b-76abca7141a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:26.935335 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b64abd-ca45-4eae-b53b-76abca7141a9 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:26.956446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 83/169] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:26 2022] GET /identity/v3/role_assignments?user.id=4ba85db5bf4841828041a1a8149cc423&scope.project.id=76f48757de234b528b472ca888b7cff8&role.id=b9c5d282a37c489e83eabbdd2b393dbf => generated 608 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:26.958587 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b64abd-ca45-4eae-b53b-76abca7141a9 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:27.018008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be06735-e1c9-4852-a051-6b70bd11a6a5 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:27.100070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f8494-0e09-4db6-86f1-9f6b68926c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:27.100750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f8494-0e09-4db6-86f1-9f6b68926c7f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:27.101037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f8494-0e09-4db6-86f1-9f6b68926c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:27.101297 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f8494-0e09-4db6-86f1-9f6b68926c7f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:27.118287 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f8494-0e09-4db6-86f1-9f6b68926c7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:27.131643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-307f8494-0e09-4db6-86f1-9f6b68926c7f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:27:27.131643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:27.131643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:27.131643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:27.131643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:27.131643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:27.131643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:27.131643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:27.131643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:27.131643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:27.131643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:27.131643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:27.131643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:27.131643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:27.131643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:27.131643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:27.133420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:27.133420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:27.133420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:27.133420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:27.133420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:27.133420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:27.133420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:27.133420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:27.133420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:27.133420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:27.133420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:27.133420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:27.133420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:27.133420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:27.133420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:27.133420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:27.134962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:27.134962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:27.134962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:27.134962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:27.134962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:27.134962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:27.134962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:27.134962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:27.134962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:27.134962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:27.134962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:27:27.134962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:27:27.134962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 87/170] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:27:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:27.140240 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f8494-0e09-4db6-86f1-9f6b68926c7f None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:27.203580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:27.248540 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b64abd-ca45-4eae-b53b-76abca7141a9 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:27.335130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a73271-f13d-453e-a6a9-950bf8e04aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:27.335804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a73271-f13d-453e-a6a9-950bf8e04aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:27.336087 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a73271-f13d-453e-a6a9-950bf8e04aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:27.336327 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a73271-f13d-453e-a6a9-950bf8e04aa9 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:27.337031 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a73271-f13d-453e-a6a9-950bf8e04aa9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:27.337329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a73271-f13d-453e-a6a9-950bf8e04aa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:27.338801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a73271-f13d-453e-a6a9-950bf8e04aa9 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:27.360528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 84/171] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:27.370641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f8494-0e09-4db6-86f1-9f6b68926c7f None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:27.392317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a73271-f13d-453e-a6a9-950bf8e04aa9 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:27.471320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450bd98-4954-4d8c-a876-0417764e38d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:27.472815 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450bd98-4954-4d8c-a876-0417764e38d9 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:27.473332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450bd98-4954-4d8c-a876-0417764e38d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:27.473582 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450bd98-4954-4d8c-a876-0417764e38d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:27.474285 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450bd98-4954-4d8c-a876-0417764e38d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:27.474584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450bd98-4954-4d8c-a876-0417764e38d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:27.476036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450bd98-4954-4d8c-a876-0417764e38d9 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:27.497307 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:27.500762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 88/172] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:27:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:27.505263 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450bd98-4954-4d8c-a876-0417764e38d9 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:27.633866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a73271-f13d-453e-a6a9-950bf8e04aa9 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:27.679306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:27.697358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450bd98-4954-4d8c-a876-0417764e38d9 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:27.739779 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edfd8c-a9d0-495f-80fc-aeee7bd0c0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:27.740832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edfd8c-a9d0-495f-80fc-aeee7bd0c0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:27.741285 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edfd8c-a9d0-495f-80fc-aeee7bd0c0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:27.741755 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edfd8c-a9d0-495f-80fc-aeee7bd0c0c6 None admin] PATH_INFO: `/v3/users/4ba85db5bf4841828041a1a8149cc423` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:27.743166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edfd8c-a9d0-495f-80fc-aeee7bd0c0c6 None admin] RBAC: Authorizing `identity:get_user(user_id=4ba85db5bf4841828041a1a8149cc423)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:27.744948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edfd8c-a9d0-495f-80fc-aeee7bd0c0c6 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:27.746943 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 89/173] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:27 2022] GET /identity/v3/users/4ba85db5bf4841828041a1a8149cc423 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:27.751016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d6f3b-f62b-4181-b974-d7035e543caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:27.755514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d6f3b-f62b-4181-b974-d7035e543caa None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:27.755514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d6f3b-f62b-4181-b974-d7035e543caa None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:27.755514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d6f3b-f62b-4181-b974-d7035e543caa None admin] PATH_INFO: `/v3/users/4ba85db5bf4841828041a1a8149cc423` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:27.755514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d6f3b-f62b-4181-b974-d7035e543caa None admin] RBAC: Authorizing `identity:get_user(user_id=4ba85db5bf4841828041a1a8149cc423)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:27.757051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edfd8c-a9d0-495f-80fc-aeee7bd0c0c6 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:27.758260 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d6f3b-f62b-4181-b974-d7035e543caa None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:27.762184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 85/174] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:27 2022] GET /identity/v3/users/4ba85db5bf4841828041a1a8149cc423 => generated 275 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:27.768324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d6f3b-f62b-4181-b974-d7035e543caa None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:27.873276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edfd8c-a9d0-495f-80fc-aeee7bd0c0c6 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:27.913937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4fa26-a6a6-4ed7-86c7-90baa0d77a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:27.914921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4fa26-a6a6-4ed7-86c7-90baa0d77a6a None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:27.915393 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4fa26-a6a6-4ed7-86c7-90baa0d77a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:27.915932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4fa26-a6a6-4ed7-86c7-90baa0d77a6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:27.947133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:28.000040 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4fa26-a6a6-4ed7-86c7-90baa0d77a6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:28.001726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4fa26-a6a6-4ed7-86c7-90baa0d77a6a None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:28.103785 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d6f3b-f62b-4181-b974-d7035e543caa None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:28.124172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 90/175] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:27:28.132934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4fa26-a6a6-4ed7-86c7-90baa0d77a6a None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:28.143513 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:28.230508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c32fa-1101-4314-9fb1-ea2939e95dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:28.231028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c32fa-1101-4314-9fb1-ea2939e95dac None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:28.231378 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c32fa-1101-4314-9fb1-ea2939e95dac None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:28.231682 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c32fa-1101-4314-9fb1-ea2939e95dac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:28.248495 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:28.346272 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4fa26-a6a6-4ed7-86c7-90baa0d77a6a None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:28.393489 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c32fa-1101-4314-9fb1-ea2939e95dac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:28.395072 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c32fa-1101-4314-9fb1-ea2939e95dac None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:28.433579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38624c-edd7-4a6f-9d5d-4dcd5aa8c5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:28.434253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38624c-edd7-4a6f-9d5d-4dcd5aa8c5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:28.434537 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38624c-edd7-4a6f-9d5d-4dcd5aa8c5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:28.434828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38624c-edd7-4a6f-9d5d-4dcd5aa8c5a4 None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:28.440466 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38624c-edd7-4a6f-9d5d-4dcd5aa8c5a4 None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:28.441997 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38624c-edd7-4a6f-9d5d-4dcd5aa8c5a4 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:28.444239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 91/176] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:28 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:28.445640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c67430-5893-41f0-bd57-d5d6854bae66 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:28.445973 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c67430-5893-41f0-bd57-d5d6854bae66 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:28.446211 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c67430-5893-41f0-bd57-d5d6854bae66 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:28.447841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 92/177] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:28.456560 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c67430-5893-41f0-bd57-d5d6854bae66 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:28.583524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 86/178] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 811 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:27:28.583524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c580a6-e281-4b29-bc78-a4f911e633fa None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:28.583524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c580a6-e281-4b29-bc78-a4f911e633fa None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:28.583524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c580a6-e281-4b29-bc78-a4f911e633fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:28.596032 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:28.611023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-93c580a6-e281-4b29-bc78-a4f911e633fa None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:28.612266 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-93c580a6-e281-4b29-bc78-a4f911e633fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:28.682427 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c67430-5893-41f0-bd57-d5d6854bae66 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:28.730608 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:28.733963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 87/179] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:28.743513 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c580a6-e281-4b29-bc78-a4f911e633fa None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:28.752455 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a424cbf-10b2-4e72-833f-4dee1a68131f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:28.753508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a424cbf-10b2-4e72-833f-4dee1a68131f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:28.754381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a424cbf-10b2-4e72-833f-4dee1a68131f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:28.754499 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a424cbf-10b2-4e72-833f-4dee1a68131f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:28.755988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a424cbf-10b2-4e72-833f-4dee1a68131f None admin] RBAC: Adding query filter params (role.id=e35c45d51df34051b68fa49475ac7250, scope.project.id=76f48757de234b528b472ca888b7cff8, user.id=4ba85db5bf4841828041a1a8149cc423) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:28.756530 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a424cbf-10b2-4e72-833f-4dee1a68131f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:28.759338 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a424cbf-10b2-4e72-833f-4dee1a68131f None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:28.772086 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 93/180] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:28 2022] GET /identity/v3/role_assignments?user.id=4ba85db5bf4841828041a1a8149cc423&scope.project.id=76f48757de234b528b472ca888b7cff8&role.id=e35c45d51df34051b68fa49475ac7250 => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:28.774259 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb19141-e077-4c27-bdc1-f0f66e5456e7 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:28.774719 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb19141-e077-4c27-bdc1-f0f66e5456e7 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:28.775193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb19141-e077-4c27-bdc1-f0f66e5456e7 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:28.778087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 94/181] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:28.790373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d494e5f-1b53-4eff-951e-4da9eef370d0 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:28.790864 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d494e5f-1b53-4eff-951e-4da9eef370d0 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:28.791340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d494e5f-1b53-4eff-951e-4da9eef370d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:28.848795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-7d494e5f-1b53-4eff-951e-4da9eef370d0 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:28.850854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7d494e5f-1b53-4eff-951e-4da9eef370d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:29.023680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c580a6-e281-4b29-bc78-a4f911e633fa None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:29.062500 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932f1ad-0580-48a1-aa02-20886aea2ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:29.062704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 95/182] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:27:29.063941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932f1ad-0580-48a1-aa02-20886aea2ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:29.064420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932f1ad-0580-48a1-aa02-20886aea2ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:29.064881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932f1ad-0580-48a1-aa02-20886aea2ec6 None admin] PATH_INFO: `/v3/projects/e6a3195fb6d7424ebe9c1c6bfbe3fd93` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:29.066293 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932f1ad-0580-48a1-aa02-20886aea2ec6 None admin] RBAC: Authorizing `identity:get_project(project_id=e6a3195fb6d7424ebe9c1c6bfbe3fd93)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:29.068025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932f1ad-0580-48a1-aa02-20886aea2ec6 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:29.070052 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 88/183] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:28 2022] GET /identity/v3/projects/e6a3195fb6d7424ebe9c1c6bfbe3fd93 => generated 312 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:29.077776 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d494e5f-1b53-4eff-951e-4da9eef370d0 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:29.123988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932f1ad-0580-48a1-aa02-20886aea2ec6 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:29.131969 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:29.309800 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d494e5f-1b53-4eff-951e-4da9eef370d0 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:29.348015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:29.348261 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932f1ad-0580-48a1-aa02-20886aea2ec6 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:29.385065 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b68a79-b21d-4450-b5b0-f5cb1037f282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:29.386616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b68a79-b21d-4450-b5b0-f5cb1037f282 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:29.387071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b68a79-b21d-4450-b5b0-f5cb1037f282 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:29.387539 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b68a79-b21d-4450-b5b0-f5cb1037f282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:29.388906 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b68a79-b21d-4450-b5b0-f5cb1037f282 None admin] RBAC: Adding query filter params (role.id=b9c5d282a37c489e83eabbdd2b393dbf, scope.project.id=e6a3195fb6d7424ebe9c1c6bfbe3fd93, user.id=4ba85db5bf4841828041a1a8149cc423) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:29.390131 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b68a79-b21d-4450-b5b0-f5cb1037f282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:29.392925 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b68a79-b21d-4450-b5b0-f5cb1037f282 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:29.403402 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 96/184] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:29 2022] GET /identity/v3/role_assignments?user.id=4ba85db5bf4841828041a1a8149cc423&scope.project.id=e6a3195fb6d7424ebe9c1c6bfbe3fd93&role.id=b9c5d282a37c489e83eabbdd2b393dbf => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:29.425925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822280e-2e57-42b0-bdef-3b8897180b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:29.426905 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822280e-2e57-42b0-bdef-3b8897180b15 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:29.427355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822280e-2e57-42b0-bdef-3b8897180b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:29.427844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822280e-2e57-42b0-bdef-3b8897180b15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:29.447151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822280e-2e57-42b0-bdef-3b8897180b15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:29.457034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-7822280e-2e57-42b0-bdef-3b8897180b15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:27:29.457034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:29.457034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:29.457034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:29.457034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:29.457034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:29.457034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:29.457034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:29.457034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:29.457034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:29.457034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:29.457034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:29.457034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:29.457034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:29.457034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:29.457034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:29.458740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:29.458740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:29.458740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:29.458740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:29.458740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:29.458740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:29.458740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:29.458740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:29.458740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:29.458740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:29.458740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:29.458740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:29.458740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:29.458740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:29.458740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:29.458740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:29.460805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:29.460805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:29.460805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:29.460805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:29.460805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:29.460805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:29.460805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:29.460805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:29.460805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:29.460805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:29.460805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:27:29.460805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:29.460805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 89/185] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:27:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:29.465552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b68a79-b21d-4450-b5b0-f5cb1037f282 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:29.596884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822280e-2e57-42b0-bdef-3b8897180b15 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:29.605505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b68a79-b21d-4450-b5b0-f5cb1037f282 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:29.650958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097f566-3b4f-4fbe-818c-70b9fe4a45f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:29.651502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097f566-3b4f-4fbe-818c-70b9fe4a45f0 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:29.651817 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097f566-3b4f-4fbe-818c-70b9fe4a45f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:29.652091 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097f566-3b4f-4fbe-818c-70b9fe4a45f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:29.652783 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097f566-3b4f-4fbe-818c-70b9fe4a45f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:29.653086 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097f566-3b4f-4fbe-818c-70b9fe4a45f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:29.654668 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097f566-3b4f-4fbe-818c-70b9fe4a45f0 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:29.665965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 97/186] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:29.672583 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097f566-3b4f-4fbe-818c-70b9fe4a45f0 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:29.740016 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:29.765533 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:29.800685 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097f566-3b4f-4fbe-818c-70b9fe4a45f0 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:29.847884 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036e7c2-f884-42ac-8697-0c7fed21f4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:29.847884 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036e7c2-f884-42ac-8697-0c7fed21f4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:29.847884 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036e7c2-f884-42ac-8697-0c7fed21f4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:29.847884 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036e7c2-f884-42ac-8697-0c7fed21f4b1 None admin] PATH_INFO: `/v3/users/ea1bd8966fae4369ab6a4b491a8fc008` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:29.860745 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822280e-2e57-42b0-bdef-3b8897180b15 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:29.866454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036e7c2-f884-42ac-8697-0c7fed21f4b1 None admin] RBAC: Authorizing `identity:get_user(user_id=ea1bd8966fae4369ab6a4b491a8fc008)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:29.867962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036e7c2-f884-42ac-8697-0c7fed21f4b1 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:29.869684 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 98/187] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:29 2022] GET /identity/v3/users/ea1bd8966fae4369ab6a4b491a8fc008 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:29.876364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036e7c2-f884-42ac-8697-0c7fed21f4b1 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:29.938807 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d11ced-9bb4-4031-8f3c-721f99eb7c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:29.940487 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d11ced-9bb4-4031-8f3c-721f99eb7c18 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:29.941306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d11ced-9bb4-4031-8f3c-721f99eb7c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:29.942095 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d11ced-9bb4-4031-8f3c-721f99eb7c18 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:29.966261 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d11ced-9bb4-4031-8f3c-721f99eb7c18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:29.978179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-e6d11ced-9bb4-4031-8f3c-721f99eb7c18 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:27:29.978179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:29.978179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:29.978179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:29.978179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:29.978179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:29.978179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:29.978179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:29.978179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:29.978179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:29.978179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:29.978179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:29.978179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:29.978179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:29.978179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:29.978179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:29.980272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:29.980272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:29.980272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:29.980272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:29.980272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:29.980272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:29.980272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:29.980272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:29.980272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:29.980272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:29.980272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:29.980272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:29.980272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:29.980272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:29.980272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:29.980272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:29.981819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:29.981819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:29.981819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:29.981819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:29.981819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:29.981819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:29.981819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:29.981819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:29.981819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:29.981819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:29.981819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:27:29.981819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:29.985752 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 90/188] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:27:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:29.994111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d11ced-9bb4-4031-8f3c-721f99eb7c18 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:30.003344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:30.007241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036e7c2-f884-42ac-8697-0c7fed21f4b1 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:30.066580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944a079-1c44-44f4-af4a-10195f7fedca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:30.067223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944a079-1c44-44f4-af4a-10195f7fedca None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:30.067597 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944a079-1c44-44f4-af4a-10195f7fedca None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:30.067875 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944a079-1c44-44f4-af4a-10195f7fedca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:30.137193 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d11ced-9bb4-4031-8f3c-721f99eb7c18 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:30.164545 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:30.177674 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6a1dd-c8b2-444e-a7a8-996ffa41d00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:30.178421 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6a1dd-c8b2-444e-a7a8-996ffa41d00f None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:30.178688 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6a1dd-c8b2-444e-a7a8-996ffa41d00f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:30.178954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6a1dd-c8b2-444e-a7a8-996ffa41d00f None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:30.179656 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6a1dd-c8b2-444e-a7a8-996ffa41d00f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:30.179957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6a1dd-c8b2-444e-a7a8-996ffa41d00f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:30.181371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6a1dd-c8b2-444e-a7a8-996ffa41d00f None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:30.182322 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944a079-1c44-44f4-af4a-10195f7fedca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:30.185003 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944a079-1c44-44f4-af4a-10195f7fedca None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:30.192923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 91/189] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:27:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:30.198632 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3e4bc-d9bb-4ba3-be91-5bb67c8eb90e None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:30.199386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3e4bc-d9bb-4ba3-be91-5bb67c8eb90e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:30.200095 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3e4bc-d9bb-4ba3-be91-5bb67c8eb90e None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:30.206355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 92/190] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:30 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:30.207328 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3e4bc-d9bb-4ba3-be91-5bb67c8eb90e None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:30.346244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:30.348579 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3e4bc-d9bb-4ba3-be91-5bb67c8eb90e None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:30.355823 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 99/191] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 16:27:30.357932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728a085-928c-499f-be9e-0611d96ca1f3 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:30.359347 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728a085-928c-499f-be9e-0611d96ca1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:30.359849 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728a085-928c-499f-be9e-0611d96ca1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:30.388060 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-b728a085-928c-499f-be9e-0611d96ca1f3 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:30.389771 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b728a085-928c-499f-be9e-0611d96ca1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:30.413763 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2d7ac-f597-4f8b-a27b-52e626892103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:30.414762 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2d7ac-f597-4f8b-a27b-52e626892103 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:30.415212 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2d7ac-f597-4f8b-a27b-52e626892103 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:30.415686 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2d7ac-f597-4f8b-a27b-52e626892103 None admin] PATH_INFO: `/v3/users/ea1bd8966fae4369ab6a4b491a8fc008` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:30.418151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2d7ac-f597-4f8b-a27b-52e626892103 None admin] RBAC: Authorizing `identity:get_user(user_id=ea1bd8966fae4369ab6a4b491a8fc008)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:30.421282 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2d7ac-f597-4f8b-a27b-52e626892103 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:30.424135 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 93/192] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:30 2022] GET /identity/v3/users/ea1bd8966fae4369ab6a4b491a8fc008 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:30.432345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2d7ac-f597-4f8b-a27b-52e626892103 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:30.502566 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 100/193] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:30.504315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728a085-928c-499f-be9e-0611d96ca1f3 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:30.542232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:30.618448 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2d7ac-f597-4f8b-a27b-52e626892103 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:30.678443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728a085-928c-499f-be9e-0611d96ca1f3 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:30.678682 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a584cc-4a70-4af2-8e9e-20da667e86a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:30.679610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a584cc-4a70-4af2-8e9e-20da667e86a1 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:30.680044 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a584cc-4a70-4af2-8e9e-20da667e86a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:30.680476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a584cc-4a70-4af2-8e9e-20da667e86a1 None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:30.682339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a584cc-4a70-4af2-8e9e-20da667e86a1 None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:30.684406 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a584cc-4a70-4af2-8e9e-20da667e86a1 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:30.692991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 94/194] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:30 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:30.692991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5c5e6-55c6-4a93-bdc4-930df6c81612 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:30.692991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5c5e6-55c6-4a93-bdc4-930df6c81612 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:30.692991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5c5e6-55c6-4a93-bdc4-930df6c81612 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:30.694350 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 95/195] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:30.695091 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5c5e6-55c6-4a93-bdc4-930df6c81612 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:30.726490 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:30.736247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e65718-c663-4434-9960-88a47047a008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:30.737125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e65718-c663-4434-9960-88a47047a008 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:30.740951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e65718-c663-4434-9960-88a47047a008 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:30.740951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e65718-c663-4434-9960-88a47047a008 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:30.820134 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e65718-c663-4434-9960-88a47047a008 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:30.821543 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e65718-c663-4434-9960-88a47047a008 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:30.834816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5c5e6-55c6-4a93-bdc4-930df6c81612 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:30.862462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:30.874590 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a4500-4336-4b79-bafd-80422035c654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:30.875201 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a4500-4336-4b79-bafd-80422035c654 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:30.875497 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a4500-4336-4b79-bafd-80422035c654 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:30.877985 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a4500-4336-4b79-bafd-80422035c654 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:30.877985 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a4500-4336-4b79-bafd-80422035c654 None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=d636caf99d654f54ada4912b086ad3c6, user.id=ea1bd8966fae4369ab6a4b491a8fc008) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:30.877985 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a4500-4336-4b79-bafd-80422035c654 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:30.878277 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a4500-4336-4b79-bafd-80422035c654 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:30.884103 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 96/196] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:30 2022] GET /identity/v3/role_assignments?user.id=ea1bd8966fae4369ab6a4b491a8fc008&scope.project.id=d636caf99d654f54ada4912b086ad3c6&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:30.885329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48093890-5e95-42f4-b2b5-3b9f38863595 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:30.885606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48093890-5e95-42f4-b2b5-3b9f38863595 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:30.885881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48093890-5e95-42f4-b2b5-3b9f38863595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:30.907171 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-48093890-5e95-42f4-b2b5-3b9f38863595 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:30.908498 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-48093890-5e95-42f4-b2b5-3b9f38863595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:30.956646 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 101/197] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:27:30.957976 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e65718-c663-4434-9960-88a47047a008 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:31.010012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 97/198] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:31.011453 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48093890-5e95-42f4-b2b5-3b9f38863595 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:31.016572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:31.127010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e65718-c663-4434-9960-88a47047a008 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:31.158995 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48093890-5e95-42f4-b2b5-3b9f38863595 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:31.167465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194dd49-a007-4d45-86ce-55eeb0e4295d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:31.168351 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194dd49-a007-4d45-86ce-55eeb0e4295d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:31.168720 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194dd49-a007-4d45-86ce-55eeb0e4295d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:31.169125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194dd49-a007-4d45-86ce-55eeb0e4295d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:31.170442 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194dd49-a007-4d45-86ce-55eeb0e4295d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:31.172667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194dd49-a007-4d45-86ce-55eeb0e4295d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:31.174444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 102/199] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:27:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:31.180155 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194dd49-a007-4d45-86ce-55eeb0e4295d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:31.188445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:31.217418 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eaef7-e73e-4a97-b94c-3040d9ca0560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:31.219638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eaef7-e73e-4a97-b94c-3040d9ca0560 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:31.220459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eaef7-e73e-4a97-b94c-3040d9ca0560 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:31.220877 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eaef7-e73e-4a97-b94c-3040d9ca0560 None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:31.222250 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0eaef7-e73e-4a97-b94c-3040d9ca0560 None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:31.225158 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0eaef7-e73e-4a97-b94c-3040d9ca0560 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:31.227054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 98/200] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:31 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:31.233683 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eaef7-e73e-4a97-b94c-3040d9ca0560 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:31.384707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eaef7-e73e-4a97-b94c-3040d9ca0560 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:31.427292 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:31.431654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194dd49-a007-4d45-86ce-55eeb0e4295d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:31.449718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006841c-1449-404f-b7bf-e698b4c097ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:31.450924 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006841c-1449-404f-b7bf-e698b4c097ba None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:31.451388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006841c-1449-404f-b7bf-e698b4c097ba None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:31.452557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006841c-1449-404f-b7bf-e698b4c097ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:31.453923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006841c-1449-404f-b7bf-e698b4c097ba None admin] RBAC: Adding query filter params (role.id=e35c45d51df34051b68fa49475ac7250, scope.project.id=d636caf99d654f54ada4912b086ad3c6, user.id=ea1bd8966fae4369ab6a4b491a8fc008) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:31.454423 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006841c-1449-404f-b7bf-e698b4c097ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:31.456616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006841c-1449-404f-b7bf-e698b4c097ba None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:31.465462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 99/201] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:31 2022] GET /identity/v3/role_assignments?user.id=ea1bd8966fae4369ab6a4b491a8fc008&scope.project.id=d636caf99d654f54ada4912b086ad3c6&role.id=e35c45d51df34051b68fa49475ac7250 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:31.475316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430de5e-84c0-4a5b-a892-c5ae03c7006e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:31.476583 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430de5e-84c0-4a5b-a892-c5ae03c7006e None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:31.477502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430de5e-84c0-4a5b-a892-c5ae03c7006e None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:31.477975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430de5e-84c0-4a5b-a892-c5ae03c7006e None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:31.478877 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430de5e-84c0-4a5b-a892-c5ae03c7006e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:31.481004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430de5e-84c0-4a5b-a892-c5ae03c7006e None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:31.502244 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006841c-1449-404f-b7bf-e698b4c097ba None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:31.597765 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 103/202] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:27:31 2022] POST /identity/v3/users => generated 297 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:27:31.618462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:31.690460 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006841c-1449-404f-b7bf-e698b4c097ba None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:31.741162 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85790e7-df35-4acc-b5f7-3409c05d6a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:31.742262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85790e7-df35-4acc-b5f7-3409c05d6a28 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:31.742787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85790e7-df35-4acc-b5f7-3409c05d6a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:31.743266 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85790e7-df35-4acc-b5f7-3409c05d6a28 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:31.768087 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85790e7-df35-4acc-b5f7-3409c05d6a28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:31.777927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-c85790e7-df35-4acc-b5f7-3409c05d6a28 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:27:31.777927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:31.777927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:31.777927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:31.777927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:31.777927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:31.777927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:31.777927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:31.777927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:31.777927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:31.777927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:31.777927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:31.777927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:31.777927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:31.777927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:31.777927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:31.779710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:31.779710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:31.779710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:31.779710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:31.779710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:31.779710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:31.779710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:31.779710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:31.779710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:31.779710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:31.779710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:31.779710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:31.779710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:31.779710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:31.779710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:31.779710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:31.782054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:31.782054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:31.782054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:31.782054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:31.782054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:31.782054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:31.782054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:31.782054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:31.782054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:31.782054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:31.782054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:27:31.782054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:31.786313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 100/203] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:31.796791 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430de5e-84c0-4a5b-a892-c5ae03c7006e None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:31.963147 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430de5e-84c0-4a5b-a892-c5ae03c7006e None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:32.032628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858ce53-58cd-4c7a-89a5-94ed47259ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:32.034048 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858ce53-58cd-4c7a-89a5-94ed47259ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:32.034820 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858ce53-58cd-4c7a-89a5-94ed47259ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:32.035493 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858ce53-58cd-4c7a-89a5-94ed47259ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:32.036967 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858ce53-58cd-4c7a-89a5-94ed47259ce6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:32.037733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858ce53-58cd-4c7a-89a5-94ed47259ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:32.040777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858ce53-58cd-4c7a-89a5-94ed47259ce6 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:32.059060 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 104/204] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:32.065357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85790e7-df35-4acc-b5f7-3409c05d6a28 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:32.248515 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85790e7-df35-4acc-b5f7-3409c05d6a28 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:32.268804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:32.323047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e04cb5-e944-4f74-be33-239973e3f6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:32.324489 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e04cb5-e944-4f74-be33-239973e3f6fd None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:32.325171 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e04cb5-e944-4f74-be33-239973e3f6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:32.325797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e04cb5-e944-4f74-be33-239973e3f6fd None admin] PATH_INFO: `/v3/users/d3d7f47772cf4a23b637e9d4e6b308ef` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:32.329125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e04cb5-e944-4f74-be33-239973e3f6fd None admin] RBAC: Authorizing `identity:get_user(user_id=d3d7f47772cf4a23b637e9d4e6b308ef)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:32.335099 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e04cb5-e944-4f74-be33-239973e3f6fd None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:32.338352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 101/205] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:32 2022] GET /identity/v3/users/d3d7f47772cf4a23b637e9d4e6b308ef => generated 289 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:32.345688 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858ce53-58cd-4c7a-89a5-94ed47259ce6 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:32.381771 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:32.507990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858ce53-58cd-4c7a-89a5-94ed47259ce6 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:32.557466 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff4865-ce0f-4ac2-afcb-704b2a928dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:32.558112 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4865-ce0f-4ac2-afcb-704b2a928dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:32.558391 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4865-ce0f-4ac2-afcb-704b2a928dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:32.558664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4865-ce0f-4ac2-afcb-704b2a928dd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:32.659517 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff4865-ce0f-4ac2-afcb-704b2a928dd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:32.659517 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff4865-ce0f-4ac2-afcb-704b2a928dd9 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:32.680544 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:32.785284 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 105/206] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:27:32.791402 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e04cb5-e944-4f74-be33-239973e3f6fd None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:33.020917 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e04cb5-e944-4f74-be33-239973e3f6fd None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:33.093721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a5771-d1a2-4e87-90d1-c0e2e52bd3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:33.094710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a5771-d1a2-4e87-90d1-c0e2e52bd3ca None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:33.095201 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a5771-d1a2-4e87-90d1-c0e2e52bd3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:33.095723 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a5771-d1a2-4e87-90d1-c0e2e52bd3ca None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:33.097844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a5771-d1a2-4e87-90d1-c0e2e52bd3ca None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:33.100609 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a5771-d1a2-4e87-90d1-c0e2e52bd3ca None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:33.104128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 102/207] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:32 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:33.112658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff4865-ce0f-4ac2-afcb-704b2a928dd9 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:33.282990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff4865-ce0f-4ac2-afcb-704b2a928dd9 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:33.324022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:33.341447 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb34d2-fa52-4622-8c21-720111923dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:33.342084 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb34d2-fa52-4622-8c21-720111923dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:33.342991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb34d2-fa52-4622-8c21-720111923dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:33.343268 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb34d2-fa52-4622-8c21-720111923dc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:33.344046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb34d2-fa52-4622-8c21-720111923dc4 None admin] RBAC: Adding query filter params (role.id=be4da00ddeb847968d5fdd6a8dd9de0a, scope.project.id=76f48757de234b528b472ca888b7cff8, user.id=d3d7f47772cf4a23b637e9d4e6b308ef) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:33.344491 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb34d2-fa52-4622-8c21-720111923dc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:33.345981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb34d2-fa52-4622-8c21-720111923dc4 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:33.352945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 106/208] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:33 2022] GET /identity/v3/role_assignments?user.id=d3d7f47772cf4a23b637e9d4e6b308ef&scope.project.id=76f48757de234b528b472ca888b7cff8&role.id=be4da00ddeb847968d5fdd6a8dd9de0a => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:34.482296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad40e8-4785-4045-9d12-bddc802fe862 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:34.483113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad40e8-4785-4045-9d12-bddc802fe862 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:34.483113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad40e8-4785-4045-9d12-bddc802fe862 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:34.483424 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a49ac6-eeff-4886-a64b-a3c2a3364235 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:34.484071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a49ac6-eeff-4886-a64b-a3c2a3364235 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:34.484506 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a49ac6-eeff-4886-a64b-a3c2a3364235 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:34.484824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 103/209] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:34.487249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 107/210] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:34.491210 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac611e72-d9cb-4b53-b89e-81c3894b06d5 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:34.491827 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac611e72-d9cb-4b53-b89e-81c3894b06d5 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:34.492312 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac611e72-d9cb-4b53-b89e-81c3894b06d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:34.496491 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5639e07-6c42-465e-a72e-3cd2e4a373ba None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:34.496943 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5639e07-6c42-465e-a72e-3cd2e4a373ba None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:34.497363 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5639e07-6c42-465e-a72e-3cd2e4a373ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:34.525796 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-e5639e07-6c42-465e-a72e-3cd2e4a373ba None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:34.528295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e5639e07-6c42-465e-a72e-3cd2e4a373ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:34.532017 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-ac611e72-d9cb-4b53-b89e-81c3894b06d5 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:34.534284 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ac611e72-d9cb-4b53-b89e-81c3894b06d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:34.629792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:34.669869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 108/211] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:34.680807 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 104/212] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:34.952829 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5639e07-6c42-465e-a72e-3cd2e4a373ba None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:34.998083 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa173d-ac2b-4511-9f58-b63d31291885 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:34.999102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa173d-ac2b-4511-9f58-b63d31291885 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:34.999924 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa173d-ac2b-4511-9f58-b63d31291885 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:35.002766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 105/213] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:35.012031 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd856d-2676-442a-8456-cb5506ca1020 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:35.012913 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd856d-2676-442a-8456-cb5506ca1020 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:35.013668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd856d-2676-442a-8456-cb5506ca1020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:35.046603 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-a3dd856d-2676-442a-8456-cb5506ca1020 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:35.049333 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a3dd856d-2676-442a-8456-cb5506ca1020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:35.073528 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5639e07-6c42-465e-a72e-3cd2e4a373ba None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:35.087361 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:35.113683 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e383db-fd17-478b-85e1-d149ae979ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:35.114336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e383db-fd17-478b-85e1-d149ae979ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:35.114613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e383db-fd17-478b-85e1-d149ae979ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:35.114878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e383db-fd17-478b-85e1-d149ae979ec8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:35.127249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e383db-fd17-478b-85e1-d149ae979ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:35.133220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-89e383db-fd17-478b-85e1-d149ae979ec8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:27:35.133220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:35.133220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:35.133220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:35.133220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:35.133220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:35.133220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:35.133220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:35.133220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:35.133220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:35.133220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:35.133220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:35.133220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:35.133220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:35.133220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:35.133220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:35.134218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:35.134218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:35.134218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:35.134218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:35.134218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:35.134218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:35.134218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:35.134218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:35.134218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:35.134218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:35.134218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:35.134218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:35.134218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:35.134218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:35.134218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:35.134218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:35.135032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:35.135032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:35.135032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:35.135032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:35.135032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:35.135032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:35.135032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:35.135032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:35.135032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:35.135032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:35.135032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:27:35.135032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:27:35.139953 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 109/214] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:27:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:35.141535 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01b785-6ed1-4ec9-9463-0c4faffecce6 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:35.141824 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01b785-6ed1-4ec9-9463-0c4faffecce6 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:35.142098 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01b785-6ed1-4ec9-9463-0c4faffecce6 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:35.147702 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 110/215] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:35.147702 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01b785-6ed1-4ec9-9463-0c4faffecce6 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:35.182406 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 106/216] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:35.185229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf3043-9a3c-4983-a26f-9325c882d192 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:35.185676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf3043-9a3c-4983-a26f-9325c882d192 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:35.186847 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf3043-9a3c-4983-a26f-9325c882d192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:35.212571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-1bcf3043-9a3c-4983-a26f-9325c882d192 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:35.213742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1bcf3043-9a3c-4983-a26f-9325c882d192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:35.270478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01b785-6ed1-4ec9-9463-0c4faffecce6 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:35.296307 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 107/217] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:35.297013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf3043-9a3c-4983-a26f-9325c882d192 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:35.336206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf98692-29b1-47c7-b63e-47b13c160930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:35.337771 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf98692-29b1-47c7-b63e-47b13c160930 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:35.338697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf98692-29b1-47c7-b63e-47b13c160930 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:35.340181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf98692-29b1-47c7-b63e-47b13c160930 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:35.340387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:35.344246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf98692-29b1-47c7-b63e-47b13c160930 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:35.345104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf98692-29b1-47c7-b63e-47b13c160930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:35.349983 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf98692-29b1-47c7-b63e-47b13c160930 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:35.370245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 111/218] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:27:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:35.377180 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf98692-29b1-47c7-b63e-47b13c160930 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:35.418884 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:35.456931 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf3043-9a3c-4983-a26f-9325c882d192 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:35.506755 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf98692-29b1-47c7-b63e-47b13c160930 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:35.521668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195dd836-03e5-4c6f-8b2a-fceae5e71dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:35.524268 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dd836-03e5-4c6f-8b2a-fceae5e71dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:35.525386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dd836-03e5-4c6f-8b2a-fceae5e71dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:35.526314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dd836-03e5-4c6f-8b2a-fceae5e71dd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:35.551068 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195dd836-03e5-4c6f-8b2a-fceae5e71dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:35.552901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b44e51-42ab-40ec-a3d9-e9705fa48e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:35.553547 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b44e51-42ab-40ec-a3d9-e9705fa48e3e None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:35.553814 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b44e51-42ab-40ec-a3d9-e9705fa48e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:35.554083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b44e51-42ab-40ec-a3d9-e9705fa48e3e None admin] PATH_INFO: `/v3/users/ea1bd8966fae4369ab6a4b491a8fc008` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:35.555359 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b44e51-42ab-40ec-a3d9-e9705fa48e3e None admin] RBAC: Authorizing `identity:get_user(user_id=ea1bd8966fae4369ab6a4b491a8fc008)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:35.556846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b44e51-42ab-40ec-a3d9-e9705fa48e3e None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:35.560193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 112/219] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:35 2022] GET /identity/v3/users/ea1bd8966fae4369ab6a4b491a8fc008 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:35.564725 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b44e51-42ab-40ec-a3d9-e9705fa48e3e None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:35.568331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-195dd836-03e5-4c6f-8b2a-fceae5e71dd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:27:35.568331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:35.568331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:35.568331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:35.568331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:35.568331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:35.568331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:35.568331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:35.568331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:35.568331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:35.568331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:35.568331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:35.568331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:35.568331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:35.568331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:35.568331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:35.570025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:35.570025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:35.570025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:35.570025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:35.570025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:35.570025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:35.570025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:35.570025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:35.570025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:35.570025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:35.570025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:35.570025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:35.570025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:35.570025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:35.570025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:35.570025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:35.571536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:35.571536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:35.571536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:35.571536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:35.571536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:35.571536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:35.571536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:35.571536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:35.571536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:35.571536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:35.571536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:27:35.571536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:35.579338 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 108/220] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:27:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:35.584545 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195dd836-03e5-4c6f-8b2a-fceae5e71dd7 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:35.696091 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:35.703743 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195dd836-03e5-4c6f-8b2a-fceae5e71dd7 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:35.729450 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:35.732872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b44e51-42ab-40ec-a3d9-e9705fa48e3e None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:35.744532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bbadc-89ba-4ec7-902a-2329877588fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:35.745404 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bbadc-89ba-4ec7-902a-2329877588fe None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:35.745832 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bbadc-89ba-4ec7-902a-2329877588fe None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:35.746272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bbadc-89ba-4ec7-902a-2329877588fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:35.748165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bbadc-89ba-4ec7-902a-2329877588fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:35.750531 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bbadc-89ba-4ec7-902a-2329877588fe None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:35.755601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 109/221] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:27:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:35.755601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bbadc-89ba-4ec7-902a-2329877588fe None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:35.787916 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e0e56-9237-4f7c-b91e-aec501fbf2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:35.788831 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e0e56-9237-4f7c-b91e-aec501fbf2db None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:35.789274 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e0e56-9237-4f7c-b91e-aec501fbf2db None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:35.789737 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e0e56-9237-4f7c-b91e-aec501fbf2db None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:35.791593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e0e56-9237-4f7c-b91e-aec501fbf2db None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:35.794119 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e0e56-9237-4f7c-b91e-aec501fbf2db None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:35.802054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 113/222] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:35 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:35.802054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e0e56-9237-4f7c-b91e-aec501fbf2db None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:35.908424 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bbadc-89ba-4ec7-902a-2329877588fe None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:35.934968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e0e56-9237-4f7c-b91e-aec501fbf2db None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:35.948846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f483d-4687-4771-bf9c-54efb74e86f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:35.949603 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f483d-4687-4771-bf9c-54efb74e86f8 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:35.949997 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f483d-4687-4771-bf9c-54efb74e86f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:35.950385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f483d-4687-4771-bf9c-54efb74e86f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:35.951223 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f483d-4687-4771-bf9c-54efb74e86f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:35.952187 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f483d-4687-4771-bf9c-54efb74e86f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:35.953778 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f483d-4687-4771-bf9c-54efb74e86f8 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:35.963075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 110/223] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:35.963977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f483d-4687-4771-bf9c-54efb74e86f8 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:35.986916 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd2111-71fb-484b-b286-42791099ba4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:35.987758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd2111-71fb-484b-b286-42791099ba4e None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:35.988132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd2111-71fb-484b-b286-42791099ba4e None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:35.988521 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd2111-71fb-484b-b286-42791099ba4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:35.995672 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:36.001196 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd2111-71fb-484b-b286-42791099ba4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:36.006416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-5abd2111-71fb-484b-b286-42791099ba4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:36.006416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:36.006416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:36.006416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:36.006416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:36.006416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:36.006416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:36.006416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:36.006416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:36.006416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:36.006416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:36.006416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:36.006416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:36.006416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:36.006416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:36.006416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:36.014867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:36.014867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:36.014867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:36.014867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:36.014867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:36.014867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:36.014867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:36.014867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:36.014867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:36.014867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:36.014867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:36.014867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:36.014867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:36.014867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:36.014867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:36.014867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:36.016699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:36.016699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:36.016699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:36.016699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:36.016699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:36.016699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:36.016699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:36.016699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:36.016699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:36.016699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:36.016699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:36.016699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:27:36.016699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 114/224] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:36.016699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd2111-71fb-484b-b286-42791099ba4e None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:36.048599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:36.102811 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f483d-4687-4771-bf9c-54efb74e86f8 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:36.154260 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd2111-71fb-484b-b286-42791099ba4e None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:36.156774 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bcf14-722d-46e9-8d04-28deadd5bcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:36.157734 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bcf14-722d-46e9-8d04-28deadd5bcc9 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:36.158183 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bcf14-722d-46e9-8d04-28deadd5bcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:36.158636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bcf14-722d-46e9-8d04-28deadd5bcc9 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:36.159443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bcf14-722d-46e9-8d04-28deadd5bcc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:36.161946 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bcf14-722d-46e9-8d04-28deadd5bcc9 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:36.202793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efded70-e5f9-4cc1-af5a-eb265fb6d92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:36.203639 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efded70-e5f9-4cc1-af5a-eb265fb6d92f None admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:36.204006 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efded70-e5f9-4cc1-af5a-eb265fb6d92f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:36.204367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efded70-e5f9-4cc1-af5a-eb265fb6d92f None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6/users/ea1bd8966fae4369ab6a4b491a8fc008/roles/e35c45d51df34051b68fa49475ac7250` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:36.206712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efded70-e5f9-4cc1-af5a-eb265fb6d92f None admin] RBAC: Authorizing `identity:create_grant(project_id=d636caf99d654f54ada4912b086ad3c6, user_id=ea1bd8966fae4369ab6a4b491a8fc008, role_id=e35c45d51df34051b68fa49475ac7250)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:36.208473 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efded70-e5f9-4cc1-af5a-eb265fb6d92f None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:36.273479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 111/225] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:27:35 2022] POST /identity/v3/users => generated 297 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:27:36.274442 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bcf14-722d-46e9-8d04-28deadd5bcc9 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:36.307132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 115/226] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:27:36 2022] PUT /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6/users/ea1bd8966fae4369ab6a4b491a8fc008/roles/e35c45d51df34051b68fa49475ac7250 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:27:36.309036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efded70-e5f9-4cc1-af5a-eb265fb6d92f None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:36.464748 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:36.511526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:36.523909 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bcf14-722d-46e9-8d04-28deadd5bcc9 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:36.541221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efded70-e5f9-4cc1-af5a-eb265fb6d92f None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:36.594356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a96ac-998e-4ea0-819c-7289920e9660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:36.595538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a96ac-998e-4ea0-819c-7289920e9660 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:36.596079 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a96ac-998e-4ea0-819c-7289920e9660 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:36.596567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a96ac-998e-4ea0-819c-7289920e9660 None admin] PATH_INFO: `/v3/users/ea1bd8966fae4369ab6a4b491a8fc008` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:36.598854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a96ac-998e-4ea0-819c-7289920e9660 None admin] RBAC: Authorizing `identity:get_user(user_id=ea1bd8966fae4369ab6a4b491a8fc008)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:36.603846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a96ac-998e-4ea0-819c-7289920e9660 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:36.605485 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 112/227] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:36 2022] GET /identity/v3/users/ea1bd8966fae4369ab6a4b491a8fc008 => generated 283 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:36.617458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a96ac-998e-4ea0-819c-7289920e9660 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:36.622705 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bbfef-5d8c-43b1-b799-124382df6516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:36.623387 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bbfef-5d8c-43b1-b799-124382df6516 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:36.624440 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bbfef-5d8c-43b1-b799-124382df6516 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:36.625720 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bbfef-5d8c-43b1-b799-124382df6516 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:36.626515 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7bbfef-5d8c-43b1-b799-124382df6516 None admin] RBAC: Adding query filter params (name=member) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:36.626825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7bbfef-5d8c-43b1-b799-124382df6516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:36.628279 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7bbfef-5d8c-43b1-b799-124382df6516 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:36.639223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 116/228] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:36.646364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bbfef-5d8c-43b1-b799-124382df6516 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:36.827365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a96ac-998e-4ea0-819c-7289920e9660 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:36.865338 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bbfef-5d8c-43b1-b799-124382df6516 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:36.906543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c1ee2-b202-4f64-a3f5-edffe7f558cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:36.907608 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c1ee2-b202-4f64-a3f5-edffe7f558cc None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:36.908927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c1ee2-b202-4f64-a3f5-edffe7f558cc None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:36.909397 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c1ee2-b202-4f64-a3f5-edffe7f558cc None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:36.911778 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c1ee2-b202-4f64-a3f5-edffe7f558cc None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:36.914811 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c1ee2-b202-4f64-a3f5-edffe7f558cc None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:36.918241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 113/229] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:36 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:36.929574 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c1ee2-b202-4f64-a3f5-edffe7f558cc None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:36.945994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73f673-4b81-45d1-a48c-d5a674c8f912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:36.947113 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f673-4b81-45d1-a48c-d5a674c8f912 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:36.948799 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f673-4b81-45d1-a48c-d5a674c8f912 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:36.949298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f673-4b81-45d1-a48c-d5a674c8f912 None admin] PATH_INFO: `/v3/users/c6461bc84cdb49c2ab83fd09ecc9d424` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:36.974860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:36.982727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73f673-4b81-45d1-a48c-d5a674c8f912 None admin] RBAC: Authorizing `identity:get_user(user_id=c6461bc84cdb49c2ab83fd09ecc9d424)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:36.986613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73f673-4b81-45d1-a48c-d5a674c8f912 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:36.989283 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 117/230] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:36 2022] GET /identity/v3/users/c6461bc84cdb49c2ab83fd09ecc9d424 => generated 297 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:36.995420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73f673-4b81-45d1-a48c-d5a674c8f912 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:37.021508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:37.161343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c1ee2-b202-4f64-a3f5-edffe7f558cc None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:37.198936 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73f673-4b81-45d1-a48c-d5a674c8f912 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:37.246518 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0779f-2e93-4e52-9d59-bcd0237527cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:37.247681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0779f-2e93-4e52-9d59-bcd0237527cf None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:37.248217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0779f-2e93-4e52-9d59-bcd0237527cf None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:37.248788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0779f-2e93-4e52-9d59-bcd0237527cf None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6/users/ea1bd8966fae4369ab6a4b491a8fc008/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:37.252379 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0779f-2e93-4e52-9d59-bcd0237527cf None admin] RBAC: Authorizing `identity:create_grant(project_id=d636caf99d654f54ada4912b086ad3c6, user_id=ea1bd8966fae4369ab6a4b491a8fc008, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:37.262095 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0779f-2e93-4e52-9d59-bcd0237527cf None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:37.267173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb763d4a-7357-43c9-be2f-e8738d5e1591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:37.268281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb763d4a-7357-43c9-be2f-e8738d5e1591 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:37.268831 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb763d4a-7357-43c9-be2f-e8738d5e1591 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:37.269379 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb763d4a-7357-43c9-be2f-e8738d5e1591 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:37.382926 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 114/231] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:27:36 2022] PUT /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6/users/ea1bd8966fae4369ab6a4b491a8fc008/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:27:37.430871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb763d4a-7357-43c9-be2f-e8738d5e1591 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:37.433411 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb763d4a-7357-43c9-be2f-e8738d5e1591 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:37.461857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:37.634450 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 118/232] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:27:37.644498 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0779f-2e93-4e52-9d59-bcd0237527cf None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:37.822765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:37.868677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0779f-2e93-4e52-9d59-bcd0237527cf None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:37.933669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f45fe-84ba-464a-8e80-9f499c31449e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:37.934759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f45fe-84ba-464a-8e80-9f499c31449e None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:37.935239 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f45fe-84ba-464a-8e80-9f499c31449e None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:37.935836 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f45fe-84ba-464a-8e80-9f499c31449e None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:37.938038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f45fe-84ba-464a-8e80-9f499c31449e None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:37.940789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f45fe-84ba-464a-8e80-9f499c31449e None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:37.943931 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 115/233] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:37 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:37.953677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb763d4a-7357-43c9-be2f-e8738d5e1591 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:38.179905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb763d4a-7357-43c9-be2f-e8738d5e1591 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:38.189149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:38.226985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb72e2-a5a8-4379-a0f2-877427d7244b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:38.227639 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb72e2-a5a8-4379-a0f2-877427d7244b None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:38.227915 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb72e2-a5a8-4379-a0f2-877427d7244b None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:38.228183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb72e2-a5a8-4379-a0f2-877427d7244b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:38.229158 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb72e2-a5a8-4379-a0f2-877427d7244b None admin] RBAC: Adding query filter params (role.id=b9c5d282a37c489e83eabbdd2b393dbf, scope.project.id=d636caf99d654f54ada4912b086ad3c6, user.id=c6461bc84cdb49c2ab83fd09ecc9d424) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:38.229474 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb72e2-a5a8-4379-a0f2-877427d7244b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:38.232318 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb72e2-a5a8-4379-a0f2-877427d7244b None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:38.245798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 119/234] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:37 2022] GET /identity/v3/role_assignments?user.id=c6461bc84cdb49c2ab83fd09ecc9d424&scope.project.id=d636caf99d654f54ada4912b086ad3c6&role.id=b9c5d282a37c489e83eabbdd2b393dbf => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:39.914533 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29b227-ef81-44c5-9ac0-6a60b697c1bc None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:39.915419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29b227-ef81-44c5-9ac0-6a60b697c1bc None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:39.915419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29b227-ef81-44c5-9ac0-6a60b697c1bc None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:39.918627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 116/235] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:39.926319 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308b313-3dca-4d89-8f61-7c9d1a205753 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:39.926893 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308b313-3dca-4d89-8f61-7c9d1a205753 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:39.927263 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308b313-3dca-4d89-8f61-7c9d1a205753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:39.968896 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-0308b313-3dca-4d89-8f61-7c9d1a205753 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:39.971041 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-0308b313-3dca-4d89-8f61-7c9d1a205753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:40.086237 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 120/236] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:40.452400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5ef77-0ef9-47b0-baea-df9e3eb4d219 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:40.452929 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5ef77-0ef9-47b0-baea-df9e3eb4d219 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:40.453365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5ef77-0ef9-47b0-baea-df9e3eb4d219 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:40.456602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 117/237] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:40.463196 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0620e23-1d8a-4ca6-a7c5-5c2a0f5d020e None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:40.463513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0620e23-1d8a-4ca6-a7c5-5c2a0f5d020e None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:40.463981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0620e23-1d8a-4ca6-a7c5-5c2a0f5d020e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:40.467706 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06a77-687e-4ab4-9747-5ef26f169737 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:40.468203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06a77-687e-4ab4-9747-5ef26f169737 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:40.468646 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06a77-687e-4ab4-9747-5ef26f169737 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:40.472933 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 118/238] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:40.477867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca25d8-33a2-4021-b54d-51cd73cf670d None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:40.478360 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca25d8-33a2-4021-b54d-51cd73cf670d None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:40.479090 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca25d8-33a2-4021-b54d-51cd73cf670d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:40.519901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-bdca25d8-33a2-4021-b54d-51cd73cf670d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:40.520601 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-e0620e23-1d8a-4ca6-a7c5-5c2a0f5d020e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:40.521131 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-bdca25d8-33a2-4021-b54d-51cd73cf670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:40.522522 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e0620e23-1d8a-4ca6-a7c5-5c2a0f5d020e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:40.622535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 119/239] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:40.624589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca25d8-33a2-4021-b54d-51cd73cf670d None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:40.736640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 121/240] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:40.775165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7c13c-4da7-43a1-939c-dae39aa82f5a None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:40.775675 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7c13c-4da7-43a1-939c-dae39aa82f5a None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:40.776155 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7c13c-4da7-43a1-939c-dae39aa82f5a None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:40.778758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 122/241] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:27:40.785677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de89b12-334d-4428-9ae2-9ac374b8321c None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:40.786157 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de89b12-334d-4428-9ae2-9ac374b8321c None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:40.786816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de89b12-334d-4428-9ae2-9ac374b8321c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:40.845771 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-1de89b12-334d-4428-9ae2-9ac374b8321c None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:40.848087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1de89b12-334d-4428-9ae2-9ac374b8321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:40.897846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:40.945746 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:40.950522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca25d8-33a2-4021-b54d-51cd73cf670d None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:41.030753 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc6849-070c-4ab2-979e-ac553139f7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:41.031920 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc6849-070c-4ab2-979e-ac553139f7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:41.032419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc6849-070c-4ab2-979e-ac553139f7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:41.032912 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc6849-070c-4ab2-979e-ac553139f7c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:41.036599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 123/242] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:27:41.037971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de89b12-334d-4428-9ae2-9ac374b8321c None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:41.054861 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc6849-070c-4ab2-979e-ac553139f7c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:41.065558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-e6fc6849-070c-4ab2-979e-ac553139f7c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:27:41.065558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:41.065558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:41.065558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:41.065558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:41.065558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:41.065558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:41.065558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:41.065558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:41.065558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:41.065558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:41.065558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:41.065558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:41.065558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:41.065558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:41.065558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:41.066596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:41.066596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:41.066596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:41.066596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:41.066596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:41.066596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:41.066596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:41.066596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:41.066596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:41.066596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:41.066596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:41.066596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:41.066596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:41.066596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:41.066596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:41.066596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:41.068204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:41.068204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:41.068204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:41.068204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:41.068204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:41.068204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:41.068204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:41.068204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:41.068204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:41.068204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:41.068204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:27:41.068204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:41.068204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 120/243] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:27:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:41.077302 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc6849-070c-4ab2-979e-ac553139f7c8 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:41.167833 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de89b12-334d-4428-9ae2-9ac374b8321c None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:41.210742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c077c-fbd8-4ea0-a5bc-86d76fad95c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:41.211853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c077c-fbd8-4ea0-a5bc-86d76fad95c9 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:41.212295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c077c-fbd8-4ea0-a5bc-86d76fad95c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:41.212726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c077c-fbd8-4ea0-a5bc-86d76fad95c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:41.214098 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c077c-fbd8-4ea0-a5bc-86d76fad95c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:41.215842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c077c-fbd8-4ea0-a5bc-86d76fad95c9 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:41.218546 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 124/244] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:27:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:41.224114 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c077c-fbd8-4ea0-a5bc-86d76fad95c9 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:41.265947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:41.284219 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc6849-070c-4ab2-979e-ac553139f7c8 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:41.345208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c077c-fbd8-4ea0-a5bc-86d76fad95c9 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:41.367669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83581a80-9264-4df4-9733-b16a84639fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:41.369235 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83581a80-9264-4df4-9733-b16a84639fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:41.369713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83581a80-9264-4df4-9733-b16a84639fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:41.370210 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83581a80-9264-4df4-9733-b16a84639fb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:41.371421 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83581a80-9264-4df4-9733-b16a84639fb5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:41.371973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83581a80-9264-4df4-9733-b16a84639fb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:41.374841 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83581a80-9264-4df4-9733-b16a84639fb5 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:41.377800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:41.389597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 121/245] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:27:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:41.390813 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83581a80-9264-4df4-9733-b16a84639fb5 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:41.421965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1f2b2-9b8d-44cc-936f-9ea85dc559e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:41.423051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f2b2-9b8d-44cc-936f-9ea85dc559e3 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:41.423560 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f2b2-9b8d-44cc-936f-9ea85dc559e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:41.424043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f2b2-9b8d-44cc-936f-9ea85dc559e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:41.446632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1f2b2-9b8d-44cc-936f-9ea85dc559e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:41.457336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-22f1f2b2-9b8d-44cc-936f-9ea85dc559e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:27:41.457336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:41.457336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:41.457336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:41.457336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:41.457336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:41.457336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:41.457336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:41.457336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:41.457336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:41.457336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:41.457336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:41.457336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:41.457336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:41.457336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:41.457336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:41.458444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:41.458444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:41.458444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:41.458444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:41.458444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:41.458444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:41.458444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:41.458444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:41.458444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:41.458444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:41.458444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:41.458444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:41.458444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:41.458444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:41.458444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:41.458444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:41.459331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:41.459331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:41.459331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:41.459331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:41.459331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:41.459331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:41.459331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:41.459331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:41.459331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:41.459331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:41.459331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:27:41.459331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:27:41.460011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 125/246] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:41.466037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1f2b2-9b8d-44cc-936f-9ea85dc559e3 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:41.593240 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83581a80-9264-4df4-9733-b16a84639fb5 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:41.604293 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:41.625419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1f2b2-9b8d-44cc-936f-9ea85dc559e3 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:41.668829 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d66ee3-c701-43ec-aaea-d32828d5f14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:41.669737 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d66ee3-c701-43ec-aaea-d32828d5f14c None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:41.671275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d66ee3-c701-43ec-aaea-d32828d5f14c None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:41.671275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d66ee3-c701-43ec-aaea-d32828d5f14c None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:41.672394 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d66ee3-c701-43ec-aaea-d32828d5f14c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:41.674061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d66ee3-c701-43ec-aaea-d32828d5f14c None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:41.698717 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e03979-6848-482f-b036-1f47c427bb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:41.703664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e03979-6848-482f-b036-1f47c427bb99 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:41.703664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e03979-6848-482f-b036-1f47c427bb99 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:41.703664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e03979-6848-482f-b036-1f47c427bb99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:41.719689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e03979-6848-482f-b036-1f47c427bb99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:41.729697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-89e03979-6848-482f-b036-1f47c427bb99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:27:41.729697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:41.729697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:41.729697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:41.729697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:41.729697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:41.729697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:41.729697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:41.729697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:41.729697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:41.729697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:41.729697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:41.729697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:41.729697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:41.729697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:41.729697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:41.730828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:41.730828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:41.730828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:41.730828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:41.730828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:41.730828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:41.730828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:41.730828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:41.730828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:41.730828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:41.730828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:41.730828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:41.730828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:41.730828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:41.730828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:41.730828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:41.733022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:41.733022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:41.733022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:41.733022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:41.733022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:41.733022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:41.733022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:41.733022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:41.733022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:41.733022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:41.733022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:27:41.733022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:27:41.733022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 126/247] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:27:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:41.739035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e03979-6848-482f-b036-1f47c427bb99 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:41.794454 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 122/248] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:27:41 2022] POST /identity/v3/users => generated 293 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:27:41.801429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d66ee3-c701-43ec-aaea-d32828d5f14c None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:41.934318 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e03979-6848-482f-b036-1f47c427bb99 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:41.946816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:42.015078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b624c-9675-4e4c-a1cf-9dd038b4125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:42.017704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b624c-9675-4e4c-a1cf-9dd038b4125f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:42.018553 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b624c-9675-4e4c-a1cf-9dd038b4125f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:42.019160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b624c-9675-4e4c-a1cf-9dd038b4125f None admin] PATH_INFO: `/v3/users/ea1bd8966fae4369ab6a4b491a8fc008` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:42.022223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b624c-9675-4e4c-a1cf-9dd038b4125f None admin] RBAC: Authorizing `identity:get_user(user_id=ea1bd8966fae4369ab6a4b491a8fc008)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:42.025954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b624c-9675-4e4c-a1cf-9dd038b4125f None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:42.031062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 127/249] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:41 2022] GET /identity/v3/users/ea1bd8966fae4369ab6a4b491a8fc008 => generated 283 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:42.033765 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b624c-9675-4e4c-a1cf-9dd038b4125f None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:42.038990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d66ee3-c701-43ec-aaea-d32828d5f14c None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:42.062689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:42.105086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc67ccf-350f-4b31-a576-474c6668abe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:42.105737 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc67ccf-350f-4b31-a576-474c6668abe6 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:42.106018 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc67ccf-350f-4b31-a576-474c6668abe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:42.106291 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc67ccf-350f-4b31-a576-474c6668abe6 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:42.108488 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc67ccf-350f-4b31-a576-474c6668abe6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:42.108488 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc67ccf-350f-4b31-a576-474c6668abe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:42.109064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc67ccf-350f-4b31-a576-474c6668abe6 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:42.121700 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 123/250] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:42.123452 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc67ccf-350f-4b31-a576-474c6668abe6 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:42.208072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b624c-9675-4e4c-a1cf-9dd038b4125f None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:42.260288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa5f31-92ce-477b-82f7-8d462c147c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:42.260931 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa5f31-92ce-477b-82f7-8d462c147c41 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:42.261204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa5f31-92ce-477b-82f7-8d462c147c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:42.261470 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa5f31-92ce-477b-82f7-8d462c147c41 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:42.262172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa5f31-92ce-477b-82f7-8d462c147c41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:42.262471 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa5f31-92ce-477b-82f7-8d462c147c41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:42.264041 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa5f31-92ce-477b-82f7-8d462c147c41 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:42.274432 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 128/251] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:42.275917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f1111-b489-46e0-94ba-0ba21f0972ad None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:42.276188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f1111-b489-46e0-94ba-0ba21f0972ad None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:42.276465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f1111-b489-46e0-94ba-0ba21f0972ad None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:42.278078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 129/252] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:42.278589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f1111-b489-46e0-94ba-0ba21f0972ad None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:42.291590 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc67ccf-350f-4b31-a576-474c6668abe6 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:42.314223 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:42.351180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13af07c-470b-4f77-8622-55e8e4ba0531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:42.352302 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13af07c-470b-4f77-8622-55e8e4ba0531 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:42.353018 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13af07c-470b-4f77-8622-55e8e4ba0531 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:42.353479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13af07c-470b-4f77-8622-55e8e4ba0531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:42.454556 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:42.466264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13af07c-470b-4f77-8622-55e8e4ba0531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:42.470885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13af07c-470b-4f77-8622-55e8e4ba0531 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:42.481795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f1111-b489-46e0-94ba-0ba21f0972ad None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:42.525069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e5e54-0dd4-4aa7-9c7b-26a1dc9462a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:42.526096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e5e54-0dd4-4aa7-9c7b-26a1dc9462a9 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:42.526583 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e5e54-0dd4-4aa7-9c7b-26a1dc9462a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:42.527060 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e5e54-0dd4-4aa7-9c7b-26a1dc9462a9 None admin] PATH_INFO: `/v3/users/5661128f3fb6465ba3c05124b1f73c43` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:42.544479 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e5e54-0dd4-4aa7-9c7b-26a1dc9462a9 None admin] RBAC: Authorizing `identity:get_user(user_id=5661128f3fb6465ba3c05124b1f73c43)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:42.546992 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e5e54-0dd4-4aa7-9c7b-26a1dc9462a9 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:42.549446 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 130/253] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:42 2022] GET /identity/v3/users/5661128f3fb6465ba3c05124b1f73c43 => generated 297 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:42.550529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e5e54-0dd4-4aa7-9c7b-26a1dc9462a9 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:42.643467 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 124/254] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:27:42.645387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f9a9-3e31-41e2-9bf3-4449c51adc45 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:42.645677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f9a9-3e31-41e2-9bf3-4449c51adc45 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:42.645950 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f9a9-3e31-41e2-9bf3-4449c51adc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:42.668898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-a316f9a9-3e31-41e2-9bf3-4449c51adc45 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:42.671006 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a316f9a9-3e31-41e2-9bf3-4449c51adc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:42.680291 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e5e54-0dd4-4aa7-9c7b-26a1dc9462a9 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:42.686096 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:42.731249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfde9c-c480-4fa8-b78a-ed5a0ae0cd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:42.731836 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfde9c-c480-4fa8-b78a-ed5a0ae0cd61 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:42.732114 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfde9c-c480-4fa8-b78a-ed5a0ae0cd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:42.732958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfde9c-c480-4fa8-b78a-ed5a0ae0cd61 None admin] PATH_INFO: `/v3/users/ea1bd8966fae4369ab6a4b491a8fc008` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:42.734785 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfde9c-c480-4fa8-b78a-ed5a0ae0cd61 None admin] RBAC: Authorizing `identity:get_user(user_id=ea1bd8966fae4369ab6a4b491a8fc008)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:42.736685 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfde9c-c480-4fa8-b78a-ed5a0ae0cd61 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:42.739224 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 131/255] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:42 2022] GET /identity/v3/users/ea1bd8966fae4369ab6a4b491a8fc008 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:42.740102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfde9c-c480-4fa8-b78a-ed5a0ae0cd61 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:42.754863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:42.771465 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 125/256] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:42.773020 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316f9a9-3e31-41e2-9bf3-4449c51adc45 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:42.882759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfde9c-c480-4fa8-b78a-ed5a0ae0cd61 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:42.928998 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7e3b1-062e-4390-a7ca-3a2044d37a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:42.929617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7e3b1-062e-4390-a7ca-3a2044d37a77 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:42.929887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7e3b1-062e-4390-a7ca-3a2044d37a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:42.930160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7e3b1-062e-4390-a7ca-3a2044d37a77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:43.018965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316f9a9-3e31-41e2-9bf3-4449c51adc45 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:43.020215 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7e3b1-062e-4390-a7ca-3a2044d37a77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:43.022001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7e3b1-062e-4390-a7ca-3a2044d37a77 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:43.047888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:43.130085 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ec475-445c-4e7b-9f9d-c84aa33bee71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:43.131195 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ec475-445c-4e7b-9f9d-c84aa33bee71 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:43.131724 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ec475-445c-4e7b-9f9d-c84aa33bee71 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:43.132198 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ec475-445c-4e7b-9f9d-c84aa33bee71 None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:43.135111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ec475-445c-4e7b-9f9d-c84aa33bee71 None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:43.137896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ec475-445c-4e7b-9f9d-c84aa33bee71 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:43.141801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 126/257] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:42 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:43.151377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ec475-445c-4e7b-9f9d-c84aa33bee71 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:43.214529 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:43.245783 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 132/258] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:27:43.246476 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7e3b1-062e-4390-a7ca-3a2044d37a77 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:43.322752 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ec475-445c-4e7b-9f9d-c84aa33bee71 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:43.359687 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7e3b1-062e-4390-a7ca-3a2044d37a77 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:43.364287 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7ca40-619b-47b9-963d-0e1f7daea625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:43.364925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7ca40-619b-47b9-963d-0e1f7daea625 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:43.365191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7ca40-619b-47b9-963d-0e1f7daea625 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:43.365463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7ca40-619b-47b9-963d-0e1f7daea625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:43.368046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:43.398391 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db980f31-4e71-46f1-a779-b60f63f509e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:43.399259 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db980f31-4e71-46f1-a779-b60f63f509e6 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:43.399710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db980f31-4e71-46f1-a779-b60f63f509e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:43.400125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db980f31-4e71-46f1-a779-b60f63f509e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:43.400995 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db980f31-4e71-46f1-a779-b60f63f509e6 None admin] RBAC: Adding query filter params (role.id=e35c45d51df34051b68fa49475ac7250, scope.project.id=d636caf99d654f54ada4912b086ad3c6, user.id=ea1bd8966fae4369ab6a4b491a8fc008) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:43.401478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db980f31-4e71-46f1-a779-b60f63f509e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:43.403067 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db980f31-4e71-46f1-a779-b60f63f509e6 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:43.410487 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 133/259] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:43 2022] GET /identity/v3/role_assignments?user.id=ea1bd8966fae4369ab6a4b491a8fc008&scope.project.id=d636caf99d654f54ada4912b086ad3c6&role.id=e35c45d51df34051b68fa49475ac7250 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:43.420712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db980f31-4e71-46f1-a779-b60f63f509e6 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:43.445860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7ca40-619b-47b9-963d-0e1f7daea625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:43.447354 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7ca40-619b-47b9-963d-0e1f7daea625 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:43.480978 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:43.546286 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db980f31-4e71-46f1-a779-b60f63f509e6 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:43.591203 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c6d35-ddf4-4abd-9953-ef5cd6fdf8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:43.592505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c6d35-ddf4-4abd-9953-ef5cd6fdf8fd None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:43.592958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c6d35-ddf4-4abd-9953-ef5cd6fdf8fd None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:43.593379 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c6d35-ddf4-4abd-9953-ef5cd6fdf8fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:43.614179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c6d35-ddf4-4abd-9953-ef5cd6fdf8fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:43.619505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-0e7c6d35-ddf4-4abd-9953-ef5cd6fdf8fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:43.619505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:43.619505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:43.619505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:43.619505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:43.619505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:43.619505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:43.619505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:43.619505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:43.619505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:43.619505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:43.619505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:43.619505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:43.619505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:43.619505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:43.619505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:43.620636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:43.620636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:43.620636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:43.620636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:43.620636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:43.620636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:43.620636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:43.620636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:43.620636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:43.620636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:43.620636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:43.620636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:43.620636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:43.620636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:43.620636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:43.620636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:43.621588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:43.621588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:43.621588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:43.621588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:43.621588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:43.621588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:43.621588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:43.621588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:43.621588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:43.621588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:43.621588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:43.621588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:27:43.625569 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 134/260] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:43.626903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c6d35-ddf4-4abd-9953-ef5cd6fdf8fd None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:43.674926 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 127/261] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:27:43.675869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7ca40-619b-47b9-963d-0e1f7daea625 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:43.700005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:43.804537 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c6d35-ddf4-4abd-9953-ef5cd6fdf8fd None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:43.835635 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7ca40-619b-47b9-963d-0e1f7daea625 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:43.853159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:43.864758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66620f-dad4-45c9-aaa4-0006980408de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:43.865866 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66620f-dad4-45c9-aaa4-0006980408de None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:43.866049 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66620f-dad4-45c9-aaa4-0006980408de None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:43.866389 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66620f-dad4-45c9-aaa4-0006980408de None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:43.868200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66620f-dad4-45c9-aaa4-0006980408de None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:43.870153 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66620f-dad4-45c9-aaa4-0006980408de None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:43.872811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 135/262] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:43 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:43.874210 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66620f-dad4-45c9-aaa4-0006980408de None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:43.879570 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e510da-a6f4-47d4-ba01-46b532a0cd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:43.880203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e510da-a6f4-47d4-ba01-46b532a0cd2e None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:43.880476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e510da-a6f4-47d4-ba01-46b532a0cd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:43.880744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e510da-a6f4-47d4-ba01-46b532a0cd2e None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:43.881421 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e510da-a6f4-47d4-ba01-46b532a0cd2e None admin] RBAC: Adding query filter params (name=member) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:43.881721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e510da-a6f4-47d4-ba01-46b532a0cd2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:43.883127 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e510da-a6f4-47d4-ba01-46b532a0cd2e None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:43.893138 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 128/263] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:43.893999 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e510da-a6f4-47d4-ba01-46b532a0cd2e None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:44.023511 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:44.024729 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e510da-a6f4-47d4-ba01-46b532a0cd2e None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:44.027731 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66620f-dad4-45c9-aaa4-0006980408de None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:44.063662 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782f5b6-6bc5-44ce-8dda-f98c8802beb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:44.064286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782f5b6-6bc5-44ce-8dda-f98c8802beb4 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:44.064565 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782f5b6-6bc5-44ce-8dda-f98c8802beb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:44.064835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782f5b6-6bc5-44ce-8dda-f98c8802beb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:44.065738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782f5b6-6bc5-44ce-8dda-f98c8802beb4 None admin] RBAC: Adding query filter params (role.id=be4da00ddeb847968d5fdd6a8dd9de0a, scope.project.id=d636caf99d654f54ada4912b086ad3c6, user.id=5661128f3fb6465ba3c05124b1f73c43) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:44.066148 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782f5b6-6bc5-44ce-8dda-f98c8802beb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:44.067301 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dc591-76cf-4c61-83a4-9cbb3a1f8468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:44.067638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782f5b6-6bc5-44ce-8dda-f98c8802beb4 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:44.068302 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dc591-76cf-4c61-83a4-9cbb3a1f8468 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:44.068717 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dc591-76cf-4c61-83a4-9cbb3a1f8468 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:44.069122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dc591-76cf-4c61-83a4-9cbb3a1f8468 None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:44.070532 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1dc591-76cf-4c61-83a4-9cbb3a1f8468 None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:44.072204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1dc591-76cf-4c61-83a4-9cbb3a1f8468 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:44.073870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 129/264] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:43 2022] GET /identity/v3/role_assignments?user.id=5661128f3fb6465ba3c05124b1f73c43&scope.project.id=d636caf99d654f54ada4912b086ad3c6&role.id=be4da00ddeb847968d5fdd6a8dd9de0a => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:44.074512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782f5b6-6bc5-44ce-8dda-f98c8802beb4 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:44.074770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 136/265] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:43 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:44.093230 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dc591-76cf-4c61-83a4-9cbb3a1f8468 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:44.125301 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:44.204247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782f5b6-6bc5-44ce-8dda-f98c8802beb4 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:44.250759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad7b2c-6f2a-4f19-b713-2e80abc747dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:44.251732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad7b2c-6f2a-4f19-b713-2e80abc747dd None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:44.252017 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad7b2c-6f2a-4f19-b713-2e80abc747dd None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:44.252286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad7b2c-6f2a-4f19-b713-2e80abc747dd None admin] PATH_INFO: `/v3/users/c6461bc84cdb49c2ab83fd09ecc9d424` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:44.258476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad7b2c-6f2a-4f19-b713-2e80abc747dd None admin] RBAC: Authorizing `identity:get_user(user_id=c6461bc84cdb49c2ab83fd09ecc9d424)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:44.260247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad7b2c-6f2a-4f19-b713-2e80abc747dd None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:44.262779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 130/266] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:44 2022] GET /identity/v3/users/c6461bc84cdb49c2ab83fd09ecc9d424 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:44.271522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad7b2c-6f2a-4f19-b713-2e80abc747dd None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:44.331344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dc591-76cf-4c61-83a4-9cbb3a1f8468 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:44.412269 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2503fe-527c-4ede-8d29-2224dc6d5bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:44.412816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2503fe-527c-4ede-8d29-2224dc6d5bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:44.413095 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2503fe-527c-4ede-8d29-2224dc6d5bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:44.413408 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2503fe-527c-4ede-8d29-2224dc6d5bb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:44.414146 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2503fe-527c-4ede-8d29-2224dc6d5bb7 None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=d636caf99d654f54ada4912b086ad3c6, user.id=ea1bd8966fae4369ab6a4b491a8fc008) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:44.414456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2503fe-527c-4ede-8d29-2224dc6d5bb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:44.417653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2503fe-527c-4ede-8d29-2224dc6d5bb7 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:44.431504 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 137/267] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:44 2022] GET /identity/v3/role_assignments?user.id=ea1bd8966fae4369ab6a4b491a8fc008&scope.project.id=d636caf99d654f54ada4912b086ad3c6&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 608 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:44.488289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad7b2c-6f2a-4f19-b713-2e80abc747dd None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:44.501880 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:44.537569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f0483-ce07-4cdb-a98e-5ef0a3f9983b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:44.538239 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f0483-ce07-4cdb-a98e-5ef0a3f9983b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:44.538519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f0483-ce07-4cdb-a98e-5ef0a3f9983b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:44.538793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f0483-ce07-4cdb-a98e-5ef0a3f9983b None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:44.540121 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f0483-ce07-4cdb-a98e-5ef0a3f9983b None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:44.541661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f0483-ce07-4cdb-a98e-5ef0a3f9983b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:44.543871 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 131/268] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:44 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:44.552880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2503fe-527c-4ede-8d29-2224dc6d5bb7 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:44.599889 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:44.693181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2503fe-527c-4ede-8d29-2224dc6d5bb7 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:44.746370 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ec513-eed8-43e4-9415-0c8c099b52bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:44.747134 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ec513-eed8-43e4-9415-0c8c099b52bd None admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:44.747419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ec513-eed8-43e4-9415-0c8c099b52bd None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:44.747944 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ec513-eed8-43e4-9415-0c8c099b52bd None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6/users/c6461bc84cdb49c2ab83fd09ecc9d424/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:44.750465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ec513-eed8-43e4-9415-0c8c099b52bd None admin] RBAC: Authorizing `identity:create_grant(project_id=d636caf99d654f54ada4912b086ad3c6, user_id=c6461bc84cdb49c2ab83fd09ecc9d424, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:44.751959 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ec513-eed8-43e4-9415-0c8c099b52bd None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:44.838184 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 138/269] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:27:44 2022] PUT /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6/users/c6461bc84cdb49c2ab83fd09ecc9d424/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:27:44.984488 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd2c3-1821-4976-bf7a-920e21e7c5b9 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:44.984670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd2c3-1821-4976-bf7a-920e21e7c5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:44.984958 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd2c3-1821-4976-bf7a-920e21e7c5b9 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:44.986407 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 132/270] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:27:44.992738 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ce301-7f80-48dc-b4be-69545b86462a None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:44.993071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ce301-7f80-48dc-b4be-69545b86462a None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:44.993296 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ce301-7f80-48dc-b4be-69545b86462a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:45.016290 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-ea4ce301-7f80-48dc-b4be-69545b86462a None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:45.017669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ea4ce301-7f80-48dc-b4be-69545b86462a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:45.116648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 139/271] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:45.385710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcd2c3-1821-4976-bf7a-920e21e7c5b9 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:45.500458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcd2c3-1821-4976-bf7a-920e21e7c5b9 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:45.513102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37848e62-ab52-48ec-a70f-cdb7bf114fcf None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:45.514022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37848e62-ab52-48ec-a70f-cdb7bf114fcf None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:45.514925 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37848e62-ab52-48ec-a70f-cdb7bf114fcf None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:45.516314 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 140/272] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:45.530020 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b843ef-13c8-4f88-a618-3736d350dd14 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:45.530477 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b843ef-13c8-4f88-a618-3736d350dd14 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:45.530957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b843ef-13c8-4f88-a618-3736d350dd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:45.544975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5338b7c-d1cb-40c1-9a39-d55ec88e8d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:45.546198 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5338b7c-d1cb-40c1-9a39-d55ec88e8d96 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:45.546678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5338b7c-d1cb-40c1-9a39-d55ec88e8d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:45.547169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5338b7c-d1cb-40c1-9a39-d55ec88e8d96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:45.548698 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5338b7c-d1cb-40c1-9a39-d55ec88e8d96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:45.550410 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5338b7c-d1cb-40c1-9a39-d55ec88e8d96 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:45.552646 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 133/273] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:27:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:45.561233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-02b843ef-13c8-4f88-a618-3736d350dd14 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:45.562434 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5338b7c-d1cb-40c1-9a39-d55ec88e8d96 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:45.563371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-02b843ef-13c8-4f88-a618-3736d350dd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:45.591950 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:45.625665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:45.705213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5338b7c-d1cb-40c1-9a39-d55ec88e8d96 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:45.733953 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 141/274] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:45.766820 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbdb6a-0662-4e61-9967-db4973127be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:45.767879 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbdb6a-0662-4e61-9967-db4973127be2 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:45.768371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbdb6a-0662-4e61-9967-db4973127be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:45.768858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbdb6a-0662-4e61-9967-db4973127be2 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:45.770073 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbdb6a-0662-4e61-9967-db4973127be2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:45.773020 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbdb6a-0662-4e61-9967-db4973127be2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:45.866326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 134/275] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:27:45 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:27:46.025447 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b843ef-13c8-4f88-a618-3736d350dd14 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:46.227283 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b843ef-13c8-4f88-a618-3736d350dd14 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:46.284587 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3117b4-8bab-4a15-a6f7-f4a85495f1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:46.285716 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3117b4-8bab-4a15-a6f7-f4a85495f1da None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:46.286208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3117b4-8bab-4a15-a6f7-f4a85495f1da None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:46.286682 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3117b4-8bab-4a15-a6f7-f4a85495f1da None admin] PATH_INFO: `/v3/roles/member` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:46.304237 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3117b4-8bab-4a15-a6f7-f4a85495f1da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:46.309781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-af3117b4-8bab-4a15-a6f7-f4a85495f1da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:46.309781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:46.309781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:46.309781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:46.309781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:46.309781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:46.309781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:46.309781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:46.309781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:46.309781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:46.309781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:46.309781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:46.309781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:46.309781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:46.309781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:46.309781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:46.311443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:46.311443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:46.311443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:46.311443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:46.311443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:46.311443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:46.311443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:46.311443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:46.311443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:46.311443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:46.311443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:46.311443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:46.311443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:46.311443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:46.311443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:46.311443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:46.312342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:46.312342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:46.312342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:46.312342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:46.312342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:46.312342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:46.312342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:46.312342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:46.312342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:46.312342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:46.312342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:46.312342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:27:46.315590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 142/276] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:46.321288 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbdb6a-0662-4e61-9967-db4973127be2 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:46.482475 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:46.488400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbdb6a-0662-4e61-9967-db4973127be2 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:46.538021 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13191e32-ec7f-4e60-ac01-5c4c16f21a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:46.538952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13191e32-ec7f-4e60-ac01-5c4c16f21a5a None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:46.539391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13191e32-ec7f-4e60-ac01-5c4c16f21a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:46.539859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13191e32-ec7f-4e60-ac01-5c4c16f21a5a None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:46.540759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13191e32-ec7f-4e60-ac01-5c4c16f21a5a None admin] RBAC: Adding query filter params (name=member) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:46.541241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13191e32-ec7f-4e60-ac01-5c4c16f21a5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:46.542874 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13191e32-ec7f-4e60-ac01-5c4c16f21a5a None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:46.554289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 135/277] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:46.559999 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3117b4-8bab-4a15-a6f7-f4a85495f1da None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:46.581383 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:46.666219 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b3f1d-5506-4186-b85e-1a86a80dcc75 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:46.666837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b3f1d-5506-4186-b85e-1a86a80dcc75 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:46.667375 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b3f1d-5506-4186-b85e-1a86a80dcc75 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:46.669279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 136/278] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:27:46.675345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e7bbc-08d5-4bff-86a9-d9bc00a97a18 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:46.676107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e7bbc-08d5-4bff-86a9-d9bc00a97a18 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:46.676579 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e7bbc-08d5-4bff-86a9-d9bc00a97a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:46.704369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3117b4-8bab-4a15-a6f7-f4a85495f1da None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:46.711371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-774e7bbc-08d5-4bff-86a9-d9bc00a97a18 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:46.713075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-774e7bbc-08d5-4bff-86a9-d9bc00a97a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:46.746652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877396b-aa99-4566-93a7-0281e4a284fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:46.747304 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877396b-aa99-4566-93a7-0281e4a284fb None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:46.748333 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877396b-aa99-4566-93a7-0281e4a284fb None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:46.748620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877396b-aa99-4566-93a7-0281e4a284fb None admin] PATH_INFO: `/v3/users/8e6d1dbfe98f46b4ada67bd70f0e0188` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:46.764952 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877396b-aa99-4566-93a7-0281e4a284fb None admin] RBAC: Authorizing `identity:get_user(user_id=8e6d1dbfe98f46b4ada67bd70f0e0188)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:46.766030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877396b-aa99-4566-93a7-0281e4a284fb None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:46.768214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 143/279] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:46 2022] GET /identity/v3/users/8e6d1dbfe98f46b4ada67bd70f0e0188 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:46.778012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877396b-aa99-4566-93a7-0281e4a284fb None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:46.846840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 137/280] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:46.862217 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:46.906007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877396b-aa99-4566-93a7-0281e4a284fb None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:46.948249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb0a90-afa6-42bc-9105-d9322e4891b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:46.949170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb0a90-afa6-42bc-9105-d9322e4891b4 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:46.949620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb0a90-afa6-42bc-9105-d9322e4891b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:46.950148 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb0a90-afa6-42bc-9105-d9322e4891b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:46.951929 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb0a90-afa6-42bc-9105-d9322e4891b4 None admin] RBAC: Adding query filter params (role.id=b9c5d282a37c489e83eabbdd2b393dbf, user.id=8e6d1dbfe98f46b4ada67bd70f0e0188, scope.system=all) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:46.952490 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb0a90-afa6-42bc-9105-d9322e4891b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:46.954103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb0a90-afa6-42bc-9105-d9322e4891b4 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:46.960686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 144/281] 10.222.0.25 () {56 vars in 1308 bytes} [Wed Sep 7 16:27:46 2022] GET /identity/v3/role_assignments?user.id=8e6d1dbfe98f46b4ada67bd70f0e0188&scope.system=all&role.id=b9c5d282a37c489e83eabbdd2b393dbf => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:47.169062 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e7bbc-08d5-4bff-86a9-d9bc00a97a18 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:47.384582 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:47.407678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e7bbc-08d5-4bff-86a9-d9bc00a97a18 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:47.476768 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef083be-c637-4eb8-9350-1e75252198e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:47.477801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef083be-c637-4eb8-9350-1e75252198e1 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:47.478537 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef083be-c637-4eb8-9350-1e75252198e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:47.478927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef083be-c637-4eb8-9350-1e75252198e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:47.505316 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef083be-c637-4eb8-9350-1e75252198e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:47.515440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-cef083be-c637-4eb8-9350-1e75252198e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:27:47.515440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:47.515440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:47.515440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:47.515440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:47.515440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:47.515440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:47.515440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:47.515440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:47.515440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:47.515440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:47.515440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:47.515440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:47.515440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:47.515440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:47.515440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:47.516458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:47.516458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:47.516458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:47.516458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:47.516458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:47.516458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:47.516458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:47.516458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:47.516458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:47.516458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:47.516458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:47.516458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:47.516458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:47.516458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:47.516458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:47.516458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:47.517245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:47.517245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:47.517245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:47.517245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:47.517245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:47.517245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:47.517245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:47.517245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:47.517245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:47.517245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:47.517245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:27:47.517245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:47.518474 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 138/282] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:47.523658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb0a90-afa6-42bc-9105-d9322e4891b4 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:47.544618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583a13b-06c0-45f8-90e7-858c1324ee69 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:47.545107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583a13b-06c0-45f8-90e7-858c1324ee69 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:47.546088 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583a13b-06c0-45f8-90e7-858c1324ee69 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:47.548045 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 139/283] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:47.554610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04d75f-5e34-4565-87f3-7944976a4a60 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:47.555075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04d75f-5e34-4565-87f3-7944976a4a60 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:47.555611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04d75f-5e34-4565-87f3-7944976a4a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:47.604150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-2a04d75f-5e34-4565-87f3-7944976a4a60 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:47.608058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2a04d75f-5e34-4565-87f3-7944976a4a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:47.748096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb0a90-afa6-42bc-9105-d9322e4891b4 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:47.816466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 140/284] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:47.822774 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:47.836121 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88309e-3f0b-4528-8b30-c127bca3f8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:47.837307 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88309e-3f0b-4528-8b30-c127bca3f8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:47.837793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88309e-3f0b-4528-8b30-c127bca3f8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:47.838259 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88309e-3f0b-4528-8b30-c127bca3f8a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:47.839461 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88309e-3f0b-4528-8b30-c127bca3f8a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:47.844193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88309e-3f0b-4528-8b30-c127bca3f8a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:47.846853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88309e-3f0b-4528-8b30-c127bca3f8a2 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:47.875379 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 145/285] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:47.881606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04d75f-5e34-4565-87f3-7944976a4a60 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:48.064023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:48.093095 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04d75f-5e34-4565-87f3-7944976a4a60 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:48.145071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a80a05-f463-4b76-8389-284c7a6bf3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:48.145792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a80a05-f463-4b76-8389-284c7a6bf3fd None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:48.146150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a80a05-f463-4b76-8389-284c7a6bf3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:48.146423 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a80a05-f463-4b76-8389-284c7a6bf3fd None admin] PATH_INFO: `/v3/users/5661128f3fb6465ba3c05124b1f73c43` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:48.147975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a80a05-f463-4b76-8389-284c7a6bf3fd None admin] RBAC: Authorizing `identity:get_user(user_id=5661128f3fb6465ba3c05124b1f73c43)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:48.150326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a80a05-f463-4b76-8389-284c7a6bf3fd None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:48.152647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 141/286] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:47 2022] GET /identity/v3/users/5661128f3fb6465ba3c05124b1f73c43 => generated 297 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:48.159753 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88309e-3f0b-4528-8b30-c127bca3f8a2 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:48.189676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a80a05-f463-4b76-8389-284c7a6bf3fd None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:48.374382 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a80a05-f463-4b76-8389-284c7a6bf3fd None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:48.414676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88309e-3f0b-4528-8b30-c127bca3f8a2 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:48.418209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b64c9c-25ad-47f1-8ad7-b7f7a2d3e108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:48.419264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b64c9c-25ad-47f1-8ad7-b7f7a2d3e108 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:48.420354 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b64c9c-25ad-47f1-8ad7-b7f7a2d3e108 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:48.421257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b64c9c-25ad-47f1-8ad7-b7f7a2d3e108 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:48.457525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b64c9c-25ad-47f1-8ad7-b7f7a2d3e108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:48.469313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-e8b64c9c-25ad-47f1-8ad7-b7f7a2d3e108 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:48.469313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:48.469313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:48.469313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:48.469313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:48.469313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:48.469313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:48.469313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:48.469313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:48.469313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:48.469313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:48.469313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:48.469313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:48.469313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:48.469313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:48.469313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:48.470319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:48.470319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:48.470319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:48.470319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:48.470319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:48.470319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:48.470319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:48.470319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:48.470319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:48.470319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:48.470319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:48.470319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:48.470319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:48.470319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:48.470319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:48.470319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:48.471130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:48.471130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:48.471130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:48.471130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:48.471130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:48.471130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:48.471130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:48.471130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:48.471130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:48.471130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:48.471130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:48.471130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:48.472374 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 142/287] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:27:48.490559 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b64c9c-25ad-47f1-8ad7-b7f7a2d3e108 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:48.503528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:48.509010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952f322-42c4-47ed-8e86-9c1e59893370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:48.509763 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952f322-42c4-47ed-8e86-9c1e59893370 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:48.510051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952f322-42c4-47ed-8e86-9c1e59893370 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:48.510328 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952f322-42c4-47ed-8e86-9c1e59893370 None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:48.516418 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952f322-42c4-47ed-8e86-9c1e59893370 None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:48.517930 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952f322-42c4-47ed-8e86-9c1e59893370 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:48.529920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 146/288] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:48 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:48.529920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952f322-42c4-47ed-8e86-9c1e59893370 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:48.640289 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:48.640729 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b64c9c-25ad-47f1-8ad7-b7f7a2d3e108 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:48.693829 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730fe3a-51d4-4394-9503-0961d126b822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:48.694457 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730fe3a-51d4-4394-9503-0961d126b822 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:48.694734 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730fe3a-51d4-4394-9503-0961d126b822 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:48.695002 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730fe3a-51d4-4394-9503-0961d126b822 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:48.695720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730fe3a-51d4-4394-9503-0961d126b822 None admin] RBAC: Adding query filter params (name=member) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:48.696057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730fe3a-51d4-4394-9503-0961d126b822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:48.697628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730fe3a-51d4-4394-9503-0961d126b822 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:48.708783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 143/289] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:48.714792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730fe3a-51d4-4394-9503-0961d126b822 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:48.740855 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952f322-42c4-47ed-8e86-9c1e59893370 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:48.819213 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aa361-1f86-4bc0-91e2-c1e47419907f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:48.820379 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aa361-1f86-4bc0-91e2-c1e47419907f None admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:48.820864 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aa361-1f86-4bc0-91e2-c1e47419907f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:48.821332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aa361-1f86-4bc0-91e2-c1e47419907f None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6/users/5661128f3fb6465ba3c05124b1f73c43/roles/be4da00ddeb847968d5fdd6a8dd9de0a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:48.827152 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9aa361-1f86-4bc0-91e2-c1e47419907f None admin] RBAC: Authorizing `identity:create_grant(project_id=d636caf99d654f54ada4912b086ad3c6, user_id=5661128f3fb6465ba3c05124b1f73c43, role_id=be4da00ddeb847968d5fdd6a8dd9de0a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:48.833435 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9aa361-1f86-4bc0-91e2-c1e47419907f None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:48.897338 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:48.922805 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 147/290] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:27:48 2022] PUT /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6/users/5661128f3fb6465ba3c05124b1f73c43/roles/be4da00ddeb847968d5fdd6a8dd9de0a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:27:48.978139 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730fe3a-51d4-4394-9503-0961d126b822 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:49.051383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f5e56-3c78-4af3-9266-42f9eae2b3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:49.052102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f5e56-3c78-4af3-9266-42f9eae2b3cf None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:49.052380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f5e56-3c78-4af3-9266-42f9eae2b3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:49.052651 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f5e56-3c78-4af3-9266-42f9eae2b3cf None admin] PATH_INFO: `/v3/users/c6461bc84cdb49c2ab83fd09ecc9d424` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:49.053979 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f5e56-3c78-4af3-9266-42f9eae2b3cf None admin] RBAC: Authorizing `identity:get_user(user_id=c6461bc84cdb49c2ab83fd09ecc9d424)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:49.055591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f5e56-3c78-4af3-9266-42f9eae2b3cf None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:49.058339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 144/291] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:48 2022] GET /identity/v3/users/c6461bc84cdb49c2ab83fd09ecc9d424 => generated 297 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:49.065386 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aa361-1f86-4bc0-91e2-c1e47419907f None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:49.121119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097cafe-9971-4a0f-b869-d91b6fb3a820 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:49.121766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097cafe-9971-4a0f-b869-d91b6fb3a820 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:49.122274 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097cafe-9971-4a0f-b869-d91b6fb3a820 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:49.124520 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 145/292] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:49.148483 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e11cb0-f164-47f8-bc46-bcf556d6af67 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:49.151508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e11cb0-f164-47f8-bc46-bcf556d6af67 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:49.152021 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e11cb0-f164-47f8-bc46-bcf556d6af67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:49.193385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-60e11cb0-f164-47f8-bc46-bcf556d6af67 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:49.195922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-60e11cb0-f164-47f8-bc46-bcf556d6af67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:49.258004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aa361-1f86-4bc0-91e2-c1e47419907f None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:49.291296 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:49.305373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72280688-a5ca-4c12-912e-8044cb5e5f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:49.306003 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72280688-a5ca-4c12-912e-8044cb5e5f28 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:49.306280 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72280688-a5ca-4c12-912e-8044cb5e5f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:49.306557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72280688-a5ca-4c12-912e-8044cb5e5f28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:49.351234 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 146/293] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:27:49.354502 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b69f33-e863-4c36-8c9f-a124b7b7cb7e None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:49.354994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b69f33-e863-4c36-8c9f-a124b7b7cb7e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:49.355502 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b69f33-e863-4c36-8c9f-a124b7b7cb7e None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:49.366706 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 147/294] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:49 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:49.374176 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213a99a-5c3e-4f20-8179-59bfc83fe404 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:49.374667 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213a99a-5c3e-4f20-8179-59bfc83fe404 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:49.375237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213a99a-5c3e-4f20-8179-59bfc83fe404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:49.399557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72280688-a5ca-4c12-912e-8044cb5e5f28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:49.401032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72280688-a5ca-4c12-912e-8044cb5e5f28 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:49.446557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-3213a99a-5c3e-4f20-8179-59bfc83fe404 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:49.448621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3213a99a-5c3e-4f20-8179-59bfc83fe404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:49.531884 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 148/295] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 16:27:49.547571 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72280688-a5ca-4c12-912e-8044cb5e5f28 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:49.581861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:49.669285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:49.681654 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 148/296] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:49.724689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72280688-a5ca-4c12-912e-8044cb5e5f28 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:49.769499 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b3167-cc42-4159-a192-5bb6baf72462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:49.770161 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b3167-cc42-4159-a192-5bb6baf72462 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:49.770443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b3167-cc42-4159-a192-5bb6baf72462 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:49.770718 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b3167-cc42-4159-a192-5bb6baf72462 None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:49.771994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b3167-cc42-4159-a192-5bb6baf72462 None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:49.773737 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b3167-cc42-4159-a192-5bb6baf72462 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:49.775870 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 149/297] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:49 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:49.782620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213a99a-5c3e-4f20-8179-59bfc83fe404 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:49.944769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213a99a-5c3e-4f20-8179-59bfc83fe404 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:50.011339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d9540-692a-43c4-9c8c-d9c3d6b44ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:50.015279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d9540-692a-43c4-9c8c-d9c3d6b44ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:50.015984 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d9540-692a-43c4-9c8c-d9c3d6b44ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:50.016719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d9540-692a-43c4-9c8c-d9c3d6b44ae7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:50.019512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d9540-692a-43c4-9c8c-d9c3d6b44ae7 None admin] RBAC: Adding query filter params (role.id=b9c5d282a37c489e83eabbdd2b393dbf, scope.project.id=d636caf99d654f54ada4912b086ad3c6, user.id=c6461bc84cdb49c2ab83fd09ecc9d424) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:50.020054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d9540-692a-43c4-9c8c-d9c3d6b44ae7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:50.023033 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d9540-692a-43c4-9c8c-d9c3d6b44ae7 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:50.036225 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 149/298] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:49 2022] GET /identity/v3/role_assignments?user.id=c6461bc84cdb49c2ab83fd09ecc9d424&scope.project.id=d636caf99d654f54ada4912b086ad3c6&role.id=b9c5d282a37c489e83eabbdd2b393dbf => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:50.082505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b3167-cc42-4159-a192-5bb6baf72462 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:50.264344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:50.272262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27ecda-57dc-4258-9027-eca47fc3c8e7 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:50.272577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27ecda-57dc-4258-9027-eca47fc3c8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:50.272812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27ecda-57dc-4258-9027-eca47fc3c8e7 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:50.274994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 150/299] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:50.285487 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b3167-cc42-4159-a192-5bb6baf72462 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:50.288083 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391752ff-3336-4af5-9460-a00d19c5ecd7 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:50.288308 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391752ff-3336-4af5-9460-a00d19c5ecd7 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:50.288779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391752ff-3336-4af5-9460-a00d19c5ecd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:50.327963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-391752ff-3336-4af5-9460-a00d19c5ecd7 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:50.329578 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-391752ff-3336-4af5-9460-a00d19c5ecd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:50.365314 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aecbfb-5aba-484c-b368-156d74f69a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:50.366663 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecbfb-5aba-484c-b368-156d74f69a6f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:50.367158 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecbfb-5aba-484c-b368-156d74f69a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:50.368219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecbfb-5aba-484c-b368-156d74f69a6f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:50.395616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aecbfb-5aba-484c-b368-156d74f69a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:50.407951 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:50.408444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-16aecbfb-5aba-484c-b368-156d74f69a6f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:27:50.408444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:50.408444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:50.408444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:50.408444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:50.408444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:50.408444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:50.408444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:50.408444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:50.408444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:50.408444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:50.408444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:50.408444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:50.408444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:50.408444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:50.408444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:50.409341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:50.409341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:50.409341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:50.409341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:50.409341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:50.409341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:50.409341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:50.409341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:50.409341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:50.409341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:50.409341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:50.409341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:50.409341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:50.409341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:50.409341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:50.409341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:50.410159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:50.410159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:50.410159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:50.410159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:50.410159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:50.410159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:50.410159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:50.410159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:50.410159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:50.410159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:50.410159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:27:50.410159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:27:50.416152 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 150/300] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:50.416152 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aecbfb-5aba-484c-b368-156d74f69a6f None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:50.435591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 151/301] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:50.437400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391752ff-3336-4af5-9460-a00d19c5ecd7 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:50.587979 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aecbfb-5aba-484c-b368-156d74f69a6f None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:50.597054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391752ff-3336-4af5-9460-a00d19c5ecd7 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:50.643804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09764060-405f-490a-9de8-d2f6cadf63d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:50.644457 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09764060-405f-490a-9de8-d2f6cadf63d7 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:50.644729 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09764060-405f-490a-9de8-d2f6cadf63d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:50.644993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09764060-405f-490a-9de8-d2f6cadf63d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:50.646297 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09764060-405f-490a-9de8-d2f6cadf63d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:50.647765 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09764060-405f-490a-9de8-d2f6cadf63d7 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:50.649454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 151/302] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:27:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:50.655576 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09764060-405f-490a-9de8-d2f6cadf63d7 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:50.658031 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af2695-0006-4bd2-ba7c-e0bd1d1e0c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:50.660422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af2695-0006-4bd2-ba7c-e0bd1d1e0c5c None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:50.660676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af2695-0006-4bd2-ba7c-e0bd1d1e0c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:50.661211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af2695-0006-4bd2-ba7c-e0bd1d1e0c5c None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:50.662610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af2695-0006-4bd2-ba7c-e0bd1d1e0c5c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:50.663101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af2695-0006-4bd2-ba7c-e0bd1d1e0c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:50.665870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af2695-0006-4bd2-ba7c-e0bd1d1e0c5c None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:50.682344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:50.683226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 152/303] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:50.690160 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af2695-0006-4bd2-ba7c-e0bd1d1e0c5c None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:50.766453 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:50.781830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09764060-405f-490a-9de8-d2f6cadf63d7 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:50.818082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af2695-0006-4bd2-ba7c-e0bd1d1e0c5c None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:50.821822 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d39992-0f4a-4af4-b07a-19a9cbb54ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:50.821822 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d39992-0f4a-4af4-b07a-19a9cbb54ce0 None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:50.822030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d39992-0f4a-4af4-b07a-19a9cbb54ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:50.822262 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d39992-0f4a-4af4-b07a-19a9cbb54ce0 None admin] PATH_INFO: `/v3/groups` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:50.822851 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d39992-0f4a-4af4-b07a-19a9cbb54ce0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:50.824330 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d39992-0f4a-4af4-b07a-19a9cbb54ce0 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:50.883233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc935f53-d6bb-4f2f-bac1-25175ab39875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:50.884625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc935f53-d6bb-4f2f-bac1-25175ab39875 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:50.885449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc935f53-d6bb-4f2f-bac1-25175ab39875 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:50.886139 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc935f53-d6bb-4f2f-bac1-25175ab39875 None admin] PATH_INFO: `/v3/users/206a5a846e1d45b6b788a198315d0a28` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:50.913455 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc935f53-d6bb-4f2f-bac1-25175ab39875 None admin] RBAC: Authorizing `identity:get_user(user_id=206a5a846e1d45b6b788a198315d0a28)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:50.915294 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc935f53-d6bb-4f2f-bac1-25175ab39875 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:50.917355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 153/304] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:50 2022] GET /identity/v3/users/206a5a846e1d45b6b788a198315d0a28 => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:50.923924 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc935f53-d6bb-4f2f-bac1-25175ab39875 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:50.924328 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 152/305] 10.222.0.25 () {60 vars in 1134 bytes} [Wed Sep 7 16:27:50 2022] POST /identity/v3/groups => generated 229 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:27:50.948879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d39992-0f4a-4af4-b07a-19a9cbb54ce0 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:51.092857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:51.094184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc935f53-d6bb-4f2f-bac1-25175ab39875 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:51.112064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:51.142648 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd03815-064d-4f59-a683-33978d8cdbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:51.144038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd03815-064d-4f59-a683-33978d8cdbb4 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:51.144567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd03815-064d-4f59-a683-33978d8cdbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:51.145043 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd03815-064d-4f59-a683-33978d8cdbb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:51.146035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd03815-064d-4f59-a683-33978d8cdbb4 None admin] RBAC: Adding query filter params (role.id=be4da00ddeb847968d5fdd6a8dd9de0a, user.id=206a5a846e1d45b6b788a198315d0a28, scope.system=all) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:51.146387 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d39992-0f4a-4af4-b07a-19a9cbb54ce0 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:51.146813 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd03815-064d-4f59-a683-33978d8cdbb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:51.148907 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd03815-064d-4f59-a683-33978d8cdbb4 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:51.158611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 154/306] 10.222.0.25 () {56 vars in 1308 bytes} [Wed Sep 7 16:27:50 2022] GET /identity/v3/role_assignments?user.id=206a5a846e1d45b6b788a198315d0a28&scope.system=all&role.id=be4da00ddeb847968d5fdd6a8dd9de0a => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:51.218880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b10ba4-016c-445c-84df-cd56f57c409d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:51.219897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b10ba4-016c-445c-84df-cd56f57c409d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:51.220333 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b10ba4-016c-445c-84df-cd56f57c409d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:51.220742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b10ba4-016c-445c-84df-cd56f57c409d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:51.241938 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b10ba4-016c-445c-84df-cd56f57c409d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:51.252494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-62b10ba4-016c-445c-84df-cd56f57c409d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:51.252494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:51.252494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:51.252494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:51.252494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:51.252494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:51.252494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:51.252494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:51.252494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:51.252494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:51.252494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:51.252494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:51.252494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:51.252494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:51.252494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:51.252494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:51.253478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:51.253478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:51.253478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:51.253478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:51.253478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:51.253478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:51.253478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:51.253478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:51.253478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:51.253478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:51.253478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:51.253478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:51.253478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:51.253478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:51.253478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:51.253478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:51.254273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:51.254273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:51.254273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:51.254273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:51.254273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:51.254273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:51.254273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:51.254273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:51.254273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:51.254273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:51.254273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:51.254273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:27:51.255455 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 153/307] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:51.263804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd03815-064d-4f59-a683-33978d8cdbb4 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:51.399761 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd03815-064d-4f59-a683-33978d8cdbb4 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:51.452506 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e35a2-286d-4513-a7b8-75e108467b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:51.453188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e35a2-286d-4513-a7b8-75e108467b46 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:51.453468 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e35a2-286d-4513-a7b8-75e108467b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:51.453737 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e35a2-286d-4513-a7b8-75e108467b46 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:51.454498 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e35a2-286d-4513-a7b8-75e108467b46 None admin] RBAC: Adding query filter params (name=member) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:51.454838 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e35a2-286d-4513-a7b8-75e108467b46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:51.456321 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e35a2-286d-4513-a7b8-75e108467b46 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:51.466973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 155/308] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:51.473811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b10ba4-016c-445c-84df-cd56f57c409d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:51.594394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b10ba4-016c-445c-84df-cd56f57c409d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:51.648661 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd4a51-07b2-4472-b057-4699ef4c4c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:51.649718 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd4a51-07b2-4472-b057-4699ef4c4c3a None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:51.650220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd4a51-07b2-4472-b057-4699ef4c4c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:51.650664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd4a51-07b2-4472-b057-4699ef4c4c3a None admin] PATH_INFO: `/v3/users/8e6d1dbfe98f46b4ada67bd70f0e0188` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:51.659581 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd4a51-07b2-4472-b057-4699ef4c4c3a None admin] RBAC: Authorizing `identity:get_user(user_id=8e6d1dbfe98f46b4ada67bd70f0e0188)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:51.661118 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd4a51-07b2-4472-b057-4699ef4c4c3a None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:51.662874 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 154/309] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:51 2022] GET /identity/v3/users/8e6d1dbfe98f46b4ada67bd70f0e0188 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:51.668733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e35a2-286d-4513-a7b8-75e108467b46 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:51.714285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:51.780257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e35a2-286d-4513-a7b8-75e108467b46 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:51.817580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864024d-77e4-4e0a-9787-deeb20649fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:51.818486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864024d-77e4-4e0a-9787-deeb20649fc3 None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:51.818908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864024d-77e4-4e0a-9787-deeb20649fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:51.819323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864024d-77e4-4e0a-9787-deeb20649fc3 None admin] PATH_INFO: `/v3/system/users/8e6d1dbfe98f46b4ada67bd70f0e0188/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:51.820923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864024d-77e4-4e0a-9787-deeb20649fc3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8e6d1dbfe98f46b4ada67bd70f0e0188, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:51.822485 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864024d-77e4-4e0a-9787-deeb20649fc3 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:51.918031 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 156/310] 10.222.0.25 () {58 vars in 1334 bytes} [Wed Sep 7 16:27:51 2022] PUT /identity/v3/system/users/8e6d1dbfe98f46b4ada67bd70f0e0188/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:27:52.081793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67a0ae-d933-4dd6-8187-952c13848bca None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:52.082086 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67a0ae-d933-4dd6-8187-952c13848bca None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:52.082835 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67a0ae-d933-4dd6-8187-952c13848bca None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:52.085502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 155/311] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:52.095970 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed929c-eb01-4522-bf62-73a32b52655c None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:52.096892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed929c-eb01-4522-bf62-73a32b52655c None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:52.097638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed929c-eb01-4522-bf62-73a32b52655c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:52.128232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-02ed929c-eb01-4522-bf62-73a32b52655c None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:52.130880 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-02ed929c-eb01-4522-bf62-73a32b52655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:52.293579 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 157/312] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:27:52.570776 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67a0ae-d933-4dd6-8187-952c13848bca None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:52.581833 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:52.682363 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67a0ae-d933-4dd6-8187-952c13848bca None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:52.720744 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb7f2b-278b-4f99-99ff-02f3faf02002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:52.721393 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb7f2b-278b-4f99-99ff-02f3faf02002 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:52.721669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb7f2b-278b-4f99-99ff-02f3faf02002 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:52.721940 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb7f2b-278b-4f99-99ff-02f3faf02002 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:52.734364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb7f2b-278b-4f99-99ff-02f3faf02002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:52.739842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-4bcb7f2b-278b-4f99-99ff-02f3faf02002 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:27:52.739842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:52.739842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:52.739842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:52.739842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:52.739842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:52.739842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:52.739842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:52.739842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:52.739842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:52.739842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:52.739842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:52.739842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:52.739842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:52.739842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:52.739842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:52.740879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:52.740879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:52.740879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:52.740879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:52.740879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:52.740879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:52.740879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:52.740879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:52.740879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:52.740879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:52.740879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:52.740879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:52.740879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:52.740879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:52.740879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:52.740879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:52.741667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:52.741667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:52.741667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:52.741667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:52.741667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:52.741667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:52.741667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:52.741667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:52.741667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:52.741667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:52.741667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:27:52.741667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:27:52.741667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 156/313] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:52.747966 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed929c-eb01-4522-bf62-73a32b52655c None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:52.782697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:52.866491 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed929c-eb01-4522-bf62-73a32b52655c None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:52.909398 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a866622-da0f-40c4-967e-f9baaae56998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:52.910463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a866622-da0f-40c4-967e-f9baaae56998 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:52.910969 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a866622-da0f-40c4-967e-f9baaae56998 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:52.911453 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a866622-da0f-40c4-967e-f9baaae56998 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:52.912476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a866622-da0f-40c4-967e-f9baaae56998 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:52.913000 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a866622-da0f-40c4-967e-f9baaae56998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:52.914648 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a866622-da0f-40c4-967e-f9baaae56998 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:52.926099 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 158/314] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:52.932000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb7f2b-278b-4f99-99ff-02f3faf02002 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:53.035885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:53.053462 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb7f2b-278b-4f99-99ff-02f3faf02002 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:53.093868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36b50a-db38-4f15-93db-4673f24763c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:53.094566 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b50a-db38-4f15-93db-4673f24763c6 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:53.094848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b50a-db38-4f15-93db-4673f24763c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:53.095122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b50a-db38-4f15-93db-4673f24763c6 None admin] PATH_INFO: `/v3/users/5661128f3fb6465ba3c05124b1f73c43` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:53.096515 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36b50a-db38-4f15-93db-4673f24763c6 None admin] RBAC: Authorizing `identity:get_user(user_id=5661128f3fb6465ba3c05124b1f73c43)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:53.097991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36b50a-db38-4f15-93db-4673f24763c6 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:53.099682 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 157/315] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:52 2022] GET /identity/v3/users/5661128f3fb6465ba3c05124b1f73c43 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:53.106997 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a866622-da0f-40c4-967e-f9baaae56998 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:53.249126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:53.262005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a866622-da0f-40c4-967e-f9baaae56998 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:53.319759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc1d24-4c59-489b-b507-748ec7764299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:53.320779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc1d24-4c59-489b-b507-748ec7764299 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:53.321216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc1d24-4c59-489b-b507-748ec7764299 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:53.321666 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc1d24-4c59-489b-b507-748ec7764299 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:53.460792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc1d24-4c59-489b-b507-748ec7764299 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:53.463717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc1d24-4c59-489b-b507-748ec7764299 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:53.601383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 159/316] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 16:27:53.601845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:53.607788 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36b50a-db38-4f15-93db-4673f24763c6 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:53.638129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d3313-78d3-4390-9046-e2034966e61b None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:53.638474 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d3313-78d3-4390-9046-e2034966e61b None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:53.638686 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d3313-78d3-4390-9046-e2034966e61b None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:53.640542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 160/317] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:27:53.646572 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec96c2-a6e1-4301-ae07-37985b7b58e0 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:53.646862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec96c2-a6e1-4301-ae07-37985b7b58e0 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:53.647106 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec96c2-a6e1-4301-ae07-37985b7b58e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:53.667961 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-f1ec96c2-a6e1-4301-ae07-37985b7b58e0 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:53.669767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f1ec96c2-a6e1-4301-ae07-37985b7b58e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:53.725965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36b50a-db38-4f15-93db-4673f24763c6 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:53.754948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 161/318] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:27:53.764535 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cc222-f89d-435b-b6ed-f1308b8f5c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:53.765181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cc222-f89d-435b-b6ed-f1308b8f5c20 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:53.765459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cc222-f89d-435b-b6ed-f1308b8f5c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:53.765730 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cc222-f89d-435b-b6ed-f1308b8f5c20 None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:53.766882 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cc222-f89d-435b-b6ed-f1308b8f5c20 None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:53.768362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cc222-f89d-435b-b6ed-f1308b8f5c20 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:53.770364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 158/319] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:27:53 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:53.776388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec96c2-a6e1-4301-ae07-37985b7b58e0 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:53.941300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec96c2-a6e1-4301-ae07-37985b7b58e0 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:53.985880 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:54.002809 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b739b8-cfe7-42f2-87a2-2565b30cad02 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:54.003143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b739b8-cfe7-42f2-87a2-2565b30cad02 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:54.003624 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b739b8-cfe7-42f2-87a2-2565b30cad02 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:54.005541 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 159/320] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:54.007207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f513-07bc-4fc4-97fe-ab19ed755b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:54.011525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f513-07bc-4fc4-97fe-ab19ed755b54 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:54.011525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f513-07bc-4fc4-97fe-ab19ed755b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:54.011525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f513-07bc-4fc4-97fe-ab19ed755b54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:54.011525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f513-07bc-4fc4-97fe-ab19ed755b54 None admin] RBAC: Adding query filter params (role.id=be4da00ddeb847968d5fdd6a8dd9de0a, scope.project.id=d636caf99d654f54ada4912b086ad3c6, user.id=5661128f3fb6465ba3c05124b1f73c43) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:54.011885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd358bd-8357-47e2-9d46-4fc8180dd21e None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:54.011885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd358bd-8357-47e2-9d46-4fc8180dd21e None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:54.012013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f513-07bc-4fc4-97fe-ab19ed755b54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:54.012078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd358bd-8357-47e2-9d46-4fc8180dd21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:54.014699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f513-07bc-4fc4-97fe-ab19ed755b54 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:54.022839 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 162/321] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:27:53 2022] GET /identity/v3/role_assignments?user.id=5661128f3fb6465ba3c05124b1f73c43&scope.project.id=d636caf99d654f54ada4912b086ad3c6&role.id=be4da00ddeb847968d5fdd6a8dd9de0a => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:54.034046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:54.043022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-cfd358bd-8357-47e2-9d46-4fc8180dd21e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:54.045077 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-cfd358bd-8357-47e2-9d46-4fc8180dd21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:54.077523 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f513-07bc-4fc4-97fe-ab19ed755b54 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:54.186039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 160/322] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:27:54.268833 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f513-07bc-4fc4-97fe-ab19ed755b54 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:54.336050 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d97e6-8a04-4c40-bd60-666c62d2e230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:54.337118 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d97e6-8a04-4c40-bd60-666c62d2e230 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:54.337584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d97e6-8a04-4c40-bd60-666c62d2e230 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:54.338084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d97e6-8a04-4c40-bd60-666c62d2e230 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:54.340099 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d97e6-8a04-4c40-bd60-666c62d2e230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:54.343318 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d97e6-8a04-4c40-bd60-666c62d2e230 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:54.346437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 163/323] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:27:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:54.355152 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd358bd-8357-47e2-9d46-4fc8180dd21e None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:54.518610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3c6d8-01c0-418b-8e32-e7203a2408c7 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:54.518956 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3c6d8-01c0-418b-8e32-e7203a2408c7 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:54.519399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3c6d8-01c0-418b-8e32-e7203a2408c7 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:54.520945 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 164/324] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:54.526638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d1b78-2c1b-4ac1-b0c7-7e9c0cd7ff86 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:54.526925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d1b78-2c1b-4ac1-b0c7-7e9c0cd7ff86 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:54.527197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d1b78-2c1b-4ac1-b0c7-7e9c0cd7ff86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:54.539903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd358bd-8357-47e2-9d46-4fc8180dd21e None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:54.555163 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-8e7d1b78-2c1b-4ac1-b0c7-7e9c0cd7ff86 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:54.557098 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-8e7d1b78-2c1b-4ac1-b0c7-7e9c0cd7ff86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:54.588252 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:54.596119 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9bf24-44fa-4da6-869d-751b49c3a8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:54.597014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9bf24-44fa-4da6-869d-751b49c3a8a3 None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:54.597428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9bf24-44fa-4da6-869d-751b49c3a8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:54.598175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9bf24-44fa-4da6-869d-751b49c3a8a3 None admin] PATH_INFO: `/v3/groups` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:54.598941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9bf24-44fa-4da6-869d-751b49c3a8a3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:54.600905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9bf24-44fa-4da6-869d-751b49c3a8a3 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:54.626442 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:54.644246 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 165/325] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:27:54.645241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d1b78-2c1b-4ac1-b0c7-7e9c0cd7ff86 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:54.742318 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 161/326] 10.222.0.25 () {60 vars in 1134 bytes} [Wed Sep 7 16:27:54 2022] POST /identity/v3/groups => generated 226 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:27:54.765784 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d1b78-2c1b-4ac1-b0c7-7e9c0cd7ff86 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:54.815754 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186aafe-2a00-4096-a43b-7e36aa8fe270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:54.816337 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186aafe-2a00-4096-a43b-7e36aa8fe270 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:54.816615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186aafe-2a00-4096-a43b-7e36aa8fe270 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:54.816890 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186aafe-2a00-4096-a43b-7e36aa8fe270 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:54.831406 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186aafe-2a00-4096-a43b-7e36aa8fe270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:54.836806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-d186aafe-2a00-4096-a43b-7e36aa8fe270 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:27:54.836806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:54.836806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:54.836806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:54.836806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:54.836806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:54.836806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:54.836806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:54.836806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:54.836806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:54.836806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:54.836806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:54.836806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:54.836806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:54.836806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:54.836806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:54.838532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:54.838532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:54.838532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:54.838532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:54.838532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:54.838532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:54.838532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:54.838532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:54.838532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:54.838532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:54.838532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:54.838532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:54.838532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:54.838532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:54.838532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:54.838532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:54.839998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:54.839998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:54.839998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:54.839998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:54.839998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:54.839998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:54.839998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:54.839998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:54.839998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:54.839998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:54.839998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:27:54.839998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:54.839998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 166/327] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:54.848260 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9bf24-44fa-4da6-869d-751b49c3a8a3 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:54.917327 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186aafe-2a00-4096-a43b-7e36aa8fe270 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:54.990261 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:55.017448 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9bf24-44fa-4da6-869d-751b49c3a8a3 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:55.070133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82862332-f38f-4149-8968-f7ae782d4c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:55.071515 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82862332-f38f-4149-8968-f7ae782d4c94 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:55.071515 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82862332-f38f-4149-8968-f7ae782d4c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:55.071921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82862332-f38f-4149-8968-f7ae782d4c94 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:55.073049 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82862332-f38f-4149-8968-f7ae782d4c94 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:55.073498 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82862332-f38f-4149-8968-f7ae782d4c94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:55.076426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82862332-f38f-4149-8968-f7ae782d4c94 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:55.087001 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186aafe-2a00-4096-a43b-7e36aa8fe270 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:55.093412 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 162/328] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:55.101292 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82862332-f38f-4149-8968-f7ae782d4c94 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:55.144019 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072cb5e-9d15-4379-98a3-d961b65113ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:55.145015 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072cb5e-9d15-4379-98a3-d961b65113ba None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:55.145301 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072cb5e-9d15-4379-98a3-d961b65113ba None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:55.145575 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072cb5e-9d15-4379-98a3-d961b65113ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:55.159716 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072cb5e-9d15-4379-98a3-d961b65113ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:55.165571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-1072cb5e-9d15-4379-98a3-d961b65113ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:55.165571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:55.165571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:55.165571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:55.165571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:55.165571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:55.165571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:55.165571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:55.165571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:55.165571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:55.165571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:55.165571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:55.165571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:55.165571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:55.165571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:55.165571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:55.166499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:55.166499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:55.166499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:55.166499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:55.166499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:55.166499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:55.166499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:55.166499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:55.166499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:55.166499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:55.166499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:55.166499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:55.166499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:55.166499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:55.166499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:55.166499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:55.167323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:55.167323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:55.167323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:55.167323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:55.167323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:55.167323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:55.167323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:55.167323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:55.167323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:55.167323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:55.167323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:55.167323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:55.167323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 167/329] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:55.174520 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072cb5e-9d15-4379-98a3-d961b65113ba None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:55.202410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:55.288789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82862332-f38f-4149-8968-f7ae782d4c94 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:55.337380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97520742-51b6-4fbd-894e-804823f3bfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:55.338514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97520742-51b6-4fbd-894e-804823f3bfce None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:55.338958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97520742-51b6-4fbd-894e-804823f3bfce None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:55.339725 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97520742-51b6-4fbd-894e-804823f3bfce None admin] PATH_INFO: `/v3/users/206a5a846e1d45b6b788a198315d0a28` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:55.341570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97520742-51b6-4fbd-894e-804823f3bfce None admin] RBAC: Authorizing `identity:get_user(user_id=206a5a846e1d45b6b788a198315d0a28)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:55.343211 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97520742-51b6-4fbd-894e-804823f3bfce None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:55.345433 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 163/330] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:55 2022] GET /identity/v3/users/206a5a846e1d45b6b788a198315d0a28 => generated 293 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:55.350859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97520742-51b6-4fbd-894e-804823f3bfce None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:55.371778 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072cb5e-9d15-4379-98a3-d961b65113ba None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:55.383082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:55.421699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcecfa-f45c-4eac-9b2b-f3ea54ae0415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:55.422581 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcecfa-f45c-4eac-9b2b-f3ea54ae0415 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:55.423034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcecfa-f45c-4eac-9b2b-f3ea54ae0415 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:55.423451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcecfa-f45c-4eac-9b2b-f3ea54ae0415 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:55.424309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcecfa-f45c-4eac-9b2b-f3ea54ae0415 None admin] RBAC: Adding query filter params (name=member) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:55.424754 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcecfa-f45c-4eac-9b2b-f3ea54ae0415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:55.426941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcecfa-f45c-4eac-9b2b-f3ea54ae0415 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:55.439543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 168/331] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:55.445608 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcecfa-f45c-4eac-9b2b-f3ea54ae0415 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:55.495517 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97520742-51b6-4fbd-894e-804823f3bfce None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:55.524324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:55.539364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5997918-c974-4a11-ac11-502d3daa4dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:55.540432 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5997918-c974-4a11-ac11-502d3daa4dd0 None admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:55.540936 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5997918-c974-4a11-ac11-502d3daa4dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:55.541412 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5997918-c974-4a11-ac11-502d3daa4dd0 None admin] PATH_INFO: `/v3/system/users/206a5a846e1d45b6b788a198315d0a28/roles/be4da00ddeb847968d5fdd6a8dd9de0a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:55.543328 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5997918-c974-4a11-ac11-502d3daa4dd0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=206a5a846e1d45b6b788a198315d0a28, role_id=be4da00ddeb847968d5fdd6a8dd9de0a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:55.545583 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5997918-c974-4a11-ac11-502d3daa4dd0 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:55.634741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcecfa-f45c-4eac-9b2b-f3ea54ae0415 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:55.649731 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 164/332] 10.222.0.25 () {58 vars in 1334 bytes} [Wed Sep 7 16:27:55 2022] PUT /identity/v3/system/users/206a5a846e1d45b6b788a198315d0a28/roles/be4da00ddeb847968d5fdd6a8dd9de0a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:27:55.708002 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac597d9-aa04-400e-88f8-cb343e611b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:55.709578 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac597d9-aa04-400e-88f8-cb343e611b91 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:55.710330 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac597d9-aa04-400e-88f8-cb343e611b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:55.711089 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac597d9-aa04-400e-88f8-cb343e611b91 None admin] PATH_INFO: `/v3/users/8e6d1dbfe98f46b4ada67bd70f0e0188` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:55.717864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac597d9-aa04-400e-88f8-cb343e611b91 None admin] RBAC: Authorizing `identity:get_user(user_id=8e6d1dbfe98f46b4ada67bd70f0e0188)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:55.721151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac597d9-aa04-400e-88f8-cb343e611b91 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:55.725038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 169/333] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:27:55 2022] GET /identity/v3/users/8e6d1dbfe98f46b4ada67bd70f0e0188 => generated 293 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:55.733369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5997918-c974-4a11-ac11-502d3daa4dd0 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:55.947380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5997918-c974-4a11-ac11-502d3daa4dd0 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:56.022270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501576b-1937-48d2-9091-e4de49146df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:56.023093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501576b-1937-48d2-9091-e4de49146df5 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:56.023492 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501576b-1937-48d2-9091-e4de49146df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:56.023871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501576b-1937-48d2-9091-e4de49146df5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:56.024719 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501576b-1937-48d2-9091-e4de49146df5 None admin] RBAC: Adding query filter params (role.id=b9c5d282a37c489e83eabbdd2b393dbf, user.id=8e6d1dbfe98f46b4ada67bd70f0e0188, scope.system=all) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:56.025143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501576b-1937-48d2-9091-e4de49146df5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:56.026696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501576b-1937-48d2-9091-e4de49146df5 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:56.041123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 165/334] 10.222.0.25 () {56 vars in 1308 bytes} [Wed Sep 7 16:27:55 2022] GET /identity/v3/role_assignments?user.id=8e6d1dbfe98f46b4ada67bd70f0e0188&scope.system=all&role.id=b9c5d282a37c489e83eabbdd2b393dbf => generated 510 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:58.253042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eb37d-e964-4afd-a87e-14ab770b4962 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:58.253042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eb37d-e964-4afd-a87e-14ab770b4962 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:58.253042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eb37d-e964-4afd-a87e-14ab770b4962 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:58.253042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 170/335] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:58.258993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6d0ea-37b8-4491-be08-ab839294c1ba None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:58.259974 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6d0ea-37b8-4491-be08-ab839294c1ba None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:58.260450 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6d0ea-37b8-4491-be08-ab839294c1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:58.295070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-28c6d0ea-37b8-4491-be08-ab839294c1ba None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:58.296924 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-28c6d0ea-37b8-4491-be08-ab839294c1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:58.371233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:58.379638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed561031-0475-4cfd-bf4a-109ae45fc07d None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:58.380289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed561031-0475-4cfd-bf4a-109ae45fc07d None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:58.380769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed561031-0475-4cfd-bf4a-109ae45fc07d None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:58.382391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 171/336] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:58.389604 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e0944-5639-4b71-b88f-16cceee1a9f4 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:58.390265 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e0944-5639-4b71-b88f-16cceee1a9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:58.390926 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e0944-5639-4b71-b88f-16cceee1a9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:58.436278 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-c38e0944-5639-4b71-b88f-16cceee1a9f4 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:27:58.437887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c38e0944-5639-4b71-b88f-16cceee1a9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:27:58.447678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 166/337] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:27:58.496688 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:58.553366 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 172/338] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:27:59.134505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6d0ea-37b8-4491-be08-ab839294c1ba None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:59.249727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e0944-5639-4b71-b88f-16cceee1a9f4 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:59.301329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6d0ea-37b8-4491-be08-ab839294c1ba None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:59.348234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d084d-b8c9-4fd8-8d10-fe948d64425d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:59.348894 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d084d-b8c9-4fd8-8d10-fe948d64425d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:59.349174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d084d-b8c9-4fd8-8d10-fe948d64425d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:59.349443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d084d-b8c9-4fd8-8d10-fe948d64425d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:59.367426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d084d-b8c9-4fd8-8d10-fe948d64425d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:59.372694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-e82d084d-b8c9-4fd8-8d10-fe948d64425d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:27:59.372694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:59.372694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:59.372694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:59.372694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:59.372694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:59.372694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:59.372694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:59.372694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:59.372694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:59.372694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:59.372694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:59.372694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:59.372694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:59.372694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:59.372694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:59.373852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:59.373852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:59.373852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:59.373852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:59.373852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:59.373852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:59.373852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:59.373852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:59.373852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:59.373852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:59.373852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:59.373852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:59.373852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:59.373852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:59.373852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:59.373852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:59.374846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:59.374846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:59.374846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:59.374846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:59.374846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:59.374846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:59.374846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:59.374846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:59.374846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:59.374846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:59.374846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:27:59.374846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:27:59.377354 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 167/339] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:27:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:59.383248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d084d-b8c9-4fd8-8d10-fe948d64425d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:59.433318 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:59.457608 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e0944-5639-4b71-b88f-16cceee1a9f4 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:59.517946 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d084d-b8c9-4fd8-8d10-fe948d64425d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:59.540299 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ff0b5-e6a4-4317-a2f6-54c6a33d41f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:59.540968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ff0b5-e6a4-4317-a2f6-54c6a33d41f9 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:59.541244 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ff0b5-e6a4-4317-a2f6-54c6a33d41f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:59.541512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ff0b5-e6a4-4317-a2f6-54c6a33d41f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:59.564177 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a151f06-7937-4be8-970c-479980750834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:59.565299 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a151f06-7937-4be8-970c-479980750834 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:59.568230 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a151f06-7937-4be8-970c-479980750834 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:59.568768 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a151f06-7937-4be8-970c-479980750834 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:59.569727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a151f06-7937-4be8-970c-479980750834 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:59.570563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a151f06-7937-4be8-970c-479980750834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:59.571330 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ff0b5-e6a4-4317-a2f6-54c6a33d41f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:27:59.573050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a151f06-7937-4be8-970c-479980750834 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:59.579179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-b06ff0b5-e6a4-4317-a2f6-54c6a33d41f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:59.579179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:27:59.579179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:27:59.579179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:27:59.579179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:27:59.579179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:27:59.579179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:27:59.579179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:27:59.579179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:27:59.579179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:27:59.579179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:27:59.579179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:27:59.579179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:27:59.579179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:27:59.579179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:27:59.579179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:27:59.580178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:27:59.580178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:27:59.580178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:27:59.580178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:27:59.580178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:27:59.580178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:27:59.580178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:27:59.580178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:27:59.580178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:27:59.580178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:27:59.580178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:27:59.580178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:27:59.580178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:27:59.580178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:27:59.580178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:27:59.580178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:27:59.580968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:27:59.580968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:27:59.580968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:27:59.580968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:27:59.580968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:27:59.580968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:27:59.580968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:27:59.580968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:27:59.580968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:27:59.580968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:27:59.580968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:27:59.580968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:27:59.589342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 173/340] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:27:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:27:59.594538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 168/341] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:27:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:27:59.595905 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ff0b5-e6a4-4317-a2f6-54c6a33d41f9 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:59.600788 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a151f06-7937-4be8-970c-479980750834 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:59.642310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:59.767687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ff0b5-e6a4-4317-a2f6-54c6a33d41f9 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:59.815322 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:59.828655 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a151f06-7937-4be8-970c-479980750834 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:27:59.833759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfa2dc-2db3-412f-92e5-df919f209ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:59.834405 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfa2dc-2db3-412f-92e5-df919f209ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:59.834684 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfa2dc-2db3-412f-92e5-df919f209ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:59.834955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfa2dc-2db3-412f-92e5-df919f209ca3 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:59.835671 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfa2dc-2db3-412f-92e5-df919f209ca3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:27:59.835971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfa2dc-2db3-412f-92e5-df919f209ca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:27:59.837391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfa2dc-2db3-412f-92e5-df919f209ca3 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:27:59.849588 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 174/342] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:27:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:27:59.856398 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6e326-7d74-4e47-908b-2105067cac72 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:59.856398 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6e326-7d74-4e47-908b-2105067cac72 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:59.856398 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6e326-7d74-4e47-908b-2105067cac72 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:59.857766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 175/343] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:27:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:27:59.860017 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6e326-7d74-4e47-908b-2105067cac72 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:27:59.924332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093cc86-f839-4ec2-8289-f6d263b4a22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:27:59.924981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093cc86-f839-4ec2-8289-f6d263b4a22c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:27:59.925262 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093cc86-f839-4ec2-8289-f6d263b4a22c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:27:59.925538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093cc86-f839-4ec2-8289-f6d263b4a22c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:27:59.971866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:27:59.987448 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6e326-7d74-4e47-908b-2105067cac72 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:00.028657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85fe1f-e931-4f5b-a0df-d0fb742c83e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:00.029206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093cc86-f839-4ec2-8289-f6d263b4a22c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:00.029713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85fe1f-e931-4f5b-a0df-d0fb742c83e1 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:00.030135 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85fe1f-e931-4f5b-a0df-d0fb742c83e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:00.030549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85fe1f-e931-4f5b-a0df-d0fb742c83e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:00.030997 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093cc86-f839-4ec2-8289-f6d263b4a22c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:00.111024 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85fe1f-e931-4f5b-a0df-d0fb742c83e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:00.112831 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85fe1f-e931-4f5b-a0df-d0fb742c83e1 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:00.152225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:00.157398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 169/344] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:00.158749 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e9d03-eb6a-49e2-bd01-b8b69c894889 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:00.159032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e9d03-eb6a-49e2-bd01-b8b69c894889 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:00.159300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e9d03-eb6a-49e2-bd01-b8b69c894889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:00.180096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-510e9d03-eb6a-49e2-bd01-b8b69c894889 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:00.181268 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-510e9d03-eb6a-49e2-bd01-b8b69c894889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:00.217494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:00.237201 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 176/345] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:27:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 16:28:00.243459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27b78a-d43b-47cd-9eca-5b2d5fd3ec10 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:00.244163 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27b78a-d43b-47cd-9eca-5b2d5fd3ec10 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:00.244618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27b78a-d43b-47cd-9eca-5b2d5fd3ec10 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:00.247429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 177/346] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:00.248566 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27b78a-d43b-47cd-9eca-5b2d5fd3ec10 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:00.275299 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 170/347] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:00.275701 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e9d03-eb6a-49e2-bd01-b8b69c894889 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:00.464826 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e9d03-eb6a-49e2-bd01-b8b69c894889 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:00.476405 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27b78a-d43b-47cd-9eca-5b2d5fd3ec10 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:00.519969 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:00.536823 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c605c3-3e1f-4dca-9926-ffa95debdf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:00.537819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c605c3-3e1f-4dca-9926-ffa95debdf99 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:00.537819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c605c3-3e1f-4dca-9926-ffa95debdf99 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:00.538082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c605c3-3e1f-4dca-9926-ffa95debdf99 None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:00.539287 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77942d-7c59-4e55-879f-8b5c4a18b019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:00.539981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77942d-7c59-4e55-879f-8b5c4a18b019 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:00.540254 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77942d-7c59-4e55-879f-8b5c4a18b019 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:00.540523 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77942d-7c59-4e55-879f-8b5c4a18b019 None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:00.541759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c605c3-3e1f-4dca-9926-ffa95debdf99 None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:00.543242 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c605c3-3e1f-4dca-9926-ffa95debdf99 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:00.545144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77942d-7c59-4e55-879f-8b5c4a18b019 None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:00.546643 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77942d-7c59-4e55-879f-8b5c4a18b019 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:00.548456 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 178/348] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:28:00 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:00.550221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 171/349] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:28:00 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:00.551580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be0d58-8d69-4845-babe-3cc3c8b96cf7 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:00.551867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be0d58-8d69-4845-babe-3cc3c8b96cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:00.552140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be0d58-8d69-4845-babe-3cc3c8b96cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:00.554604 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c605c3-3e1f-4dca-9926-ffa95debdf99 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:00.597279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-30be0d58-8d69-4845-babe-3cc3c8b96cf7 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:00.599276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-30be0d58-8d69-4845-babe-3cc3c8b96cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:00.709996 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:00.737215 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 179/350] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:00.738809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be0d58-8d69-4845-babe-3cc3c8b96cf7 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:00.740045 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c605c3-3e1f-4dca-9926-ffa95debdf99 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:00.784579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bcaa5-50f0-4812-ba9a-c0e671c2e810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:00.785246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bcaa5-50f0-4812-ba9a-c0e671c2e810 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:00.785531 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bcaa5-50f0-4812-ba9a-c0e671c2e810 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:00.785808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bcaa5-50f0-4812-ba9a-c0e671c2e810 None admin] PATH_INFO: `/v3/groups/b119914b23864753a220d9f1bc34bae9` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:00.794744 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bcaa5-50f0-4812-ba9a-c0e671c2e810 None admin] RBAC: Authorizing `identity:get_group(group_id=b119914b23864753a220d9f1bc34bae9)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:00.796310 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bcaa5-50f0-4812-ba9a-c0e671c2e810 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:00.798478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 172/351] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Sep 7 16:28:00 2022] GET /identity/v3/groups/b119914b23864753a220d9f1bc34bae9 => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:28:00.799773 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bcaa5-50f0-4812-ba9a-c0e671c2e810 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:00.879379 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:00.964746 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bcaa5-50f0-4812-ba9a-c0e671c2e810 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:00.968645 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be0d58-8d69-4845-babe-3cc3c8b96cf7 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:01.017222 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec659300-1731-43aa-bfee-7a9d45dd135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:01.017802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec659300-1731-43aa-bfee-7a9d45dd135b None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:01.018084 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec659300-1731-43aa-bfee-7a9d45dd135b None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:01.018363 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec659300-1731-43aa-bfee-7a9d45dd135b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:01.033148 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec659300-1731-43aa-bfee-7a9d45dd135b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:01.042465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-ec659300-1731-43aa-bfee-7a9d45dd135b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:28:01.042465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:01.042465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:01.042465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:01.042465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:01.042465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:01.042465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:01.042465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:01.042465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:01.042465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:01.042465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:01.042465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:01.042465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:01.042465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:01.042465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:01.042465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:01.044043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:01.044043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:01.044043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:01.044043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:01.044043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:01.044043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:01.044043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:01.044043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:01.044043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:01.044043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:01.044043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:01.044043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:01.044043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:01.044043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:01.044043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:01.044043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:01.044911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:01.044911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:01.044911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:01.044911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:01.044911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:01.044911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:01.044911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:01.044911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:01.044911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:01.044911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:01.044911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:28:01.044911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:01.044911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 173/352] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:28:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:01.050744 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec412c6a-0f5f-4aea-933f-66757bfbb3e5 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:01.051046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec412c6a-0f5f-4aea-933f-66757bfbb3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:01.051367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec412c6a-0f5f-4aea-933f-66757bfbb3e5 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:01.052963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 174/353] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:01.054962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec412c6a-0f5f-4aea-933f-66757bfbb3e5 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:01.055160 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269efce1-c431-43d5-9ba0-3d0aa2bf19a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:01.060832 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269efce1-c431-43d5-9ba0-3d0aa2bf19a6 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:01.062652 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269efce1-c431-43d5-9ba0-3d0aa2bf19a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:01.063161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269efce1-c431-43d5-9ba0-3d0aa2bf19a6 None admin] PATH_INFO: `/v3/groups/b119914b23864753a220d9f1bc34bae9` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:01.065454 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269efce1-c431-43d5-9ba0-3d0aa2bf19a6 None admin] RBAC: Authorizing `identity:get_group(group_id=b119914b23864753a220d9f1bc34bae9)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:01.069010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269efce1-c431-43d5-9ba0-3d0aa2bf19a6 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:01.072172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 180/354] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Sep 7 16:28:00 2022] GET /identity/v3/groups/b119914b23864753a220d9f1bc34bae9 => generated 226 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:01.074386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269efce1-c431-43d5-9ba0-3d0aa2bf19a6 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:01.156748 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:01.210933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec412c6a-0f5f-4aea-933f-66757bfbb3e5 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:01.238242 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269efce1-c431-43d5-9ba0-3d0aa2bf19a6 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:01.247538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:01.282991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2de8f-6390-4695-866e-bdce6136a603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:01.283363 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2de8f-6390-4695-866e-bdce6136a603 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:01.283618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2de8f-6390-4695-866e-bdce6136a603 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:01.283892 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2de8f-6390-4695-866e-bdce6136a603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:01.284646 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2de8f-6390-4695-866e-bdce6136a603 None admin] RBAC: Adding query filter params (group.id=b119914b23864753a220d9f1bc34bae9, role.id=e35c45d51df34051b68fa49475ac7250, scope.project.id=76f48757de234b528b472ca888b7cff8) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:01.284956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2de8f-6390-4695-866e-bdce6136a603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:01.286913 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2de8f-6390-4695-866e-bdce6136a603 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:01.293156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 175/355] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Sep 7 16:28:01 2022] GET /identity/v3/role_assignments?group.id=b119914b23864753a220d9f1bc34bae9&scope.project.id=76f48757de234b528b472ca888b7cff8&role.id=e35c45d51df34051b68fa49475ac7250 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:01.295613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc06251-f372-4c28-b5ac-e2984004d91d None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:01.295905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc06251-f372-4c28-b5ac-e2984004d91d None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:01.296181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc06251-f372-4c28-b5ac-e2984004d91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:01.310848 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f6188-ecb2-4718-a5f4-10952fa5dfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:01.313189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f6188-ecb2-4718-a5f4-10952fa5dfb6 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:01.313480 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f6188-ecb2-4718-a5f4-10952fa5dfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:01.313893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f6188-ecb2-4718-a5f4-10952fa5dfb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:01.315084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f6188-ecb2-4718-a5f4-10952fa5dfb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:01.315577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f6188-ecb2-4718-a5f4-10952fa5dfb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:01.317921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f6188-ecb2-4718-a5f4-10952fa5dfb6 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:01.318869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-2fc06251-f372-4c28-b5ac-e2984004d91d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:01.320171 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2fc06251-f372-4c28-b5ac-e2984004d91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:01.333431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 181/356] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:28:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:01.334322 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f6188-ecb2-4718-a5f4-10952fa5dfb6 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:01.457964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 176/357] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:01.459375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc06251-f372-4c28-b5ac-e2984004d91d None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:01.531224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f6188-ecb2-4718-a5f4-10952fa5dfb6 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:01.572781 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:01.613598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0c7df-df47-4ca1-a7d2-121d7e62b492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:01.615027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0c7df-df47-4ca1-a7d2-121d7e62b492 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:01.615852 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0c7df-df47-4ca1-a7d2-121d7e62b492 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:01.616588 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0c7df-df47-4ca1-a7d2-121d7e62b492 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:01.618167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0c7df-df47-4ca1-a7d2-121d7e62b492 None admin] RBAC: Adding query filter params (group.id=b119914b23864753a220d9f1bc34bae9, role.id=b9c5d282a37c489e83eabbdd2b393dbf, scope.project.id=76f48757de234b528b472ca888b7cff8) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:01.619010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0c7df-df47-4ca1-a7d2-121d7e62b492 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:01.622685 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0c7df-df47-4ca1-a7d2-121d7e62b492 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:01.633718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 182/358] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Sep 7 16:28:01 2022] GET /identity/v3/role_assignments?group.id=b119914b23864753a220d9f1bc34bae9&scope.project.id=76f48757de234b528b472ca888b7cff8&role.id=b9c5d282a37c489e83eabbdd2b393dbf => generated 260 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:01.640714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a959-8f08-449b-9b20-a5b18d938b6d None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:01.641583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a959-8f08-449b-9b20-a5b18d938b6d None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:01.642361 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a959-8f08-449b-9b20-a5b18d938b6d None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:01.645956 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 183/359] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:01.648913 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3a959-8f08-449b-9b20-a5b18d938b6d None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:01.684736 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc06251-f372-4c28-b5ac-e2984004d91d None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:01.714002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:01.758122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969c1b7-3933-4e8f-b218-8fcaa92c77c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:01.759166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969c1b7-3933-4e8f-b218-8fcaa92c77c2 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:01.759680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969c1b7-3933-4e8f-b218-8fcaa92c77c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:01.760143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969c1b7-3933-4e8f-b218-8fcaa92c77c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:01.782286 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969c1b7-3933-4e8f-b218-8fcaa92c77c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:01.791926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-0969c1b7-3933-4e8f-b218-8fcaa92c77c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:28:01.791926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:01.791926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:01.791926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:01.791926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:01.791926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:01.791926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:01.791926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:01.791926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:01.791926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:01.791926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:01.791926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:01.791926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:01.791926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:01.791926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:01.791926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:01.793741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:01.793741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:01.793741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:01.793741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:01.793741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:01.793741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:01.793741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:01.793741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:01.793741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:01.793741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:01.793741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:01.793741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:01.793741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:01.793741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:01.793741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:01.793741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:01.795464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:01.795464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:01.795464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:01.795464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:01.795464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:01.795464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:01.795464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:01.795464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:01.795464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:01.795464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:01.795464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 16:28:01.795464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:01.795464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 177/360] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:28:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:01.798036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e1939-a010-4973-a7cd-0a75ed27a480 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:01.798036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e1939-a010-4973-a7cd-0a75ed27a480 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:01.798545 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e1939-a010-4973-a7cd-0a75ed27a480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:01.828205 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-1e7e1939-a010-4973-a7cd-0a75ed27a480 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:01.830098 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1e7e1939-a010-4973-a7cd-0a75ed27a480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:01.859900 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3a959-8f08-449b-9b20-a5b18d938b6d None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:01.964247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a0c5-8d7d-4ff6-af23-bc1fbd8f8e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:01.965591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a0c5-8d7d-4ff6-af23-bc1fbd8f8e2a None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:01.966475 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a0c5-8d7d-4ff6-af23-bc1fbd8f8e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:01.972956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 178/361] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:01.974588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e1939-a010-4973-a7cd-0a75ed27a480 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:01.975947 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a0c5-8d7d-4ff6-af23-bc1fbd8f8e2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:02.095983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:02.148023 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e1939-a010-4973-a7cd-0a75ed27a480 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:02.149946 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:02.161336 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5a0c5-8d7d-4ff6-af23-bc1fbd8f8e2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:02.166634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5a0c5-8d7d-4ff6-af23-bc1fbd8f8e2a None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:02.193351 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a90ac-ae3e-448f-9839-1168480f9cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:02.194767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a90ac-ae3e-448f-9839-1168480f9cfe None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:02.195046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a90ac-ae3e-448f-9839-1168480f9cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:02.195322 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a90ac-ae3e-448f-9839-1168480f9cfe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:02.209883 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a90ac-ae3e-448f-9839-1168480f9cfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:02.216372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-ad9a90ac-ae3e-448f-9839-1168480f9cfe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:28:02.216372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:02.216372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:02.216372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:02.216372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:02.216372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:02.216372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:02.216372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:02.216372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:02.216372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:02.216372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:02.216372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:02.216372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:02.216372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:02.216372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:02.216372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:02.217350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:02.217350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:02.217350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:02.217350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:02.217350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:02.217350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:02.217350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:02.217350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:02.217350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:02.217350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:02.217350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:02.217350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:02.217350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:02.217350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:02.217350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:02.217350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:02.218163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:02.218163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:02.218163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:02.218163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:02.218163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:02.218163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:02.218163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:02.218163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:02.218163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:02.218163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:02.218163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:28:02.218163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:02.218163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 179/362] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:28:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:02.218851 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a90ac-ae3e-448f-9839-1168480f9cfe None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:02.359275 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a90ac-ae3e-448f-9839-1168480f9cfe None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:02.404281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c44dc-6325-42bb-bfba-5e51ef0b40e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:02.405317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c44dc-6325-42bb-bfba-5e51ef0b40e6 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:02.405866 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c44dc-6325-42bb-bfba-5e51ef0b40e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:02.406348 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c44dc-6325-42bb-bfba-5e51ef0b40e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:02.407397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c44dc-6325-42bb-bfba-5e51ef0b40e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:02.408047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c44dc-6325-42bb-bfba-5e51ef0b40e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:02.409763 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c44dc-6325-42bb-bfba-5e51ef0b40e6 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:02.421154 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 180/363] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:28:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:02.422383 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c44dc-6325-42bb-bfba-5e51ef0b40e6 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:02.437566 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 184/364] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 791 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:02.438473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a0c5-8d7d-4ff6-af23-bc1fbd8f8e2a None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:02.463870 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:02.563171 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c44dc-6325-42bb-bfba-5e51ef0b40e6 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:02.592983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:02.619807 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a0c5-8d7d-4ff6-af23-bc1fbd8f8e2a None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:02.662075 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6034ba-4300-4c47-8806-1c7ef102cc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:02.663579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6034ba-4300-4c47-8806-1c7ef102cc9c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:02.664081 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6034ba-4300-4c47-8806-1c7ef102cc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:02.664557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6034ba-4300-4c47-8806-1c7ef102cc9c None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:02.666789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6034ba-4300-4c47-8806-1c7ef102cc9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:02.667126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6034ba-4300-4c47-8806-1c7ef102cc9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:02.671123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6034ba-4300-4c47-8806-1c7ef102cc9c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:02.685460 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 181/365] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:02.687317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6034ba-4300-4c47-8806-1c7ef102cc9c None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:02.691563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c43b8-9a96-40a1-af30-f532d05e276f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:02.691563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c43b8-9a96-40a1-af30-f532d05e276f None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:02.691563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c43b8-9a96-40a1-af30-f532d05e276f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:02.691563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c43b8-9a96-40a1-af30-f532d05e276f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:02.719193 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c43b8-9a96-40a1-af30-f532d05e276f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:02.725182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-1d2c43b8-9a96-40a1-af30-f532d05e276f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:28:02.725182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:02.725182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:02.725182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:02.725182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:02.725182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:02.725182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:02.725182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:02.725182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:02.725182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:02.725182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:02.725182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:02.725182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:02.725182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:02.725182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:02.725182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:02.727814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:02.727814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:02.727814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:02.727814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:02.727814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:02.727814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:02.727814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:02.727814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:02.727814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:02.727814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:02.727814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:02.727814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:02.727814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:02.727814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:02.727814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:02.727814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:02.731535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:02.731535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:02.731535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:02.731535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:02.731535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:02.731535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:02.731535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:02.731535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:02.731535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:02.731535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:02.731535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:28:02.731535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:02.731535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 185/366] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:28:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:02.731535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c43b8-9a96-40a1-af30-f532d05e276f None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:02.854139 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c43b8-9a96-40a1-af30-f532d05e276f None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:02.880009 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:02.901512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab9a56-0d4d-433a-aa87-87a36ab77fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:02.902410 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab9a56-0d4d-433a-aa87-87a36ab77fcb None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:02.903399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab9a56-0d4d-433a-aa87-87a36ab77fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:02.903844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab9a56-0d4d-433a-aa87-87a36ab77fcb None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:02.911176 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab9a56-0d4d-433a-aa87-87a36ab77fcb None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:02.912724 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab9a56-0d4d-433a-aa87-87a36ab77fcb None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:02.913206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6034ba-4300-4c47-8806-1c7ef102cc9c None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:02.914811 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 186/367] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:28:02 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:02.915684 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab9a56-0d4d-433a-aa87-87a36ab77fcb None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:02.935962 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:02.988373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9378c2-2bf0-4d95-bada-bbb29cddef5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:02.989459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9378c2-2bf0-4d95-bada-bbb29cddef5d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:02.989891 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9378c2-2bf0-4d95-bada-bbb29cddef5d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:02.990314 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9378c2-2bf0-4d95-bada-bbb29cddef5d None admin] PATH_INFO: `/v3/users/206a5a846e1d45b6b788a198315d0a28` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:02.993132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9378c2-2bf0-4d95-bada-bbb29cddef5d None admin] RBAC: Authorizing `identity:get_user(user_id=206a5a846e1d45b6b788a198315d0a28)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:02.996381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9378c2-2bf0-4d95-bada-bbb29cddef5d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:03.000257 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 182/368] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:28:02 2022] GET /identity/v3/users/206a5a846e1d45b6b788a198315d0a28 => generated 293 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:03.001122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9378c2-2bf0-4d95-bada-bbb29cddef5d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:03.142568 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab9a56-0d4d-433a-aa87-87a36ab77fcb None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:03.218317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9378c2-2bf0-4d95-bada-bbb29cddef5d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:03.224899 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ef86d-7b33-4a32-822f-e41c7ef378cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:03.226293 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ef86d-7b33-4a32-822f-e41c7ef378cb None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:03.227015 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ef86d-7b33-4a32-822f-e41c7ef378cb None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:03.227978 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ef86d-7b33-4a32-822f-e41c7ef378cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:03.302471 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1af75-209e-4ce9-b199-b294d887e2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:03.303112 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1af75-209e-4ce9-b199-b294d887e2fc None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:03.303392 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1af75-209e-4ce9-b199-b294d887e2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:03.303743 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1af75-209e-4ce9-b199-b294d887e2fc None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:03.304437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1af75-209e-4ce9-b199-b294d887e2fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:03.304738 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1af75-209e-4ce9-b199-b294d887e2fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:03.306164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1af75-209e-4ce9-b199-b294d887e2fc None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:03.325973 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 183/369] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:28:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:03.326875 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1af75-209e-4ce9-b199-b294d887e2fc None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:03.384937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:03.401515 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ef86d-7b33-4a32-822f-e41c7ef378cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:03.401515 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ef86d-7b33-4a32-822f-e41c7ef378cb None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:03.422284 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:03.585413 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1af75-209e-4ce9-b199-b294d887e2fc None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:03.661862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 187/370] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 746 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:03.663787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ef86d-7b33-4a32-822f-e41c7ef378cb None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:03.664540 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3af37d-f6f1-4e43-a0dd-583d8b037bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:03.665624 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3af37d-f6f1-4e43-a0dd-583d8b037bbc None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:03.666108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3af37d-f6f1-4e43-a0dd-583d8b037bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:03.666591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3af37d-f6f1-4e43-a0dd-583d8b037bbc None admin] PATH_INFO: `/v3/groups/b119914b23864753a220d9f1bc34bae9` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:03.672239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3af37d-f6f1-4e43-a0dd-583d8b037bbc None admin] RBAC: Authorizing `identity:get_group(group_id=b119914b23864753a220d9f1bc34bae9)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:03.675037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3af37d-f6f1-4e43-a0dd-583d8b037bbc None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:03.678180 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 184/371] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Sep 7 16:28:03 2022] GET /identity/v3/groups/b119914b23864753a220d9f1bc34bae9 => generated 226 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:03.680424 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3af37d-f6f1-4e43-a0dd-583d8b037bbc None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:03.867858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:03.870447 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ef86d-7b33-4a32-822f-e41c7ef378cb None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:03.890616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:03.907883 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3af37d-f6f1-4e43-a0dd-583d8b037bbc None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:03.953069 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54d307-58b6-427f-8d04-2c0c0b4d3224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:03.954278 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54d307-58b6-427f-8d04-2c0c0b4d3224 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:03.955696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54d307-58b6-427f-8d04-2c0c0b4d3224 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:03.956983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54d307-58b6-427f-8d04-2c0c0b4d3224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:03.957996 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54d307-58b6-427f-8d04-2c0c0b4d3224 None admin] RBAC: Adding query filter params (role.id=be4da00ddeb847968d5fdd6a8dd9de0a, user.id=206a5a846e1d45b6b788a198315d0a28, scope.system=all) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:03.958711 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54d307-58b6-427f-8d04-2c0c0b4d3224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:03.960241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54d307-58b6-427f-8d04-2c0c0b4d3224 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:03.970770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93204692-ab45-4605-b38b-825945f83e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:03.971844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93204692-ab45-4605-b38b-825945f83e74 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:03.972344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93204692-ab45-4605-b38b-825945f83e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:03.972815 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93204692-ab45-4605-b38b-825945f83e74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:03.984472 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 188/372] 10.222.0.25 () {56 vars in 1308 bytes} [Wed Sep 7 16:28:03 2022] GET /identity/v3/role_assignments?user.id=206a5a846e1d45b6b788a198315d0a28&scope.system=all&role.id=be4da00ddeb847968d5fdd6a8dd9de0a => generated 510 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:03.985697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54d307-58b6-427f-8d04-2c0c0b4d3224 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:04.098086 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93204692-ab45-4605-b38b-825945f83e74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:04.099650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93204692-ab45-4605-b38b-825945f83e74 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:04.200705 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:04.220452 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 185/373] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:04.221267 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93204692-ab45-4605-b38b-825945f83e74 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:04.229768 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54d307-58b6-427f-8d04-2c0c0b4d3224 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:04.303630 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15c984-023e-46d9-8640-256bb5e69a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:04.304290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c984-023e-46d9-8640-256bb5e69a84 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:04.304566 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c984-023e-46d9-8640-256bb5e69a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:04.305098 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c984-023e-46d9-8640-256bb5e69a84 None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:04.306341 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15c984-023e-46d9-8640-256bb5e69a84 None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:04.308309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15c984-023e-46d9-8640-256bb5e69a84 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:04.310773 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 189/374] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:28:03 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:04.314315 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15c984-023e-46d9-8640-256bb5e69a84 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:04.368183 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:04.408648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93204692-ab45-4605-b38b-825945f83e74 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:04.464832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cef576-89a0-4bc2-8d9c-503c639d57c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:04.465694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cef576-89a0-4bc2-8d9c-503c639d57c7 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:04.465974 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cef576-89a0-4bc2-8d9c-503c639d57c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:04.466381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cef576-89a0-4bc2-8d9c-503c639d57c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:04.467278 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cef576-89a0-4bc2-8d9c-503c639d57c7 None admin] RBAC: Adding query filter params (group.id=b119914b23864753a220d9f1bc34bae9, role.id=b9c5d282a37c489e83eabbdd2b393dbf, scope.project.id=d636caf99d654f54ada4912b086ad3c6) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:04.467669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cef576-89a0-4bc2-8d9c-503c639d57c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:04.469709 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cef576-89a0-4bc2-8d9c-503c639d57c7 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:04.478969 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15c984-023e-46d9-8640-256bb5e69a84 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:04.483201 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 186/375] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Sep 7 16:28:04 2022] GET /identity/v3/role_assignments?group.id=b119914b23864753a220d9f1bc34bae9&scope.project.id=d636caf99d654f54ada4912b086ad3c6&role.id=b9c5d282a37c489e83eabbdd2b393dbf => generated 260 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:04.483952 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cef576-89a0-4bc2-8d9c-503c639d57c7 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:04.558162 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ed233-3c50-421f-8da1-169b9680aee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:04.559434 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed233-3c50-421f-8da1-169b9680aee2 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:04.559948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed233-3c50-421f-8da1-169b9680aee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:04.560416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed233-3c50-421f-8da1-169b9680aee2 None admin] PATH_INFO: `/v3/projects/ef7d1dd858dc44ab80c0562c9d3c8b52` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:04.566898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ed233-3c50-421f-8da1-169b9680aee2 None admin] RBAC: Authorizing `identity:get_project(project_id=ef7d1dd858dc44ab80c0562c9d3c8b52)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:04.568439 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ed233-3c50-421f-8da1-169b9680aee2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:04.571533 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 190/376] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:28:04 2022] GET /identity/v3/projects/ef7d1dd858dc44ab80c0562c9d3c8b52 => generated 344 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:04.584563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ed233-3c50-421f-8da1-169b9680aee2 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:04.590263 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:04.779766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ed233-3c50-421f-8da1-169b9680aee2 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:04.781270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cef576-89a0-4bc2-8d9c-503c639d57c7 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:04.782011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:04.873630 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fedc81-201b-4c57-852b-ced07da09438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:04.873630 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fedc81-201b-4c57-852b-ced07da09438 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:04.873630 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fedc81-201b-4c57-852b-ced07da09438 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:04.874131 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fedc81-201b-4c57-852b-ced07da09438 None admin] PATH_INFO: `/v3/groups/8122309d2b634bb8bb1ba95fc987e077` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:04.895947 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fedc81-201b-4c57-852b-ced07da09438 None admin] RBAC: Authorizing `identity:get_group(group_id=8122309d2b634bb8bb1ba95fc987e077)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:04.899253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fedc81-201b-4c57-852b-ced07da09438 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:04.899566 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca84dc-35a7-4aba-926b-e7fc9653c140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:04.900534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca84dc-35a7-4aba-926b-e7fc9653c140 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:04.900991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca84dc-35a7-4aba-926b-e7fc9653c140 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:04.901445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca84dc-35a7-4aba-926b-e7fc9653c140 None admin] PATH_INFO: `/v3/groups/b119914b23864753a220d9f1bc34bae9` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:04.904175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca84dc-35a7-4aba-926b-e7fc9653c140 None admin] RBAC: Authorizing `identity:get_group(group_id=b119914b23864753a220d9f1bc34bae9)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:04.906479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 191/377] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Sep 7 16:28:04 2022] GET /identity/v3/groups/8122309d2b634bb8bb1ba95fc987e077 => generated 229 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:28:04.906804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca84dc-35a7-4aba-926b-e7fc9653c140 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:04.909613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 187/378] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Sep 7 16:28:04 2022] GET /identity/v3/groups/b119914b23864753a220d9f1bc34bae9 => generated 226 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:04.913354 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1c480-4641-433d-9e69-bd4928ff6cb6 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:04.914222 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1c480-4641-433d-9e69-bd4928ff6cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:04.914983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1c480-4641-433d-9e69-bd4928ff6cb6 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:04.918867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 192/379] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:04.923409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca84dc-35a7-4aba-926b-e7fc9653c140 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:04.925384 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1c480-4641-433d-9e69-bd4928ff6cb6 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:05.158513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca84dc-35a7-4aba-926b-e7fc9653c140 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:05.200182 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:05.203045 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1c480-4641-433d-9e69-bd4928ff6cb6 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:05.244704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab419c-89d1-4a0c-82d9-d58b2f76f074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:05.246314 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab419c-89d1-4a0c-82d9-d58b2f76f074 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:05.247877 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab419c-89d1-4a0c-82d9-d58b2f76f074 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:05.248391 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab419c-89d1-4a0c-82d9-d58b2f76f074 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:05.249798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab419c-89d1-4a0c-82d9-d58b2f76f074 None admin] RBAC: Adding query filter params (group.id=b119914b23864753a220d9f1bc34bae9, role.id=e35c45d51df34051b68fa49475ac7250, scope.project.id=d636caf99d654f54ada4912b086ad3c6) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:05.250325 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab419c-89d1-4a0c-82d9-d58b2f76f074 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:05.254468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab419c-89d1-4a0c-82d9-d58b2f76f074 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:05.267690 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 188/380] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Sep 7 16:28:04 2022] GET /identity/v3/role_assignments?group.id=b119914b23864753a220d9f1bc34bae9&scope.project.id=d636caf99d654f54ada4912b086ad3c6&role.id=e35c45d51df34051b68fa49475ac7250 => generated 260 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:05.270398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924be8bd-8118-4f68-85a7-bfe02d0958bd None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:05.271121 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924be8bd-8118-4f68-85a7-bfe02d0958bd None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:05.271836 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924be8bd-8118-4f68-85a7-bfe02d0958bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:05.298593 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7adce9-2157-466e-aba2-0cd1f8bfffb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:05.299707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7adce9-2157-466e-aba2-0cd1f8bfffb4 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:05.300202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7adce9-2157-466e-aba2-0cd1f8bfffb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:05.300691 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7adce9-2157-466e-aba2-0cd1f8bfffb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:05.302098 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7adce9-2157-466e-aba2-0cd1f8bfffb4 None admin] RBAC: Adding query filter params (group.id=8122309d2b634bb8bb1ba95fc987e077, role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=ef7d1dd858dc44ab80c0562c9d3c8b52) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:05.302652 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7adce9-2157-466e-aba2-0cd1f8bfffb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:05.305501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7adce9-2157-466e-aba2-0cd1f8bfffb4 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:05.331923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 193/381] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Sep 7 16:28:04 2022] GET /identity/v3/role_assignments?group.id=8122309d2b634bb8bb1ba95fc987e077&scope.project.id=ef7d1dd858dc44ab80c0562c9d3c8b52&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 260 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:05.345459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-924be8bd-8118-4f68-85a7-bfe02d0958bd None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:05.347661 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-924be8bd-8118-4f68-85a7-bfe02d0958bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:05.516762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 189/382] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:05.615845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3a8c5-bc81-4eef-a543-428ee0c09740 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:05.616174 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3a8c5-bc81-4eef-a543-428ee0c09740 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:05.616394 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3a8c5-bc81-4eef-a543-428ee0c09740 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:05.617814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 194/383] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:28:05.625058 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d390c5-8be9-4540-8d20-e2c6d24558d6 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:05.625336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d390c5-8be9-4540-8d20-e2c6d24558d6 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:05.625606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d390c5-8be9-4540-8d20-e2c6d24558d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:05.650334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-98d390c5-8be9-4540-8d20-e2c6d24558d6 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:05.657563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-98d390c5-8be9-4540-8d20-e2c6d24558d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:05.752722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 190/384] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:06.030454 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3a8c5-bc81-4eef-a543-428ee0c09740 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:06.092204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:06.103320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d390c5-8be9-4540-8d20-e2c6d24558d6 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:06.191988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:06.205413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3a8c5-bc81-4eef-a543-428ee0c09740 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:06.276549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822786a-7054-44eb-8145-7e0f04dbebc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:06.277213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822786a-7054-44eb-8145-7e0f04dbebc7 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:06.278387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822786a-7054-44eb-8145-7e0f04dbebc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:06.278515 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822786a-7054-44eb-8145-7e0f04dbebc7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:06.291443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822786a-7054-44eb-8145-7e0f04dbebc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:06.302432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-a822786a-7054-44eb-8145-7e0f04dbebc7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:28:06.302432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:06.302432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:06.302432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:06.302432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:06.302432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:06.302432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:06.302432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:06.302432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:06.302432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:06.302432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:06.302432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:06.302432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:06.302432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:06.302432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:06.302432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:06.304143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:06.304143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:06.304143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:06.304143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:06.304143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:06.304143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:06.304143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:06.304143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:06.304143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:06.304143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:06.304143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:06.304143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:06.304143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:06.304143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:06.304143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:06.304143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:06.306567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:06.306567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:06.306567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:06.306567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:06.306567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:06.306567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:06.306567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:06.306567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:06.306567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:06.306567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:06.306567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:28:06.306567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:06.312255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 195/385] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:28:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:06.315434 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d390c5-8be9-4540-8d20-e2c6d24558d6 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:06.329162 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822786a-7054-44eb-8145-7e0f04dbebc7 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:06.370062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82d9da-a3d7-4078-9785-035fea6e21c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:06.370734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82d9da-a3d7-4078-9785-035fea6e21c7 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:06.371012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82d9da-a3d7-4078-9785-035fea6e21c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:06.371309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82d9da-a3d7-4078-9785-035fea6e21c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:06.393769 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82d9da-a3d7-4078-9785-035fea6e21c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:06.410073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-4d82d9da-a3d7-4078-9785-035fea6e21c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:28:06.410073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:06.410073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:06.410073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:06.410073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:06.410073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:06.410073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:06.410073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:06.410073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:06.410073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:06.410073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:06.410073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:06.410073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:06.410073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:06.410073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:06.410073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:06.411818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:06.411818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:06.411818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:06.411818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:06.411818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:06.411818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:06.411818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:06.411818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:06.411818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:06.411818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:06.411818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:06.411818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:06.411818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:06.411818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:06.411818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:06.411818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:06.413360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:06.413360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:06.413360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:06.413360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:06.413360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:06.413360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:06.413360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:06.413360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:06.413360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:06.413360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:06.413360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:28:06.413360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:06.413360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 191/386] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:28:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:06.420997 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82d9da-a3d7-4078-9785-035fea6e21c7 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:06.530953 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:06.547602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822786a-7054-44eb-8145-7e0f04dbebc7 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:06.608571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdb7cf-c868-4c2f-8360-1c00548fd54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:06.615519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdb7cf-c868-4c2f-8360-1c00548fd54f None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:06.615519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdb7cf-c868-4c2f-8360-1c00548fd54f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:06.615519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdb7cf-c868-4c2f-8360-1c00548fd54f None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:06.615519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdb7cf-c868-4c2f-8360-1c00548fd54f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:06.615519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdb7cf-c868-4c2f-8360-1c00548fd54f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:06.615519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdb7cf-c868-4c2f-8360-1c00548fd54f None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:06.635508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 196/387] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:06.639801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdb7cf-c868-4c2f-8360-1c00548fd54f None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:06.731888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:06.738476 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82d9da-a3d7-4078-9785-035fea6e21c7 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:06.808943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdb7cf-c868-4c2f-8360-1c00548fd54f None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:06.816526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a951fc-dfc5-419d-8623-53f20d9f0c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:06.817162 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a951fc-dfc5-419d-8623-53f20d9f0c12 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:06.817443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a951fc-dfc5-419d-8623-53f20d9f0c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:06.817719 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a951fc-dfc5-419d-8623-53f20d9f0c12 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:06.818403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a951fc-dfc5-419d-8623-53f20d9f0c12 None admin] RBAC: Adding query filter params (name=member) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:06.818709 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a951fc-dfc5-419d-8623-53f20d9f0c12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:06.820132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a951fc-dfc5-419d-8623-53f20d9f0c12 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:06.841440 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 192/388] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:28:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:28:06.848036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a951fc-dfc5-419d-8623-53f20d9f0c12 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:06.866490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714a8c7-6d8b-46a2-bb87-f1ceff19d630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:06.867134 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714a8c7-6d8b-46a2-bb87-f1ceff19d630 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:06.867412 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714a8c7-6d8b-46a2-bb87-f1ceff19d630 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:06.867711 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714a8c7-6d8b-46a2-bb87-f1ceff19d630 None admin] PATH_INFO: `/v3/groups/b119914b23864753a220d9f1bc34bae9` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:06.870651 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714a8c7-6d8b-46a2-bb87-f1ceff19d630 None admin] RBAC: Authorizing `identity:get_group(group_id=b119914b23864753a220d9f1bc34bae9)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:06.873228 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714a8c7-6d8b-46a2-bb87-f1ceff19d630 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:06.875110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 197/389] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Sep 7 16:28:06 2022] GET /identity/v3/groups/b119914b23864753a220d9f1bc34bae9 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:06.883770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714a8c7-6d8b-46a2-bb87-f1ceff19d630 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:06.932001 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:07.081173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714a8c7-6d8b-46a2-bb87-f1ceff19d630 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:07.094874 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a951fc-dfc5-419d-8623-53f20d9f0c12 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:07.128706 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674ebbc-0616-4ac2-80aa-af038f3c3421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:07.129363 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674ebbc-0616-4ac2-80aa-af038f3c3421 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:07.129678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674ebbc-0616-4ac2-80aa-af038f3c3421 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:07.130679 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674ebbc-0616-4ac2-80aa-af038f3c3421 None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:07.132005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674ebbc-0616-4ac2-80aa-af038f3c3421 None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:07.133526 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674ebbc-0616-4ac2-80aa-af038f3c3421 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:07.136333 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 198/390] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:28:06 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:07.143451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674ebbc-0616-4ac2-80aa-af038f3c3421 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:07.194762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482b9c9-bd2c-4155-ab84-a0365c1013af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:07.195623 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482b9c9-bd2c-4155-ab84-a0365c1013af None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:07.195761 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482b9c9-bd2c-4155-ab84-a0365c1013af None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:07.196142 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482b9c9-bd2c-4155-ab84-a0365c1013af None admin] PATH_INFO: `/v3/groups/b119914b23864753a220d9f1bc34bae9` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:07.197514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482b9c9-bd2c-4155-ab84-a0365c1013af None admin] RBAC: Authorizing `identity:get_group(group_id=b119914b23864753a220d9f1bc34bae9)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:07.198992 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482b9c9-bd2c-4155-ab84-a0365c1013af None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:07.206382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 193/391] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Sep 7 16:28:06 2022] GET /identity/v3/groups/b119914b23864753a220d9f1bc34bae9 => generated 226 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:07.215882 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482b9c9-bd2c-4155-ab84-a0365c1013af None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:07.335649 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:07.378407 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:07.409197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674ebbc-0616-4ac2-80aa-af038f3c3421 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:07.463501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253b131-15c4-4e41-b33e-acf91c13b58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:07.463501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253b131-15c4-4e41-b33e-acf91c13b58c None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:07.463501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253b131-15c4-4e41-b33e-acf91c13b58c None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:07.463501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253b131-15c4-4e41-b33e-acf91c13b58c None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8/groups/b119914b23864753a220d9f1bc34bae9/roles/e35c45d51df34051b68fa49475ac7250` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:07.463963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253b131-15c4-4e41-b33e-acf91c13b58c None admin] RBAC: Authorizing `identity:create_grant(project_id=76f48757de234b528b472ca888b7cff8, group_id=b119914b23864753a220d9f1bc34bae9, role_id=e35c45d51df34051b68fa49475ac7250)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:07.465628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253b131-15c4-4e41-b33e-acf91c13b58c None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:07.500472 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482b9c9-bd2c-4155-ab84-a0365c1013af None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:07.538667 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 199/392] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Sep 7 16:28:07 2022] PUT /identity/v3/projects/76f48757de234b528b472ca888b7cff8/groups/b119914b23864753a220d9f1bc34bae9/roles/e35c45d51df34051b68fa49475ac7250 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:28:07.553622 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b382a2-9b96-4820-a23e-3ef54fe8a302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:07.554342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b382a2-9b96-4820-a23e-3ef54fe8a302 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:07.554628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b382a2-9b96-4820-a23e-3ef54fe8a302 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:07.554906 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b382a2-9b96-4820-a23e-3ef54fe8a302 None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:07.556218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b382a2-9b96-4820-a23e-3ef54fe8a302 None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:07.560902 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b382a2-9b96-4820-a23e-3ef54fe8a302 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:07.561168 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 194/393] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:28:07 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:07.573007 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253b131-15c4-4e41-b33e-acf91c13b58c None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:07.762306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8133c9-1284-4afb-9b08-b504ae3ace35 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:07.762590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8133c9-1284-4afb-9b08-b504ae3ace35 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:07.762962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8133c9-1284-4afb-9b08-b504ae3ace35 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:07.764618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 195/394] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:28:07.765239 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253b131-15c4-4e41-b33e-acf91c13b58c None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:07.770358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacc88f-0853-4c3b-a265-e60c04a35c70 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:07.770928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacc88f-0853-4c3b-a265-e60c04a35c70 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:07.771523 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacc88f-0853-4c3b-a265-e60c04a35c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:07.810201 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05cdab-0cbe-4999-a54e-af93f1c68e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:07.810963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05cdab-0cbe-4999-a54e-af93f1c68e07 None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:07.811245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05cdab-0cbe-4999-a54e-af93f1c68e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:07.811548 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05cdab-0cbe-4999-a54e-af93f1c68e07 None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8/groups/b119914b23864753a220d9f1bc34bae9/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:07.812609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8eacc88f-0853-4c3b-a265-e60c04a35c70 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:07.813577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05cdab-0cbe-4999-a54e-af93f1c68e07 None admin] RBAC: Authorizing `identity:create_grant(project_id=76f48757de234b528b472ca888b7cff8, group_id=b119914b23864753a220d9f1bc34bae9, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:07.815065 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05cdab-0cbe-4999-a54e-af93f1c68e07 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:07.815594 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8eacc88f-0853-4c3b-a265-e60c04a35c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:07.920049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 200/395] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Sep 7 16:28:07 2022] PUT /identity/v3/projects/76f48757de234b528b472ca888b7cff8/groups/b119914b23864753a220d9f1bc34bae9/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:28:07.946543 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 196/396] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:08.261428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05cdab-0cbe-4999-a54e-af93f1c68e07 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:08.276332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:08.414239 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05cdab-0cbe-4999-a54e-af93f1c68e07 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:08.454274 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd536c-a01b-464c-ab98-e6c557829bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:08.455011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd536c-a01b-464c-ab98-e6c557829bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:08.455293 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd536c-a01b-464c-ab98-e6c557829bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:08.455590 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd536c-a01b-464c-ab98-e6c557829bd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:08.476779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd536c-a01b-464c-ab98-e6c557829bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:08.483516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-fddd536c-a01b-464c-ab98-e6c557829bd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:28:08.483516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:08.483516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:08.483516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:08.483516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:08.483516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:08.483516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:08.483516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:08.483516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:08.483516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:08.483516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:08.483516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:08.483516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:08.483516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:08.483516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:08.483516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:08.484507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:08.484507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:08.484507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:08.484507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:08.484507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:08.484507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:08.484507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:08.484507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:08.484507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:08.484507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:08.484507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:08.484507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:08.484507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:08.484507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:08.484507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:08.484507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:08.485313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:08.485313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:08.485313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:08.485313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:08.485313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:08.485313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:08.485313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:08.485313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:08.485313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:08.485313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:08.485313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:28:08.485313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:08.485313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 201/397] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:28:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:08.490875 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacc88f-0853-4c3b-a265-e60c04a35c70 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:08.537359 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:08.607109 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97f7c4-8551-4298-8d5a-94fc5dc0615a None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:08.607796 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97f7c4-8551-4298-8d5a-94fc5dc0615a None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:08.608276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97f7c4-8551-4298-8d5a-94fc5dc0615a None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:08.610461 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 202/398] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:08.616464 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f72a6e-e9c3-4085-a372-d7fc287b7f65 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:08.616756 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f72a6e-e9c3-4085-a372-d7fc287b7f65 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:08.617004 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f72a6e-e9c3-4085-a372-d7fc287b7f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:08.642647 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacc88f-0853-4c3b-a265-e60c04a35c70 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:08.672668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-68f72a6e-e9c3-4085-a372-d7fc287b7f65 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:08.673892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-68f72a6e-e9c3-4085-a372-d7fc287b7f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:08.680509 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e049a-27a1-4d60-b97f-d68f470bcf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:08.681139 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e049a-27a1-4d60-b97f-d68f470bcf77 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:08.681414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e049a-27a1-4d60-b97f-d68f470bcf77 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:08.681681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e049a-27a1-4d60-b97f-d68f470bcf77 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:08.682357 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e049a-27a1-4d60-b97f-d68f470bcf77 None admin] RBAC: Adding query filter params (name=member) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:08.682655 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e049a-27a1-4d60-b97f-d68f470bcf77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:08.684738 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e049a-27a1-4d60-b97f-d68f470bcf77 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:08.694501 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 197/399] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:28:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:08.704713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e049a-27a1-4d60-b97f-d68f470bcf77 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:08.802953 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:08.818124 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 203/400] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:08.819583 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:08.831634 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e049a-27a1-4d60-b97f-d68f470bcf77 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:08.880080 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e7fa5-785a-42b5-b1cb-b8fb237d9796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:08.880739 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e7fa5-785a-42b5-b1cb-b8fb237d9796 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:08.881012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e7fa5-785a-42b5-b1cb-b8fb237d9796 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:08.881282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e7fa5-785a-42b5-b1cb-b8fb237d9796 None admin] PATH_INFO: `/v3/groups/b119914b23864753a220d9f1bc34bae9` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:08.882535 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e7fa5-785a-42b5-b1cb-b8fb237d9796 None admin] RBAC: Authorizing `identity:get_group(group_id=b119914b23864753a220d9f1bc34bae9)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:08.884052 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e7fa5-785a-42b5-b1cb-b8fb237d9796 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:08.885930 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 198/401] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Sep 7 16:28:08 2022] GET /identity/v3/groups/b119914b23864753a220d9f1bc34bae9 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:08.892323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f72a6e-e9c3-4085-a372-d7fc287b7f65 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:08.979995 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9c388-3299-4d30-bc0d-f20cb8e5dfd1 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:08.980431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9c388-3299-4d30-bc0d-f20cb8e5dfd1 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:08.980752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9c388-3299-4d30-bc0d-f20cb8e5dfd1 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:08.982340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 199/402] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:28:08.987920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6f6c0-d8a9-4ea9-a77f-293b9118fd4c None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:08.988263 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6f6c0-d8a9-4ea9-a77f-293b9118fd4c None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:08.988526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6f6c0-d8a9-4ea9-a77f-293b9118fd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:09.024531 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-d7e6f6c0-d8a9-4ea9-a77f-293b9118fd4c None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:09.025737 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-d7e6f6c0-d8a9-4ea9-a77f-293b9118fd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:09.055885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f72a6e-e9c3-4085-a372-d7fc287b7f65 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:09.125228 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6ed3a-5183-4b89-ab66-f9e974ae1d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:09.126267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6ed3a-5183-4b89-ab66-f9e974ae1d4b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:09.126744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6ed3a-5183-4b89-ab66-f9e974ae1d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:09.127225 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6ed3a-5183-4b89-ab66-f9e974ae1d4b None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:09.129341 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6ed3a-5183-4b89-ab66-f9e974ae1d4b None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:09.132247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6ed3a-5183-4b89-ab66-f9e974ae1d4b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:09.136175 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 204/403] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:28:08 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:09.142810 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6ed3a-5183-4b89-ab66-f9e974ae1d4b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:09.192163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 200/404] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:28:09.193984 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6f6c0-d8a9-4ea9-a77f-293b9118fd4c None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:09.347127 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:09.411888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:09.428622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6ed3a-5183-4b89-ab66-f9e974ae1d4b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:09.443060 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6f6c0-d8a9-4ea9-a77f-293b9118fd4c None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:09.503728 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641a9d9-4461-482b-a2b0-3bf8c2004b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:09.505130 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641a9d9-4461-482b-a2b0-3bf8c2004b41 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:09.505130 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641a9d9-4461-482b-a2b0-3bf8c2004b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:09.505130 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641a9d9-4461-482b-a2b0-3bf8c2004b41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:09.506034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd686f-92ca-4fb0-9fa6-484256dc0b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:09.509402 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd686f-92ca-4fb0-9fa6-484256dc0b4c None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:09.509402 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd686f-92ca-4fb0-9fa6-484256dc0b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:09.509402 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd686f-92ca-4fb0-9fa6-484256dc0b4c None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6/groups/b119914b23864753a220d9f1bc34bae9/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:09.511381 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd686f-92ca-4fb0-9fa6-484256dc0b4c None admin] RBAC: Authorizing `identity:create_grant(project_id=d636caf99d654f54ada4912b086ad3c6, group_id=b119914b23864753a220d9f1bc34bae9, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:09.515570 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd686f-92ca-4fb0-9fa6-484256dc0b4c None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:09.525051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641a9d9-4461-482b-a2b0-3bf8c2004b41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:09.533844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-8641a9d9-4461-482b-a2b0-3bf8c2004b41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:28:09.533844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:09.533844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:09.533844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:09.533844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:09.533844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:09.533844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:09.533844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:09.533844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:09.533844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:09.533844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:09.533844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:09.533844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:09.533844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:09.533844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:09.533844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:09.545552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:09.545552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:09.545552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:09.545552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:09.545552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:09.545552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:09.545552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:09.545552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:09.545552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:09.545552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:09.545552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:09.545552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:09.545552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:09.545552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:09.545552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:09.545552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:09.548825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:09.548825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:09.548825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:09.548825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:09.548825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:09.548825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:09.548825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:09.548825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:09.548825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:09.548825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:09.548825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:28:09.548825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:09.548825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 201/405] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:28:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:09.548825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641a9d9-4461-482b-a2b0-3bf8c2004b41 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:09.656796 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 205/406] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Sep 7 16:28:09 2022] PUT /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6/groups/b119914b23864753a220d9f1bc34bae9/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:28:09.659229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd686f-92ca-4fb0-9fa6-484256dc0b4c None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:09.789013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd686f-92ca-4fb0-9fa6-484256dc0b4c None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:09.823706 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:09.835241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641a9d9-4461-482b-a2b0-3bf8c2004b41 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:09.835940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5b291-bc7c-4c2a-8fad-c0f7e1830cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:09.838454 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5b291-bc7c-4c2a-8fad-c0f7e1830cdf None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:09.838454 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5b291-bc7c-4c2a-8fad-c0f7e1830cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:09.838454 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5b291-bc7c-4c2a-8fad-c0f7e1830cdf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:09.852312 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5b291-bc7c-4c2a-8fad-c0f7e1830cdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:09.860289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-13e5b291-bc7c-4c2a-8fad-c0f7e1830cdf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:28:09.860289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:09.860289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:09.860289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:09.860289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:09.860289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:09.860289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:09.860289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:09.860289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:09.860289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:09.860289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:09.860289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:09.860289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:09.860289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:09.860289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:09.860289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:09.861387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:09.861387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:09.861387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:09.861387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:09.861387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:09.861387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:09.861387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:09.861387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:09.861387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:09.861387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:09.861387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:09.861387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:09.861387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:09.861387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:09.861387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:09.861387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:09.862217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:09.862217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:09.862217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:09.862217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:09.862217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:09.862217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:09.862217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:09.862217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:09.862217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:09.862217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:09.862217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:28:09.862217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:09.864597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 206/407] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:28:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:09.870833 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5b291-bc7c-4c2a-8fad-c0f7e1830cdf None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:09.983584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762f2df-e150-4fc3-9584-b05075015d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:09.984560 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762f2df-e150-4fc3-9584-b05075015d99 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:09.985043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762f2df-e150-4fc3-9584-b05075015d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:09.985787 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762f2df-e150-4fc3-9584-b05075015d99 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:09.986760 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762f2df-e150-4fc3-9584-b05075015d99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:09.987301 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762f2df-e150-4fc3-9584-b05075015d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:09.990035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762f2df-e150-4fc3-9584-b05075015d99 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:10.004921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5b291-bc7c-4c2a-8fad-c0f7e1830cdf None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:10.027629 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 202/408] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:28:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:28:10.038832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762f2df-e150-4fc3-9584-b05075015d99 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:10.054171 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefa2b8-1a7d-4dda-a0bc-d717a285f3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:10.055296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefa2b8-1a7d-4dda-a0bc-d717a285f3ba None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:10.055868 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefa2b8-1a7d-4dda-a0bc-d717a285f3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:10.056414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefa2b8-1a7d-4dda-a0bc-d717a285f3ba None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:10.060073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:10.062106 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefa2b8-1a7d-4dda-a0bc-d717a285f3ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:10.062899 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefa2b8-1a7d-4dda-a0bc-d717a285f3ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:10.065994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefa2b8-1a7d-4dda-a0bc-d717a285f3ba None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:10.082859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 207/409] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:10.089128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefa2b8-1a7d-4dda-a0bc-d717a285f3ba None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:10.148101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:10.202648 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefa2b8-1a7d-4dda-a0bc-d717a285f3ba None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:10.261063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1136386-8220-419b-a8c9-74640a6646ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:10.262390 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1136386-8220-419b-a8c9-74640a6646ba None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:10.262873 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1136386-8220-419b-a8c9-74640a6646ba None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:10.263512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1136386-8220-419b-a8c9-74640a6646ba None admin] PATH_INFO: `/v3/groups/b119914b23864753a220d9f1bc34bae9` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:10.265053 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1136386-8220-419b-a8c9-74640a6646ba None admin] RBAC: Authorizing `identity:get_group(group_id=b119914b23864753a220d9f1bc34bae9)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:10.266785 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1136386-8220-419b-a8c9-74640a6646ba None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:10.269011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 208/410] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Sep 7 16:28:10 2022] GET /identity/v3/groups/b119914b23864753a220d9f1bc34bae9 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:28:10.275096 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1136386-8220-419b-a8c9-74640a6646ba None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:10.326558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762f2df-e150-4fc3-9584-b05075015d99 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:10.411733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1136386-8220-419b-a8c9-74640a6646ba None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:10.426126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd1f1e-074a-4b58-9bca-853284d57743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:10.427212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd1f1e-074a-4b58-9bca-853284d57743 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:10.427706 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd1f1e-074a-4b58-9bca-853284d57743 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:10.428156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd1f1e-074a-4b58-9bca-853284d57743 None admin] PATH_INFO: `/v3/groups/8122309d2b634bb8bb1ba95fc987e077` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:10.429717 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd1f1e-074a-4b58-9bca-853284d57743 None admin] RBAC: Authorizing `identity:get_group(group_id=8122309d2b634bb8bb1ba95fc987e077)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:10.431500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd1f1e-074a-4b58-9bca-853284d57743 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:10.436626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 203/411] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Sep 7 16:28:10 2022] GET /identity/v3/groups/8122309d2b634bb8bb1ba95fc987e077 => generated 229 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:28:10.442517 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd1f1e-074a-4b58-9bca-853284d57743 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:10.456000 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:10.495584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a1f08-6792-404d-9404-9435714de45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:10.497040 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a1f08-6792-404d-9404-9435714de45b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:10.497040 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a1f08-6792-404d-9404-9435714de45b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:10.497040 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a1f08-6792-404d-9404-9435714de45b None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:10.499935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a1f08-6792-404d-9404-9435714de45b None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:10.501579 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a1f08-6792-404d-9404-9435714de45b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:10.504950 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 209/412] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:28:10 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:10.515082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a1f08-6792-404d-9404-9435714de45b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:10.632063 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:10.684537 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd1f1e-074a-4b58-9bca-853284d57743 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:10.738780 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a1f08-6792-404d-9404-9435714de45b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:10.763081 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adc2bd-0a19-4dbc-91d9-da6bc5028238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:10.763081 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc2bd-0a19-4dbc-91d9-da6bc5028238 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:10.763640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc2bd-0a19-4dbc-91d9-da6bc5028238 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:10.763780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc2bd-0a19-4dbc-91d9-da6bc5028238 None admin] PATH_INFO: `/v3/projects/ef7d1dd858dc44ab80c0562c9d3c8b52` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:10.764934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adc2bd-0a19-4dbc-91d9-da6bc5028238 None admin] RBAC: Authorizing `identity:get_project(project_id=ef7d1dd858dc44ab80c0562c9d3c8b52)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:10.766462 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adc2bd-0a19-4dbc-91d9-da6bc5028238 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:10.773383 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 204/413] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:28:10 2022] GET /identity/v3/projects/ef7d1dd858dc44ab80c0562c9d3c8b52 => generated 344 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:28:10.778976 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adc2bd-0a19-4dbc-91d9-da6bc5028238 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:10.818548 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db2eb8-bce6-43d3-84cc-a6a3dc8486f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:10.819230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db2eb8-bce6-43d3-84cc-a6a3dc8486f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:10.819528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db2eb8-bce6-43d3-84cc-a6a3dc8486f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:10.819798 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db2eb8-bce6-43d3-84cc-a6a3dc8486f4 None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6/groups/b119914b23864753a220d9f1bc34bae9/roles/e35c45d51df34051b68fa49475ac7250` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:10.826393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db2eb8-bce6-43d3-84cc-a6a3dc8486f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d636caf99d654f54ada4912b086ad3c6, group_id=b119914b23864753a220d9f1bc34bae9, role_id=e35c45d51df34051b68fa49475ac7250)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:10.827334 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db2eb8-bce6-43d3-84cc-a6a3dc8486f4 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:10.916590 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 210/414] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Sep 7 16:28:10 2022] PUT /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6/groups/b119914b23864753a220d9f1bc34bae9/roles/e35c45d51df34051b68fa49475ac7250 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:28:10.934451 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adc2bd-0a19-4dbc-91d9-da6bc5028238 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:10.998036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46011939-0529-4a04-bfd5-b14f37994b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:10.998724 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46011939-0529-4a04-bfd5-b14f37994b00 None admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:10.999002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46011939-0529-4a04-bfd5-b14f37994b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:10.999279 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46011939-0529-4a04-bfd5-b14f37994b00 None admin] PATH_INFO: `/v3/projects/ef7d1dd858dc44ab80c0562c9d3c8b52/groups/8122309d2b634bb8bb1ba95fc987e077/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:11.001273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46011939-0529-4a04-bfd5-b14f37994b00 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef7d1dd858dc44ab80c0562c9d3c8b52, group_id=8122309d2b634bb8bb1ba95fc987e077, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:11.002724 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46011939-0529-4a04-bfd5-b14f37994b00 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:11.096475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 205/415] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Sep 7 16:28:10 2022] PUT /identity/v3/projects/ef7d1dd858dc44ab80c0562c9d3c8b52/groups/8122309d2b634bb8bb1ba95fc987e077/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:28:11.297943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6732-ac1c-4708-b83a-9a625ec8e897 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:11.298321 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6732-ac1c-4708-b83a-9a625ec8e897 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:11.298492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6732-ac1c-4708-b83a-9a625ec8e897 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:11.299896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 211/416] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:11.310440 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f1e13-c160-4463-99df-8a759d0122b4 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:11.310906 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f1e13-c160-4463-99df-8a759d0122b4 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:11.311372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f1e13-c160-4463-99df-8a759d0122b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:11.341164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:11.350759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-de2f1e13-c160-4463-99df-8a759d0122b4 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:11.353127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-de2f1e13-c160-4463-99df-8a759d0122b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:11.526161 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 206/417] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:11.582431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134ea1d-21fa-425a-a4fe-d718f2ae062e None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:11.582979 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134ea1d-21fa-425a-a4fe-d718f2ae062e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:11.583378 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134ea1d-21fa-425a-a4fe-d718f2ae062e None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:11.585990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 212/418] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:11.593403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bae6b3-be78-46fb-a0e3-ac277d937c91 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:11.593987 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bae6b3-be78-46fb-a0e3-ac277d937c91 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:11.594480 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bae6b3-be78-46fb-a0e3-ac277d937c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:11.629351 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f7bae6b3-be78-46fb-a0e3-ac277d937c91 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:11.631302 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f7bae6b3-be78-46fb-a0e3-ac277d937c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:11.765851 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 207/419] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:11.946579 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134ea1d-21fa-425a-a4fe-d718f2ae062e None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:12.052403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:12.165828 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134ea1d-21fa-425a-a4fe-d718f2ae062e None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:12.208612 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bae6b3-be78-46fb-a0e3-ac277d937c91 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:12.278884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383692d7-6a10-45d8-bbd5-59c81f2f4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:12.280602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383692d7-6a10-45d8-bbd5-59c81f2f4b05 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:12.281408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383692d7-6a10-45d8-bbd5-59c81f2f4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:12.282198 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383692d7-6a10-45d8-bbd5-59c81f2f4b05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:12.312577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383692d7-6a10-45d8-bbd5-59c81f2f4b05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:12.334414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-383692d7-6a10-45d8-bbd5-59c81f2f4b05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:28:12.334414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:12.334414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:12.334414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:12.334414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:12.334414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:12.334414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:12.334414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:12.334414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:12.334414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:12.334414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:12.334414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:12.334414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:12.334414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:12.334414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:12.334414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:12.336232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:12.336232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:12.336232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:12.336232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:12.336232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:12.336232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:12.336232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:12.336232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:12.336232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:12.336232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:12.336232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:12.336232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:12.336232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:12.336232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:12.336232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:12.336232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:12.337816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:12.337816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:12.337816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:12.337816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:12.337816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:12.337816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:12.337816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:12.337816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:12.337816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:12.337816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:12.337816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:28:12.337816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:12.350951 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 213/420] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:28:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:12.358505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383692d7-6a10-45d8-bbd5-59c81f2f4b05 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:12.427608 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:12.557282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bae6b3-be78-46fb-a0e3-ac277d937c91 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:12.671430 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383692d7-6a10-45d8-bbd5-59c81f2f4b05 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:12.697934 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:12.699408 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8e172-b4a0-43c0-8362-422ea85c0b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:12.700719 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8e172-b4a0-43c0-8362-422ea85c0b5c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:12.701244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8e172-b4a0-43c0-8362-422ea85c0b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:12.702126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8e172-b4a0-43c0-8362-422ea85c0b5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:12.738980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d6b53-f1cc-40e3-b6b8-69e29b7b771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:12.741025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d6b53-f1cc-40e3-b6b8-69e29b7b771d None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:12.741798 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d6b53-f1cc-40e3-b6b8-69e29b7b771d None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:12.742563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d6b53-f1cc-40e3-b6b8-69e29b7b771d None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:12.744157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d6b53-f1cc-40e3-b6b8-69e29b7b771d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:12.744998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d6b53-f1cc-40e3-b6b8-69e29b7b771d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:12.748768 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d6b53-f1cc-40e3-b6b8-69e29b7b771d None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:12.752991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8e172-b4a0-43c0-8362-422ea85c0b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:12.766916 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 214/421] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:12.770881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-88b8e172-b4a0-43c0-8362-422ea85c0b5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:28:12.770881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:12.770881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:12.770881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:12.770881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:12.770881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:12.770881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:12.770881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:12.770881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:12.770881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:12.770881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:12.770881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:12.770881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:12.770881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:12.770881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:12.770881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:12.773187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:12.773187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:12.773187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:12.773187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:12.773187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:12.773187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:12.773187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:12.773187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:12.773187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:12.773187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:12.773187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:12.773187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:12.773187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:12.773187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:12.773187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:12.773187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:12.774811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:12.774811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:12.774811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:12.774811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:12.774811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:12.774811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:12.774811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:12.774811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:12.774811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:12.774811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:12.774811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:28:12.774811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:12.774811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 208/422] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:28:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 566 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:12.780457 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d6b53-f1cc-40e3-b6b8-69e29b7b771d None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:12.781101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8e172-b4a0-43c0-8362-422ea85c0b5c None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:13.015650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8e172-b4a0-43c0-8362-422ea85c0b5c None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:13.067898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:13.081966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac8c79-3aa0-4bd2-84fd-5762db020fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:13.083070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac8c79-3aa0-4bd2-84fd-5762db020fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:13.083583 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac8c79-3aa0-4bd2-84fd-5762db020fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:13.084163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac8c79-3aa0-4bd2-84fd-5762db020fb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:13.085424 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac8c79-3aa0-4bd2-84fd-5762db020fb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:13.085965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac8c79-3aa0-4bd2-84fd-5762db020fb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:13.088795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac8c79-3aa0-4bd2-84fd-5762db020fb1 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:13.094765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d6b53-f1cc-40e3-b6b8-69e29b7b771d None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:13.106406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 209/423] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:28:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:13.124568 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac8c79-3aa0-4bd2-84fd-5762db020fb1 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:13.217472 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef4b97-8304-444c-abac-742ea48b4cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:13.218518 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef4b97-8304-444c-abac-742ea48b4cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:13.219010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef4b97-8304-444c-abac-742ea48b4cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:13.219516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef4b97-8304-444c-abac-742ea48b4cb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:13.336170 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:13.382053 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac8c79-3aa0-4bd2-84fd-5762db020fb1 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:13.413005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef4b97-8304-444c-abac-742ea48b4cb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:13.415720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef4b97-8304-444c-abac-742ea48b4cb5 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:13.513710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3692c8-dc4a-4912-96a0-470337e8cada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:13.515258 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3692c8-dc4a-4912-96a0-470337e8cada None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:13.516099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3692c8-dc4a-4912-96a0-470337e8cada None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:13.516955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3692c8-dc4a-4912-96a0-470337e8cada None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:13.615611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 215/424] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 833 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:13.621298 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef4b97-8304-444c-abac-742ea48b4cb5 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:13.749691 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:13.778070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:13.820286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef4b97-8304-444c-abac-742ea48b4cb5 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:13.831316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3692c8-dc4a-4912-96a0-470337e8cada None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:13.838247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3692c8-dc4a-4912-96a0-470337e8cada None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:13.901402 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4df827-b6e1-4c16-97dc-144dfce5fc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:13.903216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4df827-b6e1-4c16-97dc-144dfce5fc65 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:13.903216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4df827-b6e1-4c16-97dc-144dfce5fc65 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:13.905106 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4df827-b6e1-4c16-97dc-144dfce5fc65 None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:13.911776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4df827-b6e1-4c16-97dc-144dfce5fc65 None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:13.914625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4df827-b6e1-4c16-97dc-144dfce5fc65 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:13.918438 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 216/425] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:28:13 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:28:13.927499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4df827-b6e1-4c16-97dc-144dfce5fc65 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:14.139932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4df827-b6e1-4c16-97dc-144dfce5fc65 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:14.169073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 210/426] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1045 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 16:28:14.171309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75d6a7-104c-4bd1-8860-eff3fe17dde7 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:14.171852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75d6a7-104c-4bd1-8860-eff3fe17dde7 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:14.172334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75d6a7-104c-4bd1-8860-eff3fe17dde7 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:14.175414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 211/427] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:14.181397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec3afd-0152-40a6-bef1-0b009ab99230 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:14.182047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec3afd-0152-40a6-bef1-0b009ab99230 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:14.182547 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec3afd-0152-40a6-bef1-0b009ab99230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:14.208268 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-3eec3afd-0152-40a6-bef1-0b009ab99230 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:14.210052 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3eec3afd-0152-40a6-bef1-0b009ab99230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:14.216141 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5ce31-dc52-4456-8f8a-609b21d074bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:14.216832 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5ce31-dc52-4456-8f8a-609b21d074bc None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:14.217142 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5ce31-dc52-4456-8f8a-609b21d074bc None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:14.217452 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5ce31-dc52-4456-8f8a-609b21d074bc None admin] PATH_INFO: `/v3/groups/b119914b23864753a220d9f1bc34bae9` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:14.218670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5ce31-dc52-4456-8f8a-609b21d074bc None admin] RBAC: Authorizing `identity:get_group(group_id=b119914b23864753a220d9f1bc34bae9)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:14.220250 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5ce31-dc52-4456-8f8a-609b21d074bc None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:14.222018 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 217/428] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Sep 7 16:28:13 2022] GET /identity/v3/groups/b119914b23864753a220d9f1bc34bae9 => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:28:14.223354 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5ce31-dc52-4456-8f8a-609b21d074bc None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:14.231796 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:14.321548 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 212/429] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:28:14.323436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bc9d0-4fb3-4da2-bf73-2fbe61676d95 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:14.323906 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bc9d0-4fb3-4da2-bf73-2fbe61676d95 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:14.324999 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bc9d0-4fb3-4da2-bf73-2fbe61676d95 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:14.326472 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 213/430] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:14.327232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bc9d0-4fb3-4da2-bf73-2fbe61676d95 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:14.350662 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:14.404080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5ce31-dc52-4456-8f8a-609b21d074bc None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:14.453982 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee26ff9-da9c-4bb5-be0c-cfb32b49e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:14.454932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee26ff9-da9c-4bb5-be0c-cfb32b49e9ce None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:14.455360 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee26ff9-da9c-4bb5-be0c-cfb32b49e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:14.455617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bc9d0-4fb3-4da2-bf73-2fbe61676d95 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:14.455994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee26ff9-da9c-4bb5-be0c-cfb32b49e9ce None admin] PATH_INFO: `/v3/projects/76f48757de234b528b472ca888b7cff8` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:14.457529 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee26ff9-da9c-4bb5-be0c-cfb32b49e9ce None admin] RBAC: Authorizing `identity:get_project(project_id=76f48757de234b528b472ca888b7cff8)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:14.460204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee26ff9-da9c-4bb5-be0c-cfb32b49e9ce None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:14.462509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 218/431] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:28:14 2022] GET /identity/v3/projects/76f48757de234b528b472ca888b7cff8 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:14.464043 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39ab30-b200-4052-b855-c47cd1181868 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:14.464610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39ab30-b200-4052-b855-c47cd1181868 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:14.465088 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39ab30-b200-4052-b855-c47cd1181868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:14.488419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-bd39ab30-b200-4052-b855-c47cd1181868 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:14.490803 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-bd39ab30-b200-4052-b855-c47cd1181868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:14.515551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019d074-6802-44d3-ab99-b5b44e5846ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:14.516459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019d074-6802-44d3-ab99-b5b44e5846ae None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:14.516895 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019d074-6802-44d3-ab99-b5b44e5846ae None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:14.517367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019d074-6802-44d3-ab99-b5b44e5846ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:14.519155 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019d074-6802-44d3-ab99-b5b44e5846ae None admin] RBAC: Adding query filter params (group.id=b119914b23864753a220d9f1bc34bae9, role.id=e35c45d51df34051b68fa49475ac7250, scope.project.id=76f48757de234b528b472ca888b7cff8) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:14.519783 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019d074-6802-44d3-ab99-b5b44e5846ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:14.524001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019d074-6802-44d3-ab99-b5b44e5846ae None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:14.538053 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 214/432] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Sep 7 16:28:14 2022] GET /identity/v3/role_assignments?group.id=b119914b23864753a220d9f1bc34bae9&scope.project.id=76f48757de234b528b472ca888b7cff8&role.id=e35c45d51df34051b68fa49475ac7250 => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:14.539968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019d074-6802-44d3-ab99-b5b44e5846ae None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:14.573040 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:14.579678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 219/433] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:14.670954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:14.692971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019d074-6802-44d3-ab99-b5b44e5846ae None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:14.725973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39ab30-b200-4052-b855-c47cd1181868 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:14.736416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2a807-7795-44c1-8874-3efdd031c4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:14.737532 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2a807-7795-44c1-8874-3efdd031c4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:14.738019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2a807-7795-44c1-8874-3efdd031c4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:14.738512 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2a807-7795-44c1-8874-3efdd031c4e7 None admin] PATH_INFO: `/v3/groups/b119914b23864753a220d9f1bc34bae9` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:14.740790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2a807-7795-44c1-8874-3efdd031c4e7 None admin] RBAC: Authorizing `identity:get_group(group_id=b119914b23864753a220d9f1bc34bae9)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:14.743785 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2a807-7795-44c1-8874-3efdd031c4e7 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:14.747124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 215/434] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Sep 7 16:28:14 2022] GET /identity/v3/groups/b119914b23864753a220d9f1bc34bae9 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:14.754020 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2a807-7795-44c1-8874-3efdd031c4e7 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:14.907891 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39ab30-b200-4052-b855-c47cd1181868 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:14.924867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2a807-7795-44c1-8874-3efdd031c4e7 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:14.964775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c416e94-3dff-4882-a03a-e18865734c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:14.965938 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c416e94-3dff-4882-a03a-e18865734c30 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:14.966202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c416e94-3dff-4882-a03a-e18865734c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:14.966482 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c416e94-3dff-4882-a03a-e18865734c30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:14.967308 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c416e94-3dff-4882-a03a-e18865734c30 None admin] RBAC: Adding query filter params (group.id=b119914b23864753a220d9f1bc34bae9, role.id=b9c5d282a37c489e83eabbdd2b393dbf, scope.project.id=76f48757de234b528b472ca888b7cff8) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:14.967644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c416e94-3dff-4882-a03a-e18865734c30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:14.969089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c416e94-3dff-4882-a03a-e18865734c30 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:14.975317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5f4ac-d907-4f5b-982c-6efef9757507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:14.975908 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 216/435] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Sep 7 16:28:14 2022] GET /identity/v3/role_assignments?group.id=b119914b23864753a220d9f1bc34bae9&scope.project.id=76f48757de234b528b472ca888b7cff8&role.id=b9c5d282a37c489e83eabbdd2b393dbf => generated 611 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:14.978396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f712835-47dd-4c21-b2b6-6d3c63c1e8f1 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:14.978396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f712835-47dd-4c21-b2b6-6d3c63c1e8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:14.978396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f712835-47dd-4c21-b2b6-6d3c63c1e8f1 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:14.984174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 217/436] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:14.986744 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfb83a-d00b-487a-85d5-556cfe48609d None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:14.987124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfb83a-d00b-487a-85d5-556cfe48609d None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:14.987509 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfb83a-d00b-487a-85d5-556cfe48609d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:14.987698 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5f4ac-d907-4f5b-982c-6efef9757507 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:14.987941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5f4ac-d907-4f5b-982c-6efef9757507 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:14.988219 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5f4ac-d907-4f5b-982c-6efef9757507 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:15.002918 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5f4ac-d907-4f5b-982c-6efef9757507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:15.007942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-fdb5f4ac-d907-4f5b-982c-6efef9757507 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:28:15.007942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:15.007942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:15.007942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:15.007942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:15.007942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:15.007942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:15.007942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:15.007942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:15.007942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:15.007942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:15.007942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:15.007942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:15.007942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:15.007942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:15.007942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:15.008990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:15.008990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:15.008990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:15.008990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:15.008990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:15.008990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:15.008990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:15.008990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:15.008990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:15.008990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:15.008990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:15.008990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:15.008990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:15.008990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:15.008990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:15.008990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:15.014887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:15.014887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:15.014887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:15.014887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:15.014887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:15.014887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:15.014887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:15.014887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:15.014887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:15.014887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:15.014887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:28:15.014887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:15.014887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 220/437] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:28:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:15.014887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5f4ac-d907-4f5b-982c-6efef9757507 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:15.016700 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-37bfb83a-d00b-487a-85d5-556cfe48609d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:15.018094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-37bfb83a-d00b-487a-85d5-556cfe48609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:15.032287 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:15.099417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:15.135568 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 218/438] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:15.137092 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfb83a-d00b-487a-85d5-556cfe48609d None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:15.181519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5f4ac-d907-4f5b-982c-6efef9757507 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:15.238109 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4727a91-d414-4230-bcf8-6ac7a2770b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:15.238761 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4727a91-d414-4230-bcf8-6ac7a2770b4f None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:15.239040 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4727a91-d414-4230-bcf8-6ac7a2770b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:15.239972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4727a91-d414-4230-bcf8-6ac7a2770b4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:15.259648 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4727a91-d414-4230-bcf8-6ac7a2770b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:15.268211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-c4727a91-d414-4230-bcf8-6ac7a2770b4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:28:15.268211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:15.268211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:15.268211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:15.268211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:15.268211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:15.268211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:15.268211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:15.268211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:15.268211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:15.268211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:15.268211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:15.268211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:15.268211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:15.268211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:15.268211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:15.269172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:15.269172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:15.269172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:15.269172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:15.269172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:15.269172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:15.269172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:15.269172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:15.269172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:15.269172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:15.269172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:15.269172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:15.269172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:15.269172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:15.269172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:15.269172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:15.269987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:15.269987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:15.269987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:15.269987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:15.269987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:15.269987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:15.269987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:15.269987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:15.269987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:15.269987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:15.269987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 16:28:15.269987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:15.269987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 221/439] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:28:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:15.276353 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4727a91-d414-4230-bcf8-6ac7a2770b4f None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:15.308667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfb83a-d00b-487a-85d5-556cfe48609d None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:15.367803 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d767aa4-36b5-4a43-8ea8-cd400737c5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:15.367803 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d767aa4-36b5-4a43-8ea8-cd400737c5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:15.368098 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d767aa4-36b5-4a43-8ea8-cd400737c5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:15.368454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d767aa4-36b5-4a43-8ea8-cd400737c5d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:15.370934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d767aa4-36b5-4a43-8ea8-cd400737c5d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:15.370934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d767aa4-36b5-4a43-8ea8-cd400737c5d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:15.372502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d767aa4-36b5-4a43-8ea8-cd400737c5d2 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:15.384970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 219/440] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:28:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:15.394879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d767aa4-36b5-4a43-8ea8-cd400737c5d2 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:15.413932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:15.437689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4727a91-d414-4230-bcf8-6ac7a2770b4f None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:15.466408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:15.486233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ede239-2a6c-41d0-ae28-a1341bb42d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:15.487265 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ede239-2a6c-41d0-ae28-a1341bb42d6f None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:15.487593 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ede239-2a6c-41d0-ae28-a1341bb42d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:15.487832 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ede239-2a6c-41d0-ae28-a1341bb42d6f None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:15.488589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ede239-2a6c-41d0-ae28-a1341bb42d6f None admin] RBAC: Adding query filter params (name=member) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:15.488833 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ede239-2a6c-41d0-ae28-a1341bb42d6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:15.490211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ede239-2a6c-41d0-ae28-a1341bb42d6f None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:15.500691 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 222/441] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:28:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:28:15.502091 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ede239-2a6c-41d0-ae28-a1341bb42d6f None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:15.544528 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d767aa4-36b5-4a43-8ea8-cd400737c5d2 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:15.592531 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be56f7c-f767-478f-a057-8e4c98f0c7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:15.593163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be56f7c-f767-478f-a057-8e4c98f0c7ad None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:15.593432 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be56f7c-f767-478f-a057-8e4c98f0c7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:15.593702 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be56f7c-f767-478f-a057-8e4c98f0c7ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:15.647358 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ede239-2a6c-41d0-ae28-a1341bb42d6f None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:15.697509 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be56f7c-f767-478f-a057-8e4c98f0c7ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:15.699597 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be56f7c-f767-478f-a057-8e4c98f0c7ad None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:15.706899 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069038d7-d331-4da3-8eb3-0782425872c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:15.707555 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069038d7-d331-4da3-8eb3-0782425872c6 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:15.707838 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069038d7-d331-4da3-8eb3-0782425872c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:15.708105 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069038d7-d331-4da3-8eb3-0782425872c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:15.712295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:15.722758 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069038d7-d331-4da3-8eb3-0782425872c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:15.728425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-069038d7-d331-4da3-8eb3-0782425872c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:28:15.728425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:15.728425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:15.728425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:15.728425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:15.728425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:15.728425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:15.728425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:15.728425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:15.728425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:15.728425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:15.728425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:15.728425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:15.728425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:15.728425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:15.728425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:15.732484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:15.732484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:15.732484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:15.732484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:15.732484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:15.732484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:15.732484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:15.732484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:15.732484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:15.732484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:15.732484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:15.732484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:15.732484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:15.732484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:15.732484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:15.732484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:15.733347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:15.733347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:15.733347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:15.733347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:15.733347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:15.733347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:15.733347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:15.733347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:15.733347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:15.733347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:15.733347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:28:15.733347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:15.733347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 223/442] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:28:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:15.733347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069038d7-d331-4da3-8eb3-0782425872c6 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:15.782616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:15.836007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 220/443] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:15.836895 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be56f7c-f767-478f-a057-8e4c98f0c7ad None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:15.856159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069038d7-d331-4da3-8eb3-0782425872c6 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:15.894520 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b43bf-c171-47ee-bcfb-a7362e2456bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:15.895175 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b43bf-c171-47ee-bcfb-a7362e2456bf None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:15.895446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b43bf-c171-47ee-bcfb-a7362e2456bf None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:15.895780 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b43bf-c171-47ee-bcfb-a7362e2456bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:15.961939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be56f7c-f767-478f-a057-8e4c98f0c7ad None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:15.970870 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:15.974392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b43bf-c171-47ee-bcfb-a7362e2456bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:15.975904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b43bf-c171-47ee-bcfb-a7362e2456bf None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:16.002852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36c1af-e7cd-4a32-ab4e-78f9173e7534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:16.003495 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36c1af-e7cd-4a32-ab4e-78f9173e7534 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:16.003778 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36c1af-e7cd-4a32-ab4e-78f9173e7534 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:16.004042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36c1af-e7cd-4a32-ab4e-78f9173e7534 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:16.004804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36c1af-e7cd-4a32-ab4e-78f9173e7534 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:16.008122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36c1af-e7cd-4a32-ab4e-78f9173e7534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:16.008122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36c1af-e7cd-4a32-ab4e-78f9173e7534 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:16.015492 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 221/444] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:16.016334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36c1af-e7cd-4a32-ab4e-78f9173e7534 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:16.036513 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:16.102942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 224/445] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:16.104152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b43bf-c171-47ee-bcfb-a7362e2456bf None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:16.141577 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36c1af-e7cd-4a32-ab4e-78f9173e7534 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:16.185790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7597d-a7aa-4a8f-963a-d797e8d0b6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:16.186457 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7597d-a7aa-4a8f-963a-d797e8d0b6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:16.186731 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7597d-a7aa-4a8f-963a-d797e8d0b6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:16.186999 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7597d-a7aa-4a8f-963a-d797e8d0b6c5 None admin] PATH_INFO: `/v3/projects/ef7d1dd858dc44ab80c0562c9d3c8b52` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:16.188234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7597d-a7aa-4a8f-963a-d797e8d0b6c5 None admin] RBAC: Authorizing `identity:get_project(project_id=ef7d1dd858dc44ab80c0562c9d3c8b52)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:16.189679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7597d-a7aa-4a8f-963a-d797e8d0b6c5 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:16.191363 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 222/446] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:28:16 2022] GET /identity/v3/projects/ef7d1dd858dc44ab80c0562c9d3c8b52 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:16.192197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7597d-a7aa-4a8f-963a-d797e8d0b6c5 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:16.227297 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b43bf-c171-47ee-bcfb-a7362e2456bf None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:16.234971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:16.264917 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7ff2d-529c-4ce4-907d-3c27a6503be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:16.265528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7ff2d-529c-4ce4-907d-3c27a6503be5 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:16.265801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7ff2d-529c-4ce4-907d-3c27a6503be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:16.266069 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7ff2d-529c-4ce4-907d-3c27a6503be5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:16.279187 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:16.304714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7597d-a7aa-4a8f-963a-d797e8d0b6c5 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:16.338463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7ff2d-529c-4ce4-907d-3c27a6503be5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:16.341145 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7ff2d-529c-4ce4-907d-3c27a6503be5 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:16.343675 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6fd9d-11a9-4afc-991b-d0ecb3569bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:16.345097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6fd9d-11a9-4afc-991b-d0ecb3569bda None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:16.345097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6fd9d-11a9-4afc-991b-d0ecb3569bda None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:16.345097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6fd9d-11a9-4afc-991b-d0ecb3569bda None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:16.346505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6fd9d-11a9-4afc-991b-d0ecb3569bda None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:16.349636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6fd9d-11a9-4afc-991b-d0ecb3569bda None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:16.349871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 223/447] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:28:16 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:16.350712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6fd9d-11a9-4afc-991b-d0ecb3569bda None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:16.446200 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 225/448] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:16.447590 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7ff2d-529c-4ce4-907d-3c27a6503be5 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:16.463756 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6fd9d-11a9-4afc-991b-d0ecb3569bda None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:16.468811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:16.497479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:16.501225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d8df-f3cc-4fc5-b965-e30aff501032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:16.501870 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d8df-f3cc-4fc5-b965-e30aff501032 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:16.502261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d8df-f3cc-4fc5-b965-e30aff501032 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:16.502794 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d8df-f3cc-4fc5-b965-e30aff501032 None admin] PATH_INFO: `/v3/groups/8122309d2b634bb8bb1ba95fc987e077` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:16.504044 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99d8df-f3cc-4fc5-b965-e30aff501032 None admin] RBAC: Authorizing `identity:get_group(group_id=8122309d2b634bb8bb1ba95fc987e077)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:16.505817 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99d8df-f3cc-4fc5-b965-e30aff501032 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:16.507411 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 224/449] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Sep 7 16:28:16 2022] GET /identity/v3/groups/8122309d2b634bb8bb1ba95fc987e077 => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:16.508208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d8df-f3cc-4fc5-b965-e30aff501032 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:16.558369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7ff2d-529c-4ce4-907d-3c27a6503be5 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:16.597005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5ff97-b085-4430-8eaf-5d778b1a0da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:16.597712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5ff97-b085-4430-8eaf-5d778b1a0da1 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:16.598063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5ff97-b085-4430-8eaf-5d778b1a0da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:16.598345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5ff97-b085-4430-8eaf-5d778b1a0da1 None admin] PATH_INFO: `/v3/groups/b119914b23864753a220d9f1bc34bae9` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:16.599621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5ff97-b085-4430-8eaf-5d778b1a0da1 None admin] RBAC: Authorizing `identity:get_group(group_id=b119914b23864753a220d9f1bc34bae9)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:16.601065 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5ff97-b085-4430-8eaf-5d778b1a0da1 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:16.602906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 226/450] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Sep 7 16:28:16 2022] GET /identity/v3/groups/b119914b23864753a220d9f1bc34bae9 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:16.603731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5ff97-b085-4430-8eaf-5d778b1a0da1 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:16.628295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d8df-f3cc-4fc5-b965-e30aff501032 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:16.675612 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8099c72-9373-459f-9b05-68dcf0b9091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:16.676253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8099c72-9373-459f-9b05-68dcf0b9091d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:16.676527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8099c72-9373-459f-9b05-68dcf0b9091d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:16.676794 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8099c72-9373-459f-9b05-68dcf0b9091d None admin] PATH_INFO: `/v3/projects/d636caf99d654f54ada4912b086ad3c6` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:16.677957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8099c72-9373-459f-9b05-68dcf0b9091d None admin] RBAC: Authorizing `identity:get_project(project_id=d636caf99d654f54ada4912b086ad3c6)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:16.679407 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8099c72-9373-459f-9b05-68dcf0b9091d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:16.681071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 225/451] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:28:16 2022] GET /identity/v3/projects/d636caf99d654f54ada4912b086ad3c6 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:16.681829 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8099c72-9373-459f-9b05-68dcf0b9091d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:16.731907 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:16.732117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5ff97-b085-4430-8eaf-5d778b1a0da1 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:16.743264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:16.781033 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af6717-7234-4576-b82f-b3ab51893f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:16.781882 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af6717-7234-4576-b82f-b3ab51893f61 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:16.782219 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af6717-7234-4576-b82f-b3ab51893f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:16.782529 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af6717-7234-4576-b82f-b3ab51893f61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:16.783399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af6717-7234-4576-b82f-b3ab51893f61 None admin] RBAC: Adding query filter params (group.id=8122309d2b634bb8bb1ba95fc987e077, role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=ef7d1dd858dc44ab80c0562c9d3c8b52) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:16.786788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af6717-7234-4576-b82f-b3ab51893f61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:16.786788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af6717-7234-4576-b82f-b3ab51893f61 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:16.794437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 227/452] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Sep 7 16:28:16 2022] GET /identity/v3/role_assignments?group.id=8122309d2b634bb8bb1ba95fc987e077&scope.project.id=ef7d1dd858dc44ab80c0562c9d3c8b52&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:16.795709 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af6717-7234-4576-b82f-b3ab51893f61 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:16.818496 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8099c72-9373-459f-9b05-68dcf0b9091d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:16.881967 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1cf38-550f-45b9-b572-c1638fbf2966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:16.882933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1cf38-550f-45b9-b572-c1638fbf2966 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:16.883381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1cf38-550f-45b9-b572-c1638fbf2966 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:16.883868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1cf38-550f-45b9-b572-c1638fbf2966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:16.885327 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1cf38-550f-45b9-b572-c1638fbf2966 None admin] RBAC: Adding query filter params (group.id=b119914b23864753a220d9f1bc34bae9, role.id=b9c5d282a37c489e83eabbdd2b393dbf, scope.project.id=d636caf99d654f54ada4912b086ad3c6) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:16.885893 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1cf38-550f-45b9-b572-c1638fbf2966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:16.888680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1cf38-550f-45b9-b572-c1638fbf2966 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:16.899544 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 226/453] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Sep 7 16:28:16 2022] GET /identity/v3/role_assignments?group.id=b119914b23864753a220d9f1bc34bae9&scope.project.id=d636caf99d654f54ada4912b086ad3c6&role.id=b9c5d282a37c489e83eabbdd2b393dbf => generated 611 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:16.974748 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af6717-7234-4576-b82f-b3ab51893f61 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:17.022706 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb617af1-528a-4fac-8dbd-ba10d115fdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:17.023763 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb617af1-528a-4fac-8dbd-ba10d115fdaa None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:17.024064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb617af1-528a-4fac-8dbd-ba10d115fdaa None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:17.024318 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb617af1-528a-4fac-8dbd-ba10d115fdaa None admin] PATH_INFO: `/v3/groups/b119914b23864753a220d9f1bc34bae9` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:17.025596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb617af1-528a-4fac-8dbd-ba10d115fdaa None admin] RBAC: Authorizing `identity:get_group(group_id=b119914b23864753a220d9f1bc34bae9)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:17.028421 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb617af1-528a-4fac-8dbd-ba10d115fdaa None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:17.030158 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 228/454] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Sep 7 16:28:16 2022] GET /identity/v3/groups/b119914b23864753a220d9f1bc34bae9 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:17.039312 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1cf38-550f-45b9-b572-c1638fbf2966 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:17.178496 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1cf38-550f-45b9-b572-c1638fbf2966 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:17.181109 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:17.225792 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c9fa8-e790-4de2-b671-abf128627114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:17.226665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c9fa8-e790-4de2-b671-abf128627114 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:17.226945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c9fa8-e790-4de2-b671-abf128627114 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:17.227218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c9fa8-e790-4de2-b671-abf128627114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:17.227981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c9fa8-e790-4de2-b671-abf128627114 None admin] RBAC: Adding query filter params (group.id=b119914b23864753a220d9f1bc34bae9, role.id=e35c45d51df34051b68fa49475ac7250, scope.project.id=d636caf99d654f54ada4912b086ad3c6) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:17.228288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c9fa8-e790-4de2-b671-abf128627114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:17.230254 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c9fa8-e790-4de2-b671-abf128627114 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:17.237228 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 227/455] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Sep 7 16:28:17 2022] GET /identity/v3/role_assignments?group.id=b119914b23864753a220d9f1bc34bae9&scope.project.id=d636caf99d654f54ada4912b086ad3c6&role.id=e35c45d51df34051b68fa49475ac7250 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:21.399623 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a3420-fac7-4fd1-8e58-20ba774c8955 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:21.400432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a3420-fac7-4fd1-8e58-20ba774c8955 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:21.400432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a3420-fac7-4fd1-8e58-20ba774c8955 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:21.401694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 229/456] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:28:21.412702 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3274f55-2a6c-45de-8ab0-4909992bf2a2 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:21.413519 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3274f55-2a6c-45de-8ab0-4909992bf2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:21.413652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3274f55-2a6c-45de-8ab0-4909992bf2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:21.456349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-c3274f55-2a6c-45de-8ab0-4909992bf2a2 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:21.458467 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c3274f55-2a6c-45de-8ab0-4909992bf2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:21.536709 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c3271-e5a2-47cb-9677-d495ddfbe255 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:21.537148 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c3271-e5a2-47cb-9677-d495ddfbe255 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:21.537581 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c3271-e5a2-47cb-9677-d495ddfbe255 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:21.539785 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 230/457] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:21.553367 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b7367-24b5-4e1b-83c7-fd597e1befcf None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:21.553878 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b7367-24b5-4e1b-83c7-fd597e1befcf None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:21.554240 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b7367-24b5-4e1b-83c7-fd597e1befcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:21.579154 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 228/458] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:21.604843 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-b48b7367-24b5-4e1b-83c7-fd597e1befcf None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:21.606104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b48b7367-24b5-4e1b-83c7-fd597e1befcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:21.667064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:21.746817 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 231/459] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:28:21.876774 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbcd84-c5be-4631-a853-d35e8047f84b None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:21.877497 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbcd84-c5be-4631-a853-d35e8047f84b None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:21.878006 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbcd84-c5be-4631-a853-d35e8047f84b None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:21.880104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 229/460] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:21.903376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41fe25-4f87-49c9-a3a6-4ff5d274c054 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:21.903905 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41fe25-4f87-49c9-a3a6-4ff5d274c054 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:21.904383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41fe25-4f87-49c9-a3a6-4ff5d274c054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:21.936803 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-ed41fe25-4f87-49c9-a3a6-4ff5d274c054 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:21.937929 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ed41fe25-4f87-49c9-a3a6-4ff5d274c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:22.034247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 232/461] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:22.089200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94f3cc-1cac-4f43-9d4a-c3896570a3ae None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:22.089687 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94f3cc-1cac-4f43-9d4a-c3896570a3ae None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:22.090158 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94f3cc-1cac-4f43-9d4a-c3896570a3ae None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:22.097166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 230/462] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:22 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:22.102775 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a165b6-07a8-4406-9640-4b9bf40763ba None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:22.103054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a165b6-07a8-4406-9640-4b9bf40763ba None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:22.103322 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a165b6-07a8-4406-9640-4b9bf40763ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:22.122255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94f3cc-1cac-4f43-9d4a-c3896570a3ae None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:22.144869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-89a165b6-07a8-4406-9640-4b9bf40763ba None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:22.146861 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-89a165b6-07a8-4406-9640-4b9bf40763ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:22.246551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:22.252288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94f3cc-1cac-4f43-9d4a-c3896570a3ae None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:22.288042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 233/463] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:28:22.289573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a165b6-07a8-4406-9640-4b9bf40763ba None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:22.292566 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfaa2bf-715c-4c41-a0c7-b4cdbf1605da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:22.293680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaa2bf-715c-4c41-a0c7-b4cdbf1605da None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:22.294165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaa2bf-715c-4c41-a0c7-b4cdbf1605da None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:22.294711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaa2bf-715c-4c41-a0c7-b4cdbf1605da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:22.307109 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfaa2bf-715c-4c41-a0c7-b4cdbf1605da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:22.309601 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfaa2bf-715c-4c41-a0c7-b4cdbf1605da None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:22.325816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-acfaa2bf-715c-4c41-a0c7-b4cdbf1605da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:22.325816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:22.325816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:22.325816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:22.325816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:22.325816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:22.325816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:22.325816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:22.325816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:22.325816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:22.325816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:22.325816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:22.325816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:22.325816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:22.325816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:22.325816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:22.326795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:22.326795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:22.326795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:22.326795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:22.326795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:22.326795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:22.326795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:22.326795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:22.326795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:22.326795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:22.326795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:22.326795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:22.326795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:22.326795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:22.326795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:22.326795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:22.326795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:22.327688 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:22.327688 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:22.327688 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:22.329915 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 231/464] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:22.336245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfaa2bf-715c-4c41-a0c7-b4cdbf1605da None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:22.353269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:22.467901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a165b6-07a8-4406-9640-4b9bf40763ba None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:22.497169 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfaa2bf-715c-4c41-a0c7-b4cdbf1605da None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:22.507197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdb2d7-19f9-4d54-91ec-821bbe64bf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:22.507197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdb2d7-19f9-4d54-91ec-821bbe64bf6f None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:22.507883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdb2d7-19f9-4d54-91ec-821bbe64bf6f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:22.507883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdb2d7-19f9-4d54-91ec-821bbe64bf6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:22.520134 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccdb2d7-19f9-4d54-91ec-821bbe64bf6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:22.521573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccdb2d7-19f9-4d54-91ec-821bbe64bf6f None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:22.539319 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fbae6-5316-42ba-946a-bb7a92fa1a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:22.540166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-8ccdb2d7-19f9-4d54-91ec-821bbe64bf6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:22.540166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:22.540166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:22.540166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:22.540166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:22.540166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:22.540166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:22.540166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:22.540166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:22.540166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:22.540166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:22.540166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:22.540166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:22.540166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:22.540166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:22.540166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:22.541060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:22.541060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:22.541060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:22.541060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:22.541060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:22.541060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:22.541060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:22.541060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:22.541060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:22.541060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:22.541060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:22.541060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:22.541060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:22.541060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:22.541060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:22.541060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:22.541060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:22.541959 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:22.541959 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:22.541959 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:22.542797 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fbae6-5316-42ba-946a-bb7a92fa1a01 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:22.543300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fbae6-5316-42ba-946a-bb7a92fa1a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:22.543856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fbae6-5316-42ba-946a-bb7a92fa1a01 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:22.544733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fbae6-5316-42ba-946a-bb7a92fa1a01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:22.545345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fbae6-5316-42ba-946a-bb7a92fa1a01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:22.546340 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 234/465] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:22.547173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fbae6-5316-42ba-946a-bb7a92fa1a01 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:22.547280 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdb2d7-19f9-4d54-91ec-821bbe64bf6f None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:22.562354 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 232/466] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:28:22.568369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fbae6-5316-42ba-946a-bb7a92fa1a01 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:22.587153 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:22.649792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:22.666774 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdb2d7-19f9-4d54-91ec-821bbe64bf6f None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:22.705697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea45ac-9115-4df3-b8fe-833910192462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:22.706614 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea45ac-9115-4df3-b8fe-833910192462 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:22.707013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea45ac-9115-4df3-b8fe-833910192462 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:22.707407 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea45ac-9115-4df3-b8fe-833910192462 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:22.708365 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fbae6-5316-42ba-946a-bb7a92fa1a01 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:22.720757 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea45ac-9115-4df3-b8fe-833910192462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:22.722233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea45ac-9115-4df3-b8fe-833910192462 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:22.738837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-f6ea45ac-9115-4df3-b8fe-833910192462 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:22.738837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:22.738837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:22.738837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:22.738837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:22.738837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:22.738837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:22.738837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:22.738837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:22.738837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:22.738837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:22.738837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:22.738837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:22.738837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:22.738837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:22.738837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:22.740057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:22.740057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:22.740057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:22.740057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:22.740057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:22.740057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:22.740057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:22.740057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:22.740057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:22.740057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:22.740057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:22.740057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:22.740057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:22.740057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:22.740057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:22.740057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:22.740057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:22.740914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:22.740914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:22.740914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:22.740914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 235/467] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:22.744487 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea45ac-9115-4df3-b8fe-833910192462 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:22.754740 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd43ba-b681-4bc5-a786-0a97e2a9888e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:22.755274 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd43ba-b681-4bc5-a786-0a97e2a9888e None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:22.755586 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd43ba-b681-4bc5-a786-0a97e2a9888e None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:22.755867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd43ba-b681-4bc5-a786-0a97e2a9888e None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:22.756520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd43ba-b681-4bc5-a786-0a97e2a9888e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:22.756824 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd43ba-b681-4bc5-a786-0a97e2a9888e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:22.758232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd43ba-b681-4bc5-a786-0a97e2a9888e None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:22.774999 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 233/468] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:22.774999 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd43ba-b681-4bc5-a786-0a97e2a9888e None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:22.862797 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:22.875181 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea45ac-9115-4df3-b8fe-833910192462 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:22.904559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd43ba-b681-4bc5-a786-0a97e2a9888e None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:22.914151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1141f44-f831-486f-a9bb-afe94b5e3920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:22.914778 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1141f44-f831-486f-a9bb-afe94b5e3920 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:22.915062 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1141f44-f831-486f-a9bb-afe94b5e3920 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:22.915337 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1141f44-f831-486f-a9bb-afe94b5e3920 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:22.916026 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1141f44-f831-486f-a9bb-afe94b5e3920 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:22.918903 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1141f44-f831-486f-a9bb-afe94b5e3920 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:22.928739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:22.943314 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfd89b-8e53-4898-8fa4-1d6335a6a9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:22.943988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfd89b-8e53-4898-8fa4-1d6335a6a9df None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:22.944272 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfd89b-8e53-4898-8fa4-1d6335a6a9df None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:22.944542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfd89b-8e53-4898-8fa4-1d6335a6a9df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:22.956499 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfd89b-8e53-4898-8fa4-1d6335a6a9df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:22.957960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfd89b-8e53-4898-8fa4-1d6335a6a9df None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:22.974244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-78cfd89b-8e53-4898-8fa4-1d6335a6a9df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:22.974244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:22.974244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:22.974244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:22.974244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:22.974244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:22.974244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:22.974244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:22.974244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:22.974244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:22.974244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:22.974244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:22.974244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:22.974244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:22.974244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:22.974244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:22.975732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:22.975732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:22.975732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:22.975732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:22.975732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:22.975732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:22.975732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:22.975732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:22.975732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:22.975732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:22.975732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:22.975732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:22.975732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:22.975732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:22.975732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:22.975732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:22.975732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:22.976865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:22.976865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:22.976865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:22.976865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 234/469] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:22.977082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfd89b-8e53-4898-8fa4-1d6335a6a9df None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:23.047660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 236/470] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:28:22 2022] POST /identity/v3/users => generated 248 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:28:23.048485 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1141f44-f831-486f-a9bb-afe94b5e3920 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:23.118955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfd89b-8e53-4898-8fa4-1d6335a6a9df None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:23.159217 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:23.180447 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb5a53-6b0e-4d9c-a109-80bcdf2bceda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:23.182529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb5a53-6b0e-4d9c-a109-80bcdf2bceda None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:23.183527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb5a53-6b0e-4d9c-a109-80bcdf2bceda None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:23.184325 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb5a53-6b0e-4d9c-a109-80bcdf2bceda None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:23.187873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb5a53-6b0e-4d9c-a109-80bcdf2bceda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:23.188632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb5a53-6b0e-4d9c-a109-80bcdf2bceda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:23.190336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb5a53-6b0e-4d9c-a109-80bcdf2bceda None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:23.190989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1141f44-f831-486f-a9bb-afe94b5e3920 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:23.221054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 235/471] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:23.222335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb5a53-6b0e-4d9c-a109-80bcdf2bceda None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:23.247584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b38fbc-a23b-4c43-a096-5c3cf93fed97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:23.248230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38fbc-a23b-4c43-a096-5c3cf93fed97 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:23.248706 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38fbc-a23b-4c43-a096-5c3cf93fed97 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:23.248983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38fbc-a23b-4c43-a096-5c3cf93fed97 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:23.249664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b38fbc-a23b-4c43-a096-5c3cf93fed97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:23.251223 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b38fbc-a23b-4c43-a096-5c3cf93fed97 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:23.420349 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 237/472] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:28:23 2022] POST /identity/v3/users => generated 248 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:28:23.422016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b38fbc-a23b-4c43-a096-5c3cf93fed97 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:23.432084 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb5a53-6b0e-4d9c-a109-80bcdf2bceda None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:23.524516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fbd3d-1e76-4e57-af1b-b5f062264566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:23.526527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fbd3d-1e76-4e57-af1b-b5f062264566 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:23.529556 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fbd3d-1e76-4e57-af1b-b5f062264566 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:23.530117 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fbd3d-1e76-4e57-af1b-b5f062264566 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:23.531040 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fbd3d-1e76-4e57-af1b-b5f062264566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:23.531576 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fbd3d-1e76-4e57-af1b-b5f062264566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:23.533200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fbd3d-1e76-4e57-af1b-b5f062264566 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:23.555626 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:23.572206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 236/473] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:23.573406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fbd3d-1e76-4e57-af1b-b5f062264566 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:23.663186 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:23.675183 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b38fbc-a23b-4c43-a096-5c3cf93fed97 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:23.734511 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7e5f0-514a-402f-a50c-717a73baff62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:23.735383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7e5f0-514a-402f-a50c-717a73baff62 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:23.735830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7e5f0-514a-402f-a50c-717a73baff62 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:23.736249 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7e5f0-514a-402f-a50c-717a73baff62 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:23.737050 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7e5f0-514a-402f-a50c-717a73baff62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:23.738698 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7e5f0-514a-402f-a50c-717a73baff62 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:23.762425 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fbd3d-1e76-4e57-af1b-b5f062264566 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:23.807045 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48434edc-0ade-4050-b0af-baf5f9a33e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:23.808399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48434edc-0ade-4050-b0af-baf5f9a33e4c None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:23.808399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48434edc-0ade-4050-b0af-baf5f9a33e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:23.808399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48434edc-0ade-4050-b0af-baf5f9a33e4c None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:23.809663 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48434edc-0ade-4050-b0af-baf5f9a33e4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:23.811214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48434edc-0ade-4050-b0af-baf5f9a33e4c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:23.849053 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 238/474] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:28:23 2022] POST /identity/v3/users => generated 246 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:28:23.859733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82836468-1dc2-47bd-8d62-e2a71414c13d None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:23.859733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82836468-1dc2-47bd-8d62-e2a71414c13d None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:23.859733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82836468-1dc2-47bd-8d62-e2a71414c13d None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:23.859733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 239/475] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:23.862274 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d6173-2e6d-4190-98b4-e7c84ec31b39 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:23.862766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d6173-2e6d-4190-98b4-e7c84ec31b39 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:23.863202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d6173-2e6d-4190-98b4-e7c84ec31b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:23.892157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-ee2d6173-2e6d-4190-98b4-e7c84ec31b39 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:23.893629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ee2d6173-2e6d-4190-98b4-e7c84ec31b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:23.915653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 237/476] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:28:23 2022] POST /identity/v3/users => generated 249 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:28:24.005413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 240/477] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:28:24.544053 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48434edc-0ade-4050-b0af-baf5f9a33e4c None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:24.706819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:24.710799 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48434edc-0ade-4050-b0af-baf5f9a33e4c None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:24.757289 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaf469-f1c3-4a7f-876e-84e408b9b921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:24.757926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf469-f1c3-4a7f-876e-84e408b9b921 None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:24.758978 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf469-f1c3-4a7f-876e-84e408b9b921 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:24.759252 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf469-f1c3-4a7f-876e-84e408b9b921 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:24.759990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eaf469-f1c3-4a7f-876e-84e408b9b921 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:24.762259 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eaf469-f1c3-4a7f-876e-84e408b9b921 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:24.810715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.sql.core [None req-10eaf469-f1c3-4a7f-876e-84e408b9b921 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 16:28:24.810715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 07 16:28:24.810715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [parameters: {'id': '38831574d0fd41b08267663dcf913150', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 07 16:28:24.810715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81876) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 16:28:24.835641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-10eaf469-f1c3-4a7f-876e-84e408b9b921 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 07 16:28:24.835641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:24.835641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 16:28:24.835641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 16:28:24.835641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 16:28:24.835641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 16:28:24.835641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 16:28:24.835641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 16:28:24.835641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 16:28:24.835641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application conn.query(q) Sep 07 16:28:24.835641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 16:28:24.835641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 16:28:24.835641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 16:28:24.835641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application result.read() Sep 07 16:28:24.835641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return ref.to_dict() Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 16:28:24.837520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application next(self.gen) Sep 07 16:28:24.841400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 16:28:24.841400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application yield resource Sep 07 16:28:24.841400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 16:28:24.841400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application next(self.gen) Sep 07 16:28:24.841400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 16:28:24.841400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 16:28:24.841400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 16:28:24.841400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 16:28:24.841400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 16:28:24.841400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise self.value Sep 07 16:28:24.841400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 16:28:24.841400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 16:28:24.841400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 16:28:24.841400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application session.commit() Sep 07 16:28:24.841400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 16:28:24.841400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 16:28:24.841400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 16:28:24.849135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 16:28:24.849135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 16:28:24.849135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self.session.flush() Sep 07 16:28:24.849135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 16:28:24.849135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 16:28:24.849135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 16:28:24.849135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 16:28:24.849135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 16:28:24.849135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application compat.raise_( Sep 07 16:28:24.849135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 16:28:24.849135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception Sep 07 16:28:24.849135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 16:28:24.849135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 16:28:24.849135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 16:28:24.849135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 16:28:24.849135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 16:28:24.849135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 16:28:24.853115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 16:28:24.853115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 16:28:24.853115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 07 16:28:24.853115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 07 16:28:24.853115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 16:28:24.853115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 16:28:24.853115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 16:28:24.853115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 16:28:24.853115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 16:28:24.853115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 16:28:24.853115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 16:28:24.853115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 16:28:24.853115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 16:28:24.853115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 16:28:24.853115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 16:28:24.853115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception Sep 07 16:28:24.859035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 16:28:24.859035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 16:28:24.859035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 16:28:24.859035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 16:28:24.859035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 16:28:24.859035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 16:28:24.859035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 16:28:24.859035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application conn.query(q) Sep 07 16:28:24.859035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 16:28:24.859035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 16:28:24.859035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 16:28:24.859035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application result.read() Sep 07 16:28:24.859035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 16:28:24.859035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 16:28:24.859035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 16:28:24.859035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 16:28:24.862156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 16:28:24.862156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 16:28:24.862156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 16:28:24.862156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 16:28:24.862156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 16:28:24.862156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 07 16:28:24.862156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [parameters: {'id': '38831574d0fd41b08267663dcf913150', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 07 16:28:24.862156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 16:28:24.862156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:24.862156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:28:24.862156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:24.862156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:24.862156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:24.862156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:24.862156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:24.862156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:24.871549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:24.871549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:24.871549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:24.871549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:24.871549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:24.871549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:24.871549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 07 16:28:24.871549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 07 16:28:24.871549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:24.871549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:24.871549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 07 16:28:24.871549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 07 16:28:24.871549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 16:28:24.871549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 16:28:24.871549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 07 16:28:24.871549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:24.874619 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 238/478] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Sep 7 16:28:24 2022] POST /identity/v3/roles => generated 144 bytes in 296 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:24.875563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d6173-2e6d-4190-98b4-e7c84ec31b39 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:24.940171 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:25.107658 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d6173-2e6d-4190-98b4-e7c84ec31b39 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:25.193065 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d925cd-933f-45f2-a8e4-afd7f366ff03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:25.194682 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d925cd-933f-45f2-a8e4-afd7f366ff03 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:25.195500 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d925cd-933f-45f2-a8e4-afd7f366ff03 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:25.196408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d925cd-933f-45f2-a8e4-afd7f366ff03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:25.231789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d925cd-933f-45f2-a8e4-afd7f366ff03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:25.241944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-94d925cd-933f-45f2-a8e4-afd7f366ff03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:28:25.241944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:25.241944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:25.241944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:25.241944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:25.241944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:25.241944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:25.241944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:25.241944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:25.241944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:25.241944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:25.241944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:25.241944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:25.241944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:25.241944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:25.241944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:25.246607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:25.246607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:25.246607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:25.246607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:25.246607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:25.246607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:25.246607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:25.246607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:25.246607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:25.246607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:25.246607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:25.246607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:25.246607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:25.246607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:25.246607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:25.246607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:25.247401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:25.247401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:25.247401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:25.247401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:25.247401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:25.247401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:25.247401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:25.247401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:25.247401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:25.247401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:25.247401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 16:28:25.247401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:25.248694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 241/479] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:28:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:25.254156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaf469-f1c3-4a7f-876e-84e408b9b921 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:25.521982 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaf469-f1c3-4a7f-876e-84e408b9b921 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:25.601984 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48f7e5-c1d4-4fb3-b0a9-3417b3bf6a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:25.602922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48f7e5-c1d4-4fb3-b0a9-3417b3bf6a10 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:25.603427 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48f7e5-c1d4-4fb3-b0a9-3417b3bf6a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:25.604041 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48f7e5-c1d4-4fb3-b0a9-3417b3bf6a10 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:25.605734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48f7e5-c1d4-4fb3-b0a9-3417b3bf6a10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:25.606260 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48f7e5-c1d4-4fb3-b0a9-3417b3bf6a10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:25.608939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48f7e5-c1d4-4fb3-b0a9-3417b3bf6a10 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:25.633784 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 239/480] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:26.578748 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e24b23-ca53-4ea7-8049-1741a30a01ea None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:26.578748 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e24b23-ca53-4ea7-8049-1741a30a01ea None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:26.578748 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e24b23-ca53-4ea7-8049-1741a30a01ea None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:26.580078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 242/481] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:26.584470 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeb353-9788-4d38-ab5c-e4409bd090f0 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:26.585331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeb353-9788-4d38-ab5c-e4409bd090f0 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:26.585901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeb353-9788-4d38-ab5c-e4409bd090f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:26.612768 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f4eeb353-9788-4d38-ab5c-e4409bd090f0 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:26.614964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f4eeb353-9788-4d38-ab5c-e4409bd090f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:26.643443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:26.723792 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 240/482] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:26.763061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89e650-3553-4a0e-90be-0e573b1b94ca None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:26.763373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89e650-3553-4a0e-90be-0e573b1b94ca None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:26.763650 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89e650-3553-4a0e-90be-0e573b1b94ca None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:26.765577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 243/483] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:26.781401 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded1e1b-6d99-488a-96ab-8cb689737573 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:26.781699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded1e1b-6d99-488a-96ab-8cb689737573 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:26.781952 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded1e1b-6d99-488a-96ab-8cb689737573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:26.812654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-eded1e1b-6d99-488a-96ab-8cb689737573 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:26.813849 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-eded1e1b-6d99-488a-96ab-8cb689737573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:26.914345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 241/484] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:27.086307 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89e650-3553-4a0e-90be-0e573b1b94ca None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:27.243252 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:27.254262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89e650-3553-4a0e-90be-0e573b1b94ca None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:27.254808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded1e1b-6d99-488a-96ab-8cb689737573 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:27.371872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:27.372226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4e64b-4a22-431f-85b6-2a3985e59eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:27.372948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4e64b-4a22-431f-85b6-2a3985e59eaf None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:27.373232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4e64b-4a22-431f-85b6-2a3985e59eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:27.373497 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4e64b-4a22-431f-85b6-2a3985e59eaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:27.381164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded1e1b-6d99-488a-96ab-8cb689737573 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:27.422682 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60be414-dd82-4915-9803-8bda6ca109a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:27.423156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4e64b-4a22-431f-85b6-2a3985e59eaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:27.423350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60be414-dd82-4915-9803-8bda6ca109a2 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:27.423645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60be414-dd82-4915-9803-8bda6ca109a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:27.423922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60be414-dd82-4915-9803-8bda6ca109a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:27.436817 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60be414-dd82-4915-9803-8bda6ca109a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:27.440036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-c7a4e64b-4a22-431f-85b6-2a3985e59eaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:27.440036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:27.440036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:27.440036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:27.440036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:27.440036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:27.440036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:27.440036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:27.440036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:27.440036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:27.440036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:27.440036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:27.440036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:27.440036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:27.440036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:27.440036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:27.440927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:27.440927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:27.440927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:27.440927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:27.440927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:27.440927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:27.440927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:27.440927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:27.440927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:27.440927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:27.440927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:27.440927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:27.440927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:27.440927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:27.440927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:27.440927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:27.441705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:27.441705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:27.441705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:27.441705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:27.441705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:27.441705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:27.441705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:27.441705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:27.441705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:27.441705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:27.441705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:27.441705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:27.442342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-c60be414-dd82-4915-9803-8bda6ca109a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:27.442342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:27.442342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:27.442342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:27.442342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:27.442342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:27.442342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:27.442342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:27.442342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:27.442342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:27.442342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:27.442342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:27.442342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:27.442342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:27.442342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:27.442342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:27.443143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:27.443143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:27.443143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:27.443143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:27.443143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:27.443143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:27.443143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:27.443143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:27.443143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:27.443143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:27.443143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:27.443143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:27.443143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:27.443143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:27.443143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:27.443143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:27.444164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:27.444164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:27.444164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:27.444164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:27.444164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:27.444164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:27.444164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:27.444164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:27.444164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:27.444164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:27.444164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:27.444164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:27.444753 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 244/486] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:27.444865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 242/486] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:27.449982 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4e64b-4a22-431f-85b6-2a3985e59eaf None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:27.451802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60be414-dd82-4915-9803-8bda6ca109a2 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:27.579770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60be414-dd82-4915-9803-8bda6ca109a2 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:27.626968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133eecfa-0aaf-4113-96ef-0ece08347267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:27.627897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133eecfa-0aaf-4113-96ef-0ece08347267 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:27.628183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133eecfa-0aaf-4113-96ef-0ece08347267 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:27.628456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133eecfa-0aaf-4113-96ef-0ece08347267 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:27.629134 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133eecfa-0aaf-4113-96ef-0ece08347267 None admin] RBAC: Adding query filter params (name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:27.629437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133eecfa-0aaf-4113-96ef-0ece08347267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:27.630826 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133eecfa-0aaf-4113-96ef-0ece08347267 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:27.631088 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4e64b-4a22-431f-85b6-2a3985e59eaf None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:27.641518 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 243/487] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:28:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:27.642593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9097d-7d7c-4672-b079-36051b5d7cb7 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:27.642879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9097d-7d7c-4672-b079-36051b5d7cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:27.643153 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9097d-7d7c-4672-b079-36051b5d7cb7 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:27.644794 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 244/488] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:27.645921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ee76a-27fe-4a4b-ae25-780e56d10854 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:27.646196 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ee76a-27fe-4a4b-ae25-780e56d10854 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:27.646467 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ee76a-27fe-4a4b-ae25-780e56d10854 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:27.648095 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 245/489] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:27.657863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ee76a-27fe-4a4b-ae25-780e56d10854 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:27.669569 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:27.678405 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f8e21-4cde-4959-8a45-85f759d9ab50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:27.679016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f8e21-4cde-4959-8a45-85f759d9ab50 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:27.679289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f8e21-4cde-4959-8a45-85f759d9ab50 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:27.679606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f8e21-4cde-4959-8a45-85f759d9ab50 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:27.680271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f8e21-4cde-4959-8a45-85f759d9ab50 None admin] RBAC: Adding query filter params (name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:27.680568 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f8e21-4cde-4959-8a45-85f759d9ab50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:27.681974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f8e21-4cde-4959-8a45-85f759d9ab50 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:27.691385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 245/490] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:28:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:27.692651 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c4705-615d-46e3-a382-9169f4c19548 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:27.696582 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c4705-615d-46e3-a382-9169f4c19548 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:27.696582 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c4705-615d-46e3-a382-9169f4c19548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:27.714924 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-ed7c4705-615d-46e3-a382-9169f4c19548 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:27.716169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ed7c4705-615d-46e3-a382-9169f4c19548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:27.740640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:27.799250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ee76a-27fe-4a4b-ae25-780e56d10854 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:27.829176 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 246/491] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:27.839731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb1b66-5b50-4ca4-84ae-a3e3d8c93d69 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:27.839731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb1b66-5b50-4ca4-84ae-a3e3d8c93d69 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:27.839731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb1b66-5b50-4ca4-84ae-a3e3d8c93d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:27.848001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab18ca-1888-4ca3-9c43-8e8766c7446d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:27.848744 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab18ca-1888-4ca3-9c43-8e8766c7446d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:27.849122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab18ca-1888-4ca3-9c43-8e8766c7446d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:27.849454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab18ca-1888-4ca3-9c43-8e8766c7446d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:27.861949 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab18ca-1888-4ca3-9c43-8e8766c7446d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:27.863551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab18ca-1888-4ca3-9c43-8e8766c7446d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:27.864797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-27bb1b66-5b50-4ca4-84ae-a3e3d8c93d69 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:27.866915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-27bb1b66-5b50-4ca4-84ae-a3e3d8c93d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:27.883699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-43ab18ca-1888-4ca3-9c43-8e8766c7446d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:27.883699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:27.883699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:27.883699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:27.883699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:27.883699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:27.883699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:27.883699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:27.883699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:27.883699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:27.883699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:27.883699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:27.883699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:27.883699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:27.883699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:27.883699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:27.884871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:27.884871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:27.884871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:27.884871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:27.884871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:27.884871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:27.884871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:27.884871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:27.884871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:27.884871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:27.884871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:27.884871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:27.884871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:27.884871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:27.884871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:27.884871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:27.884871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:27.886558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:27.886558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:27.886558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:27.888233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 246/492] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:27.889355 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab18ca-1888-4ca3-9c43-8e8766c7446d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:27.971558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 247/493] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:27.972473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb1b66-5b50-4ca4-84ae-a3e3d8c93d69 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:27.993552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:28.059442 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:28.078581 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab18ca-1888-4ca3-9c43-8e8766c7446d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:28.084905 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb1b66-5b50-4ca4-84ae-a3e3d8c93d69 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:28.123670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513ec4c-f1bf-4018-a1d4-06da842fd90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:28.124212 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513ec4c-f1bf-4018-a1d4-06da842fd90b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:28.124492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513ec4c-f1bf-4018-a1d4-06da842fd90b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:28.124764 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513ec4c-f1bf-4018-a1d4-06da842fd90b None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:28.125418 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513ec4c-f1bf-4018-a1d4-06da842fd90b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:28.125721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513ec4c-f1bf-4018-a1d4-06da842fd90b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:28.127140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513ec4c-f1bf-4018-a1d4-06da842fd90b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:28.144732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f7a7c-92f9-47cd-a42b-fa8a2906a8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:28.145386 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f7a7c-92f9-47cd-a42b-fa8a2906a8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:28.145661 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f7a7c-92f9-47cd-a42b-fa8a2906a8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:28.145929 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f7a7c-92f9-47cd-a42b-fa8a2906a8d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:28.148248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 248/494] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:28.155049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513ec4c-f1bf-4018-a1d4-06da842fd90b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:28.182668 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f7a7c-92f9-47cd-a42b-fa8a2906a8d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:28.184273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f7a7c-92f9-47cd-a42b-fa8a2906a8d3 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:28.216707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-4d4f7a7c-92f9-47cd-a42b-fa8a2906a8d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:28.216707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:28.216707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:28.216707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:28.216707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:28.216707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:28.216707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:28.216707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:28.216707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:28.216707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:28.216707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:28.216707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:28.216707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:28.216707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:28.216707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:28.216707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:28.217679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:28.217679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:28.217679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:28.217679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:28.217679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:28.217679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:28.217679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:28.217679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:28.217679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:28.217679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:28.217679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:28.217679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:28.217679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:28.217679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:28.217679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:28.217679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:28.217679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:28.218514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:28.218514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:28.218514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:28.225405 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 247/495] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:28.230418 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f7a7c-92f9-47cd-a42b-fa8a2906a8d3 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:28.317385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513ec4c-f1bf-4018-a1d4-06da842fd90b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:28.354616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1f0d0-c3e7-4788-9956-71cf7927a39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:28.355367 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1f0d0-c3e7-4788-9956-71cf7927a39d None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:28.355680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1f0d0-c3e7-4788-9956-71cf7927a39d None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:28.355971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1f0d0-c3e7-4788-9956-71cf7927a39d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:28.363824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:28.372805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1f0d0-c3e7-4788-9956-71cf7927a39d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:28.374395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1f0d0-c3e7-4788-9956-71cf7927a39d None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:28.384932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f7a7c-92f9-47cd-a42b-fa8a2906a8d3 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:28.388352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-68e1f0d0-c3e7-4788-9956-71cf7927a39d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 16:28:28.388352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:28.388352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:28.388352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:28.388352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:28.388352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:28.388352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:28.388352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:28.388352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:28.388352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:28.388352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:28.388352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:28.388352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:28:28.388352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:28:28.388352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:28:28.388352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:28.389479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:28.395071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:28.395071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:28.395071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:28:28.395071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:28:28.395071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:28:28.395071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:28:28.395071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:28:28.395071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:28:28.395071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 16:28:28.395071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:28.395071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 249/496] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:28:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:28.395071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1f0d0-c3e7-4788-9956-71cf7927a39d None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:28.407722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:28.445876 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbd547-7eed-44b9-92bd-ad7198e14e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:28.446970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbd547-7eed-44b9-92bd-ad7198e14e49 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:28.448119 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbd547-7eed-44b9-92bd-ad7198e14e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:28.448605 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbd547-7eed-44b9-92bd-ad7198e14e49 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:28.449827 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbd547-7eed-44b9-92bd-ad7198e14e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:28.450468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbd547-7eed-44b9-92bd-ad7198e14e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:28.454170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbd547-7eed-44b9-92bd-ad7198e14e49 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:28.482915 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 248/497] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:28:28.482915 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbd547-7eed-44b9-92bd-ad7198e14e49 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:28.532015 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1f0d0-c3e7-4788-9956-71cf7927a39d None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:28.582428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5697c07-6290-4c0b-9053-b58194a36e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:28.583171 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5697c07-6290-4c0b-9053-b58194a36e2b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:28.583458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5697c07-6290-4c0b-9053-b58194a36e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:28.583759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5697c07-6290-4c0b-9053-b58194a36e2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:28.595931 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5697c07-6290-4c0b-9053-b58194a36e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:28.601677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-e5697c07-6290-4c0b-9053-b58194a36e2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:28.601677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:28.601677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:28.601677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:28.601677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:28.601677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:28.601677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:28.601677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:28.601677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:28.601677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:28.601677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:28.601677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:28.601677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:28.601677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:28.601677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:28.601677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:28.602600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:28.602600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:28.602600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:28.602600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:28.602600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:28.602600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:28.602600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:28.602600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:28.602600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:28.602600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:28.602600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:28.602600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:28.602600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:28.602600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:28.602600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:28.602600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:28.603403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:28.603403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:28.603403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:28.603403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:28.603403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:28.603403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:28.603403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:28.603403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:28.603403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:28.603403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:28.603403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:28.603403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:28.603403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 250/498] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:28.604147 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5697c07-6290-4c0b-9053-b58194a36e2b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:28.628181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbd547-7eed-44b9-92bd-ad7198e14e49 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:28.676233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eb769-21e1-4de8-b1fc-adb46813ed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:28.676908 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eb769-21e1-4de8-b1fc-adb46813ed5b None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:28.677185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eb769-21e1-4de8-b1fc-adb46813ed5b None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:28.677455 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eb769-21e1-4de8-b1fc-adb46813ed5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:28.685844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:28.692296 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20eb769-21e1-4de8-b1fc-adb46813ed5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:28.697165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-a20eb769-21e1-4de8-b1fc-adb46813ed5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:28.697165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:28.697165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:28.697165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:28.697165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:28.697165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:28.697165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:28.697165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:28.697165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:28.697165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:28.697165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:28.697165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:28.697165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:28.697165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:28.697165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:28.697165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:28.700101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:28.700101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:28.700101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:28.700101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:28.700101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:28.700101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:28.700101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:28.700101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:28.700101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:28.700101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:28.700101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:28.700101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:28.700101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:28.700101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:28.700101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:28.700101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:28.701872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:28.701872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:28.701872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:28.701872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:28.701872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:28.701872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:28.701872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:28.701872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:28.701872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:28.701872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:28.701872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:28.701872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:28.703994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 249/499] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:28.705583 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eb769-21e1-4de8-b1fc-adb46813ed5b None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:28.733595 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5697c07-6290-4c0b-9053-b58194a36e2b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:28.756799 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:28.776871 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f81deb-4121-4799-b682-de640123e210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:28.777481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f81deb-4121-4799-b682-de640123e210 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:28.777760 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f81deb-4121-4799-b682-de640123e210 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:28.778034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f81deb-4121-4799-b682-de640123e210 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:28.778773 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f81deb-4121-4799-b682-de640123e210 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:28.779079 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f81deb-4121-4799-b682-de640123e210 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:28.780598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f81deb-4121-4799-b682-de640123e210 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:28.820859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 251/500] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Sep 7 16:28:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:28.821730 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f81deb-4121-4799-b682-de640123e210 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:28.843118 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eb769-21e1-4de8-b1fc-adb46813ed5b None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:28.880006 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e89eb8-5b32-4a6b-babf-a7a80a98a571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:28.880572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e89eb8-5b32-4a6b-babf-a7a80a98a571 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:28.880847 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e89eb8-5b32-4a6b-babf-a7a80a98a571 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:28.881116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e89eb8-5b32-4a6b-babf-a7a80a98a571 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:28.889356 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e89eb8-5b32-4a6b-babf-a7a80a98a571 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:28.890804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e89eb8-5b32-4a6b-babf-a7a80a98a571 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:28.915360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-12e89eb8-5b32-4a6b-babf-a7a80a98a571 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 16:28:28.915360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:28.915360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:28.915360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:28.915360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:28.915360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:28.915360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:28.915360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:28.915360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:28.915360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:28.915360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:28.915360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:28.915360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:28:28.915360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:28:28.915360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:28:28.915360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:28.917163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:28.918183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:28.918183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:28.918183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:28:28.918183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:28:28.918183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:28:28.918183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:28:28.918183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:28:28.918183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:28:28.918183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 16:28:28.918183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:28.918183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 250/501] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:28:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:28.919038 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f16bd-801a-41e5-8246-f2304c8918d7 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:28.919621 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f16bd-801a-41e5-8246-f2304c8918d7 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:28.919621 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f16bd-801a-41e5-8246-f2304c8918d7 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:28.920850 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 251/502] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:28.921564 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f16bd-801a-41e5-8246-f2304c8918d7 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:28.946183 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f81deb-4121-4799-b682-de640123e210 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:28.962078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:28.984494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d5d93-e2dc-4279-813e-6155c418620f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:28.985113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d5d93-e2dc-4279-813e-6155c418620f None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:28.985386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d5d93-e2dc-4279-813e-6155c418620f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:28.985657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d5d93-e2dc-4279-813e-6155c418620f None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:28.986323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d5d93-e2dc-4279-813e-6155c418620f None admin] RBAC: Adding query filter params (name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:28.986629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d5d93-e2dc-4279-813e-6155c418620f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:28.988306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d5d93-e2dc-4279-813e-6155c418620f None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:28.999549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 252/503] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:28:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:29.000594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d5d93-e2dc-4279-813e-6155c418620f None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:29.032017 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:29.043922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f16bd-801a-41e5-8246-f2304c8918d7 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:29.085112 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c810dbf-a25b-477e-9a07-0e4ded2408e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:29.085770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c810dbf-a25b-477e-9a07-0e4ded2408e0 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:29.086035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c810dbf-a25b-477e-9a07-0e4ded2408e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:29.086327 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c810dbf-a25b-477e-9a07-0e4ded2408e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:29.086977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c810dbf-a25b-477e-9a07-0e4ded2408e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:29.087352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c810dbf-a25b-477e-9a07-0e4ded2408e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:29.088965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c810dbf-a25b-477e-9a07-0e4ded2408e0 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:29.097682 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 252/504] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:28:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:29.098528 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c810dbf-a25b-477e-9a07-0e4ded2408e0 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:29.120171 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d5d93-e2dc-4279-813e-6155c418620f None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:29.156612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d7cfb-565a-4fa4-85b1-8abdf7555e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:29.157128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d7cfb-565a-4fa4-85b1-8abdf7555e1b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:29.157408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d7cfb-565a-4fa4-85b1-8abdf7555e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:29.157676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d7cfb-565a-4fa4-85b1-8abdf7555e1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:29.207665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:29.213205 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c810dbf-a25b-477e-9a07-0e4ded2408e0 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:29.239414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d7cfb-565a-4fa4-85b1-8abdf7555e1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:29.241002 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d7cfb-565a-4fa4-85b1-8abdf7555e1b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:29.261190 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c633551-b616-4aec-968f-9869bf3ee0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:29.262136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c633551-b616-4aec-968f-9869bf3ee0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:29.262462 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c633551-b616-4aec-968f-9869bf3ee0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:29.262906 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c633551-b616-4aec-968f-9869bf3ee0e4 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:29.264196 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c633551-b616-4aec-968f-9869bf3ee0e4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:29.264692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c633551-b616-4aec-968f-9869bf3ee0e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:29.267285 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c633551-b616-4aec-968f-9869bf3ee0e4 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:29.319962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 253/505] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Sep 7 16:28:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:29.321302 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e85103-1c11-45bc-a863-5b0e4e9ab5f6 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:29.321589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e85103-1c11-45bc-a863-5b0e4e9ab5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:29.321943 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e85103-1c11-45bc-a863-5b0e4e9ab5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:29.342644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-a1e85103-1c11-45bc-a863-5b0e4e9ab5f6 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:29.343948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a1e85103-1c11-45bc-a863-5b0e4e9ab5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:29.347336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:29.407666 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 253/506] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:29.408437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d7cfb-565a-4fa4-85b1-8abdf7555e1b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:29.445439 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 254/507] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:29.446349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e85103-1c11-45bc-a863-5b0e4e9ab5f6 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:29.512944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:29.557759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d7cfb-565a-4fa4-85b1-8abdf7555e1b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:29.583415 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e85103-1c11-45bc-a863-5b0e4e9ab5f6 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:29.618498 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632d182-5142-41dc-bd7c-9488f27a80e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:29.619144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632d182-5142-41dc-bd7c-9488f27a80e2 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:29.619988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632d182-5142-41dc-bd7c-9488f27a80e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:29.620946 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632d182-5142-41dc-bd7c-9488f27a80e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:29.632090 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49d5b-9f45-4613-a205-dc29ffe4fccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:29.632782 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49d5b-9f45-4613-a205-dc29ffe4fccb None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:29.632994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49d5b-9f45-4613-a205-dc29ffe4fccb None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:29.633277 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49d5b-9f45-4613-a205-dc29ffe4fccb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:29.640721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632d182-5142-41dc-bd7c-9488f27a80e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:29.643681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:29.643815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632d182-5142-41dc-bd7c-9488f27a80e2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:29.645969 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff49d5b-9f45-4613-a205-dc29ffe4fccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:29.647433 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff49d5b-9f45-4613-a205-dc29ffe4fccb None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:29.664928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-6ff49d5b-9f45-4613-a205-dc29ffe4fccb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:29.664928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:29.664928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:29.664928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:29.664928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:29.664928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:29.664928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:29.664928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:29.664928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:29.664928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:29.664928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:29.664928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:29.664928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:29.664928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:29.664928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:29.664928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:29.666699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:29.666699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:29.666699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:29.666699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:29.666699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:29.666699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:29.666699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:29.666699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:29.666699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:29.666699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:29.666699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:29.666699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:29.666699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:29.666699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:29.666699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:29.666699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:29.666699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:29.668135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:29.668135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:29.668135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:29.671935 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 255/508] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:29.672229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-d632d182-5142-41dc-bd7c-9488f27a80e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:29.672229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:29.672229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:29.672229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:29.672229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:29.672229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:29.672229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:29.672229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:29.672229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:29.672229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:29.672229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:29.672229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:29.672229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:29.672229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:29.672229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:29.672229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:29.674727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:29.674727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:29.674727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:29.674727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:29.674727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:29.674727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:29.674727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:29.674727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:29.674727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:29.674727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:29.674727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:29.674727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:29.674727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:29.674727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:29.674727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:29.674727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:29.674727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:29.678854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:29.678854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:29.678854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:29.679397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49d5b-9f45-4613-a205-dc29ffe4fccb None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:29.681647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 254/509] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:29.683618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632d182-5142-41dc-bd7c-9488f27a80e2 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:29.795432 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49d5b-9f45-4613-a205-dc29ffe4fccb None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:29.825018 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632d182-5142-41dc-bd7c-9488f27a80e2 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:29.836730 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cd8c4-d983-4dc5-b98d-0165006a55b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:29.837680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cd8c4-d983-4dc5-b98d-0165006a55b8 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:29.838737 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cd8c4-d983-4dc5-b98d-0165006a55b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:29.839175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cd8c4-d983-4dc5-b98d-0165006a55b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:29.864082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:29.872716 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073d147-d6da-4a21-990a-da77d9e9e916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:29.876063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073d147-d6da-4a21-990a-da77d9e9e916 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:29.876063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073d147-d6da-4a21-990a-da77d9e9e916 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:29.876063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073d147-d6da-4a21-990a-da77d9e9e916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:29.886418 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073d147-d6da-4a21-990a-da77d9e9e916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:29.888012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073d147-d6da-4a21-990a-da77d9e9e916 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:29.906275 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:29.916016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-a073d147-d6da-4a21-990a-da77d9e9e916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:29.916016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:29.916016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:29.916016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:29.916016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:29.916016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:29.916016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:29.916016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:29.916016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:29.916016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:29.916016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:29.916016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:29.916016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:29.916016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:29.916016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:29.916016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:29.917893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:29.917893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:29.917893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:29.917893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:29.917893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:29.917893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:29.917893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:29.917893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:29.917893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:29.917893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:29.917893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:29.917893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:29.917893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:29.917893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:29.917893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:29.917893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:29.917893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:29.919554 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:29.919554 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:29.919554 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:29.919554 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 255/510] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:29.919960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cd8c4-d983-4dc5-b98d-0165006a55b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:29.920085 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073d147-d6da-4a21-990a-da77d9e9e916 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:29.920234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cd8c4-d983-4dc5-b98d-0165006a55b8 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:30.031613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 256/511] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:30.033060 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cd8c4-d983-4dc5-b98d-0165006a55b8 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:30.052893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073d147-d6da-4a21-990a-da77d9e9e916 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:30.090491 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb45bb9-b935-4f32-b752-a36ee221cedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:30.091105 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb45bb9-b935-4f32-b752-a36ee221cedc None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:30.091391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb45bb9-b935-4f32-b752-a36ee221cedc None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:30.091687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb45bb9-b935-4f32-b752-a36ee221cedc None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:30.092395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb45bb9-b935-4f32-b752-a36ee221cedc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:30.092697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb45bb9-b935-4f32-b752-a36ee221cedc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:30.094113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb45bb9-b935-4f32-b752-a36ee221cedc None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:30.107419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 256/512] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:30.108307 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb45bb9-b935-4f32-b752-a36ee221cedc None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:30.153055 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:30.168643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:30.182364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cd8c4-d983-4dc5-b98d-0165006a55b8 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:30.217885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb45bb9-b935-4f32-b752-a36ee221cedc None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:30.238420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4243c5-fd44-4aa3-9863-1c77af7ed4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:30.239041 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4243c5-fd44-4aa3-9863-1c77af7ed4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:30.239318 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4243c5-fd44-4aa3-9863-1c77af7ed4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:30.239615 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4243c5-fd44-4aa3-9863-1c77af7ed4e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:30.240259 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4243c5-fd44-4aa3-9863-1c77af7ed4e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:30.240550 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4243c5-fd44-4aa3-9863-1c77af7ed4e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:30.241932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4243c5-fd44-4aa3-9863-1c77af7ed4e1 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:30.255497 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 257/513] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:30.255690 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1b38e-e8e7-4dce-a7ec-9047fd993bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:30.256248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b38e-e8e7-4dce-a7ec-9047fd993bbc None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:30.256349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4243c5-fd44-4aa3-9863-1c77af7ed4e1 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:30.256523 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b38e-e8e7-4dce-a7ec-9047fd993bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:30.256789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b38e-e8e7-4dce-a7ec-9047fd993bbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:30.280669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1b38e-e8e7-4dce-a7ec-9047fd993bbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:30.282477 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1b38e-e8e7-4dce-a7ec-9047fd993bbc None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:30.302365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-dcb1b38e-e8e7-4dce-a7ec-9047fd993bbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:30.302365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:30.302365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:30.302365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:30.302365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:30.302365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:30.302365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:30.302365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:30.302365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:30.302365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:30.302365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:30.302365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:30.302365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:30.302365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:30.302365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:30.302365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:30.303373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:30.303373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:30.303373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:30.303373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:30.303373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:30.303373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:30.303373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:30.303373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:30.303373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:30.303373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:30.303373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:30.303373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:30.303373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:30.303373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:30.303373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:30.303373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:30.303373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:30.304271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:30.304271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:30.304271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:30.304271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 257/514] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:30.305054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1b38e-e8e7-4dce-a7ec-9047fd993bbc None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:30.386341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4243c5-fd44-4aa3-9863-1c77af7ed4e1 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:30.406154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:30.417317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1b38e-e8e7-4dce-a7ec-9047fd993bbc None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:30.425285 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990b015-de05-46df-b1de-5c8129baa15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:30.425807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990b015-de05-46df-b1de-5c8129baa15e None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:30.426088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990b015-de05-46df-b1de-5c8129baa15e None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:30.426362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990b015-de05-46df-b1de-5c8129baa15e None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:30.427033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990b015-de05-46df-b1de-5c8129baa15e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:30.427336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990b015-de05-46df-b1de-5c8129baa15e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:30.428918 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990b015-de05-46df-b1de-5c8129baa15e None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:30.442926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 258/515] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:30.443581 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990b015-de05-46df-b1de-5c8129baa15e None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:30.462405 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:30.466655 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f3a93-64c3-4674-bf90-2b97c7fb87f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:30.467773 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f3a93-64c3-4674-bf90-2b97c7fb87f4 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:30.468268 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f3a93-64c3-4674-bf90-2b97c7fb87f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:30.468599 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f3a93-64c3-4674-bf90-2b97c7fb87f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:30.483633 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f3a93-64c3-4674-bf90-2b97c7fb87f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:30.485149 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f3a93-64c3-4674-bf90-2b97c7fb87f4 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:30.501197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-a57f3a93-64c3-4674-bf90-2b97c7fb87f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:30.501197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:30.501197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:30.501197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:30.501197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:30.501197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:30.501197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:30.501197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:30.501197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:30.501197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:30.501197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:30.501197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:30.501197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:30.501197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:30.501197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:30.501197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:30.503313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:30.503313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:30.503313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:30.503313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:30.503313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:30.503313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:30.503313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:30.503313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:30.503313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:30.503313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:30.503313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:30.503313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:30.503313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:30.503313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:30.503313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:30.503313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:30.503313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:30.505371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:30.505371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:30.505371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:30.505371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 258/516] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:30.505371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f3a93-64c3-4674-bf90-2b97c7fb87f4 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:30.586730 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990b015-de05-46df-b1de-5c8129baa15e None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:30.625006 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f3a93-64c3-4674-bf90-2b97c7fb87f4 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:30.628401 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4b423-b6e9-4b97-9d15-0c7d10db7a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:30.629289 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4b423-b6e9-4b97-9d15-0c7d10db7a68 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:30.629782 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4b423-b6e9-4b97-9d15-0c7d10db7a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:30.630306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4b423-b6e9-4b97-9d15-0c7d10db7a68 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:30.642351 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4b423-b6e9-4b97-9d15-0c7d10db7a68 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:30.644544 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4b423-b6e9-4b97-9d15-0c7d10db7a68 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:30.659807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-85d4b423-b6e9-4b97-9d15-0c7d10db7a68 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 16:28:30.659807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:30.659807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:30.659807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:30.659807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:30.659807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:30.659807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:30.659807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:30.659807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:30.659807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:30.659807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:30.659807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:30.659807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:28:30.659807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:28:30.659807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:28:30.659807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:30.661419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:30.662626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:30.662626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:30.662626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:28:30.662626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:28:30.662626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:28:30.662626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:28:30.662626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:28:30.662626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:28:30.662626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 16:28:30.662626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:30.662626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 259/517] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:30.662626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4b423-b6e9-4b97-9d15-0c7d10db7a68 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:30.672087 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e7394-44cb-4f36-b644-7fd3643c551a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:30.672712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e7394-44cb-4f36-b644-7fd3643c551a None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:30.672988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e7394-44cb-4f36-b644-7fd3643c551a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:30.673275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e7394-44cb-4f36-b644-7fd3643c551a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:30.682341 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e7394-44cb-4f36-b644-7fd3643c551a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:30.683849 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e7394-44cb-4f36-b644-7fd3643c551a None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:30.695558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-884e7394-44cb-4f36-b644-7fd3643c551a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:28:30.695558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:30.695558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:30.695558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:30.695558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:30.695558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:30.695558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:30.695558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:30.695558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:30.695558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:30.695558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:30.695558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:30.695558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:28:30.695558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:28:30.695558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:28:30.695558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:30.696586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:30.703388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:30.703388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:30.703388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:28:30.703388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:28:30.703388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:28:30.703388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:28:30.703388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:28:30.703388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:28:30.703388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:28:30.703388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:30.703388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 259/518] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Sep 7 16:28:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:30.703388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e7394-44cb-4f36-b644-7fd3643c551a None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:30.704296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:30.759180 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:30.800139 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4b423-b6e9-4b97-9d15-0c7d10db7a68 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:30.822055 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e7394-44cb-4f36-b644-7fd3643c551a None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:30.844214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5175875-a641-42a3-b998-f445a2392e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:30.844850 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5175875-a641-42a3-b998-f445a2392e14 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:30.845138 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5175875-a641-42a3-b998-f445a2392e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:30.845409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5175875-a641-42a3-b998-f445a2392e14 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:30.846069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5175875-a641-42a3-b998-f445a2392e14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:30.846378 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5175875-a641-42a3-b998-f445a2392e14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:30.847787 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5175875-a641-42a3-b998-f445a2392e14 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:30.864469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 260/519] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:30.864469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5175875-a641-42a3-b998-f445a2392e14 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:30.876803 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4721abf-4957-445b-ab66-25684bb6d4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:30.877681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4721abf-4957-445b-ab66-25684bb6d4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:30.878157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4721abf-4957-445b-ab66-25684bb6d4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:30.878646 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4721abf-4957-445b-ab66-25684bb6d4d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:30.890719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4721abf-4957-445b-ab66-25684bb6d4d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:30.892225 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4721abf-4957-445b-ab66-25684bb6d4d5 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:30.906005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-f4721abf-4957-445b-ab66-25684bb6d4d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:30.906005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:30.906005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:30.906005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:30.906005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:30.906005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:30.906005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:30.906005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:30.906005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:30.906005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:30.906005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:30.906005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:30.906005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:28:30.906005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:28:30.906005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:28:30.907117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:28:30.907117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:30.907117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:30.907117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:30.907117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:30.907117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:30.907117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:30.907117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:30.907117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:30.907117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:30.907117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:30.907117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:30.907117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:30.907117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:30.907117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:30.907117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:30.907117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:30.908443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:28:30.908443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:28:30.908443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:28:30.908443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:28:30.908443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:28:30.908443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:28:30.908443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:30.908443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:30.908443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 260/520] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:30.908443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4721abf-4957-445b-ab66-25684bb6d4d5 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:30.987961 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5175875-a641-42a3-b998-f445a2392e14 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:30.992531 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:31.031989 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:31.041735 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e582c31-ab38-4e53-8052-59e6a7a8de09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:31.042751 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e582c31-ab38-4e53-8052-59e6a7a8de09 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:31.043199 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e582c31-ab38-4e53-8052-59e6a7a8de09 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:31.043733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e582c31-ab38-4e53-8052-59e6a7a8de09 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:31.044947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e582c31-ab38-4e53-8052-59e6a7a8de09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:31.045485 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e582c31-ab38-4e53-8052-59e6a7a8de09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:31.046649 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4721abf-4957-445b-ab66-25684bb6d4d5 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:31.048145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e582c31-ab38-4e53-8052-59e6a7a8de09 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:31.070869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 261/521] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:31.072628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e582c31-ab38-4e53-8052-59e6a7a8de09 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:31.089677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac1612-ed2b-4f81-b02a-107c28f4bd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:31.090385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac1612-ed2b-4f81-b02a-107c28f4bd32 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:31.090903 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac1612-ed2b-4f81-b02a-107c28f4bd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:31.090903 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac1612-ed2b-4f81-b02a-107c28f4bd32 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:31.091738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac1612-ed2b-4f81-b02a-107c28f4bd32 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:31.092046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac1612-ed2b-4f81-b02a-107c28f4bd32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:31.093635 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac1612-ed2b-4f81-b02a-107c28f4bd32 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:31.116063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 261/522] 10.222.0.25 () {56 vars in 1139 bytes} [Wed Sep 7 16:28:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:31.116951 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac1612-ed2b-4f81-b02a-107c28f4bd32 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:31.245672 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e582c31-ab38-4e53-8052-59e6a7a8de09 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:31.252919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac1612-ed2b-4f81-b02a-107c28f4bd32 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:31.282197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:31.299397 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c87c38-351c-4cab-8f26-1eb1095a9871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:31.303942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c87c38-351c-4cab-8f26-1eb1095a9871 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:31.303942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c87c38-351c-4cab-8f26-1eb1095a9871 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:31.303942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c87c38-351c-4cab-8f26-1eb1095a9871 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:31.303942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c87c38-351c-4cab-8f26-1eb1095a9871 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:31.304771 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdebcc-f40a-4fc7-86c2-c8d9a9393695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:31.305289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c87c38-351c-4cab-8f26-1eb1095a9871 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:31.305591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdebcc-f40a-4fc7-86c2-c8d9a9393695 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:31.305958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdebcc-f40a-4fc7-86c2-c8d9a9393695 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:31.306316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdebcc-f40a-4fc7-86c2-c8d9a9393695 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:31.308549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdebcc-f40a-4fc7-86c2-c8d9a9393695 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:31.309015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdebcc-f40a-4fc7-86c2-c8d9a9393695 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:31.311695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdebcc-f40a-4fc7-86c2-c8d9a9393695 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:31.337750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 262/523] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Sep 7 16:28:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:31.339300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdebcc-f40a-4fc7-86c2-c8d9a9393695 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:31.427511 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 262/524] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:28:31 2022] POST /identity/v3/users => generated 247 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:28:31.427511 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c87c38-351c-4cab-8f26-1eb1095a9871 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:31.435717 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:31.513374 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdebcc-f40a-4fc7-86c2-c8d9a9393695 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:31.592584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f1edd-25ef-4592-9e59-1a444276dc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:31.593538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f1edd-25ef-4592-9e59-1a444276dc47 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:31.593999 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f1edd-25ef-4592-9e59-1a444276dc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:31.594345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f1edd-25ef-4592-9e59-1a444276dc47 None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:31.595238 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f1edd-25ef-4592-9e59-1a444276dc47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:31.595578 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f1edd-25ef-4592-9e59-1a444276dc47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:31.597059 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f1edd-25ef-4592-9e59-1a444276dc47 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:31.617046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c87c38-351c-4cab-8f26-1eb1095a9871 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:31.623053 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 263/525] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:28:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:31.624402 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f1edd-25ef-4592-9e59-1a444276dc47 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:31.678984 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec4d24-0e10-47e7-977f-a518c13aeee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:31.680106 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec4d24-0e10-47e7-977f-a518c13aeee2 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:31.680437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec4d24-0e10-47e7-977f-a518c13aeee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:31.680828 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec4d24-0e10-47e7-977f-a518c13aeee2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:31.690291 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec4d24-0e10-47e7-977f-a518c13aeee2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:31.692386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec4d24-0e10-47e7-977f-a518c13aeee2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:31.711314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-b9ec4d24-0e10-47e7-977f-a518c13aeee2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:31.711314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:31.711314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:31.711314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:31.711314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:31.711314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:31.711314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:31.711314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:31.711314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:31.711314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:31.711314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:31.711314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:31.711314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:28:31.711314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:28:31.711314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:28:31.713420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:28:31.713420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:31.713420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:31.713420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:31.713420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:31.713420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:31.713420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:31.713420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:31.713420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:31.713420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:31.713420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:31.713420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:31.713420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:31.713420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:31.713420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:31.713420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:31.713420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:31.715086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:28:31.715086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:28:31.715086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:28:31.715086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:28:31.715086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:28:31.715086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:28:31.715086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:31.715086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:31.715086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 263/526] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:31.715086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec4d24-0e10-47e7-977f-a518c13aeee2 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:31.787710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:31.816365 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f1edd-25ef-4592-9e59-1a444276dc47 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:31.839009 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:31.878437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b4b28-86df-4cdc-a53d-f509c434bcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:31.879592 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b4b28-86df-4cdc-a53d-f509c434bcf1 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:31.880092 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b4b28-86df-4cdc-a53d-f509c434bcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:31.880546 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b4b28-86df-4cdc-a53d-f509c434bcf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:31.889772 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec4d24-0e10-47e7-977f-a518c13aeee2 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:31.957148 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2461ca-a7dc-46ff-a82f-a5683c63872d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:31.958175 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2461ca-a7dc-46ff-a82f-a5683c63872d None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:31.958666 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2461ca-a7dc-46ff-a82f-a5683c63872d None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:31.959287 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2461ca-a7dc-46ff-a82f-a5683c63872d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:31.984236 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b4b28-86df-4cdc-a53d-f509c434bcf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:31.986831 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b4b28-86df-4cdc-a53d-f509c434bcf1 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:32.055901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2461ca-a7dc-46ff-a82f-a5683c63872d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:32.057719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2461ca-a7dc-46ff-a82f-a5683c63872d None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:32.105692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:32.166168 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 264/527] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:32.167189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b4b28-86df-4cdc-a53d-f509c434bcf1 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:32.188367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:32.227584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 264/528] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:32.227584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2461ca-a7dc-46ff-a82f-a5683c63872d None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:32.362616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b4b28-86df-4cdc-a53d-f509c434bcf1 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:32.383456 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2461ca-a7dc-46ff-a82f-a5683c63872d None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:32.410748 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc25f7-b8d3-4914-a153-b3788b224d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:32.411380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc25f7-b8d3-4914-a153-b3788b224d7d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:32.411722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc25f7-b8d3-4914-a153-b3788b224d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:32.411988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc25f7-b8d3-4914-a153-b3788b224d7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:32.412760 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc25f7-b8d3-4914-a153-b3788b224d7d None admin] RBAC: Adding query filter params (role.id=9b7a362fef7446e795c33b25a08f20bc, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=52705fc64cd54b1985ef2cb02f6c47fc) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:32.413057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc25f7-b8d3-4914-a153-b3788b224d7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:32.414611 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc25f7-b8d3-4914-a153-b3788b224d7d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:32.432044 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 265/529] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:28:32 2022] GET /identity/v3/role_assignments?user.id=52705fc64cd54b1985ef2cb02f6c47fc&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9b7a362fef7446e795c33b25a08f20bc => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:32.432044 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc25f7-b8d3-4914-a153-b3788b224d7d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:32.455410 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a06d6f-ebeb-45be-bf57-d50d33c3ae72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:32.456585 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a06d6f-ebeb-45be-bf57-d50d33c3ae72 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:32.457077 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a06d6f-ebeb-45be-bf57-d50d33c3ae72 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:32.457640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a06d6f-ebeb-45be-bf57-d50d33c3ae72 None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:32.459093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a06d6f-ebeb-45be-bf57-d50d33c3ae72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:32.459730 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a06d6f-ebeb-45be-bf57-d50d33c3ae72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:32.462608 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a06d6f-ebeb-45be-bf57-d50d33c3ae72 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:32.484651 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:32.507693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 265/530] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:32.510845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a06d6f-ebeb-45be-bf57-d50d33c3ae72 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:32.573622 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:32.628435 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc25f7-b8d3-4914-a153-b3788b224d7d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:32.634453 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a06d6f-ebeb-45be-bf57-d50d33c3ae72 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:32.678148 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eed40a-96e9-4ef3-a346-495a1a21f52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:32.679047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eed40a-96e9-4ef3-a346-495a1a21f52b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:32.679424 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eed40a-96e9-4ef3-a346-495a1a21f52b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:32.679829 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eed40a-96e9-4ef3-a346-495a1a21f52b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:32.692799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eed40a-96e9-4ef3-a346-495a1a21f52b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:32.694471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eed40a-96e9-4ef3-a346-495a1a21f52b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:32.707432 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102729a6-ef43-496b-9d6f-f679b875e9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:32.708285 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102729a6-ef43-496b-9d6f-f679b875e9aa None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:32.708659 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102729a6-ef43-496b-9d6f-f679b875e9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:32.709082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102729a6-ef43-496b-9d6f-f679b875e9aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:32.718893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-86eed40a-96e9-4ef3-a346-495a1a21f52b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:32.718893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:32.718893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:32.718893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:32.718893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:32.718893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:32.718893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:32.718893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:32.718893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:32.718893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:32.718893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:32.718893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:32.718893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:32.718893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:32.718893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:32.718893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:32.719973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:32.719973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:32.719973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:32.719973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:32.719973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:32.719973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:32.719973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:32.719973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:32.719973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:32.719973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:32.719973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:32.719973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:32.719973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:32.719973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:32.719973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:32.719973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:32.719973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:32.721275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:32.721275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:32.721275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:32.721275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 266/531] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:32.721275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eed40a-96e9-4ef3-a346-495a1a21f52b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:32.729577 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102729a6-ef43-496b-9d6f-f679b875e9aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:32.731626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102729a6-ef43-496b-9d6f-f679b875e9aa None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:32.748609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-102729a6-ef43-496b-9d6f-f679b875e9aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:32.748609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:32.748609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:32.748609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:32.748609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:32.748609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:32.748609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:32.748609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:32.748609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:32.748609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:32.748609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:32.748609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:32.748609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:32.748609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:32.748609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:32.748609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:32.749589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:32.749589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:32.749589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:32.749589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:32.749589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:32.749589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:32.749589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:32.749589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:32.749589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:32.749589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:32.749589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:32.749589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:32.749589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:32.749589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:32.749589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:32.749589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:32.749589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:32.750432 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:32.750432 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:32.750432 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:32.754600 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 266/532] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:32.755832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102729a6-ef43-496b-9d6f-f679b875e9aa None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:32.803898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:32.858646 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eed40a-96e9-4ef3-a346-495a1a21f52b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:32.897819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636fd8f-1582-477d-896d-2e6efaf3ff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:32.899232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636fd8f-1582-477d-896d-2e6efaf3ff67 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:32.899775 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636fd8f-1582-477d-896d-2e6efaf3ff67 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:32.900302 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636fd8f-1582-477d-896d-2e6efaf3ff67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:32.901837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636fd8f-1582-477d-896d-2e6efaf3ff67 None admin] RBAC: Adding query filter params (role.id=9b7a362fef7446e795c33b25a08f20bc, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=73216eee250744bb9d9b81dd983376ad) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:32.902380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636fd8f-1582-477d-896d-2e6efaf3ff67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:32.904169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636fd8f-1582-477d-896d-2e6efaf3ff67 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:32.919347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 267/533] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:28:32 2022] GET /identity/v3/role_assignments?user.id=73216eee250744bb9d9b81dd983376ad&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9b7a362fef7446e795c33b25a08f20bc => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:32.919347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636fd8f-1582-477d-896d-2e6efaf3ff67 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:33.026227 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102729a6-ef43-496b-9d6f-f679b875e9aa None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:33.112900 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:33.127553 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87e594-fd12-48b0-bdc4-ef2240bf2f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:33.133125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87e594-fd12-48b0-bdc4-ef2240bf2f23 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:33.133125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87e594-fd12-48b0-bdc4-ef2240bf2f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:33.133125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87e594-fd12-48b0-bdc4-ef2240bf2f23 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:33.133125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87e594-fd12-48b0-bdc4-ef2240bf2f23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:33.133125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87e594-fd12-48b0-bdc4-ef2240bf2f23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:33.133125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87e594-fd12-48b0-bdc4-ef2240bf2f23 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:33.182980 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 267/534] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:33.184584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87e594-fd12-48b0-bdc4-ef2240bf2f23 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:33.211359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636fd8f-1582-477d-896d-2e6efaf3ff67 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:33.263857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:33.357004 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96598599-a840-4a50-985d-8da78352107c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:33.357639 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96598599-a840-4a50-985d-8da78352107c None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:33.357922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96598599-a840-4a50-985d-8da78352107c None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:33.358192 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96598599-a840-4a50-985d-8da78352107c None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:33.358852 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96598599-a840-4a50-985d-8da78352107c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:33.359161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96598599-a840-4a50-985d-8da78352107c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:33.360591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96598599-a840-4a50-985d-8da78352107c None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:33.398664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 268/535] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:33.404793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96598599-a840-4a50-985d-8da78352107c None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:33.420844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87e594-fd12-48b0-bdc4-ef2240bf2f23 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:33.486686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fafe4-462a-4953-8370-a97c1fb2bdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:33.487766 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fafe4-462a-4953-8370-a97c1fb2bdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:33.488246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fafe4-462a-4953-8370-a97c1fb2bdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:33.488713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fafe4-462a-4953-8370-a97c1fb2bdd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:33.497172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fafe4-462a-4953-8370-a97c1fb2bdd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:33.498645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fafe4-462a-4953-8370-a97c1fb2bdd0 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:33.514037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-407fafe4-462a-4953-8370-a97c1fb2bdd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:33.514037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:33.514037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:33.514037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:33.514037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:33.514037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:33.514037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:33.514037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:33.514037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:33.514037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:33.514037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:33.514037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:33.514037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:28:33.514037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:28:33.514037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:28:33.514947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:28:33.514947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:33.514947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:33.514947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:33.514947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:33.514947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:33.514947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:33.514947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:33.514947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:33.514947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:33.514947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:33.514947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:33.514947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:33.514947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:33.514947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:33.514947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:33.514947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:33.515857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:28:33.515857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:28:33.515857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:28:33.515857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:28:33.515857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:28:33.515857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:28:33.515857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:33.515857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:33.519590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 268/536] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:33.521338 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fafe4-462a-4953-8370-a97c1fb2bdd0 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:33.576317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:33.639449 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fafe4-462a-4953-8370-a97c1fb2bdd0 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:33.678630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9573ee-46a3-4e0d-8811-f930291ff566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:33.679255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9573ee-46a3-4e0d-8811-f930291ff566 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:33.679567 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9573ee-46a3-4e0d-8811-f930291ff566 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:33.679840 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9573ee-46a3-4e0d-8811-f930291ff566 None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:33.680545 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9573ee-46a3-4e0d-8811-f930291ff566 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:33.680850 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9573ee-46a3-4e0d-8811-f930291ff566 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:33.682462 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9573ee-46a3-4e0d-8811-f930291ff566 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:33.686066 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96598599-a840-4a50-985d-8da78352107c None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:33.711358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 269/537] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:28:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:28:33.723527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9573ee-46a3-4e0d-8811-f930291ff566 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:33.788782 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6250a8-3580-474f-bce4-b831751ef4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:33.789861 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6250a8-3580-474f-bce4-b831751ef4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:33.790311 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6250a8-3580-474f-bce4-b831751ef4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:33.790821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6250a8-3580-474f-bce4-b831751ef4d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:33.813575 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6250a8-3580-474f-bce4-b831751ef4d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:33.816253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6250a8-3580-474f-bce4-b831751ef4d2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:33.845696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-bc6250a8-3580-474f-bce4-b831751ef4d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:33.845696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:33.845696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:33.845696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:33.845696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:33.845696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:33.845696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:33.845696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:33.845696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:33.845696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:33.845696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:33.845696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:33.845696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:28:33.845696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:28:33.845696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:28:33.846597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:28:33.846597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:33.846597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:33.846597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:33.846597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:33.846597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:33.846597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:33.846597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:33.846597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:33.846597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:33.846597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:33.846597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:33.846597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:33.846597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:33.846597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:33.846597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:33.846597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:33.847906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:28:33.847906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:28:33.847906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:28:33.847906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:28:33.847906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:28:33.847906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:28:33.847906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:33.847906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:33.847906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 269/538] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:28:33.855379 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6250a8-3580-474f-bce4-b831751ef4d2 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:33.865198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9573ee-46a3-4e0d-8811-f930291ff566 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:33.880084 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:33.919435 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6707b7d-58d9-4449-84ee-7941af9a8f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:33.920082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6707b7d-58d9-4449-84ee-7941af9a8f7e None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:33.920364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6707b7d-58d9-4449-84ee-7941af9a8f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:33.920642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6707b7d-58d9-4449-84ee-7941af9a8f7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:33.921379 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6707b7d-58d9-4449-84ee-7941af9a8f7e None admin] RBAC: Adding query filter params (role.id=9b7a362fef7446e795c33b25a08f20bc, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=cf48978c20f04173b114e15e1ce2157c) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:33.921689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6707b7d-58d9-4449-84ee-7941af9a8f7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:33.923374 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6707b7d-58d9-4449-84ee-7941af9a8f7e None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:33.927381 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:33.932473 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 270/539] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:28:33 2022] GET /identity/v3/role_assignments?user.id=cf48978c20f04173b114e15e1ce2157c&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9b7a362fef7446e795c33b25a08f20bc => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:33.934132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3062c4-8c9c-426c-abef-316b7f20220b None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:33.934419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3062c4-8c9c-426c-abef-316b7f20220b None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:33.934789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3062c4-8c9c-426c-abef-316b7f20220b None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:33.940916 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 271/540] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:33.942433 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95a549-43ec-4011-bbe5-067725011b02 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:33.942717 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95a549-43ec-4011-bbe5-067725011b02 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:33.942994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95a549-43ec-4011-bbe5-067725011b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:33.965838 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8d95a549-43ec-4011-bbe5-067725011b02 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:33.967134 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8d95a549-43ec-4011-bbe5-067725011b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:34.050641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 272/541] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:34.114959 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6250a8-3580-474f-bce4-b831751ef4d2 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:34.167923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ceba4-83b3-44da-ab46-9c76fe916b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:34.168564 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ceba4-83b3-44da-ab46-9c76fe916b87 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:34.168841 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ceba4-83b3-44da-ab46-9c76fe916b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:34.169109 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ceba4-83b3-44da-ab46-9c76fe916b87 None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:34.169813 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ceba4-83b3-44da-ab46-9c76fe916b87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:34.170114 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ceba4-83b3-44da-ab46-9c76fe916b87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:34.171643 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ceba4-83b3-44da-ab46-9c76fe916b87 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:34.191512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 270/542] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:28:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:34.202100 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95a549-43ec-4011-bbe5-067725011b02 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:34.379439 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:34.384216 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95a549-43ec-4011-bbe5-067725011b02 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:34.440269 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47a562-9e09-4bb6-9212-63a84e24d9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:34.440901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47a562-9e09-4bb6-9212-63a84e24d9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:34.441175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47a562-9e09-4bb6-9212-63a84e24d9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:34.441443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47a562-9e09-4bb6-9212-63a84e24d9b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:34.442182 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47a562-9e09-4bb6-9212-63a84e24d9b9 None admin] RBAC: Adding query filter params (role.id=9b7a362fef7446e795c33b25a08f20bc, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=bac099b78bd04e02b8614c8afce53ab7) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:34.442487 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47a562-9e09-4bb6-9212-63a84e24d9b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:34.443972 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47a562-9e09-4bb6-9212-63a84e24d9b9 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:34.449601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ceba4-83b3-44da-ab46-9c76fe916b87 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:34.451564 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 273/543] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:28:34 2022] GET /identity/v3/role_assignments?user.id=bac099b78bd04e02b8614c8afce53ab7&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9b7a362fef7446e795c33b25a08f20bc => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:34.620879 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:34.628686 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ceba4-83b3-44da-ab46-9c76fe916b87 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:34.701168 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c522e-3c47-4547-8cd9-260320cb3137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:34.701856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c522e-3c47-4547-8cd9-260320cb3137 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:34.702136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c522e-3c47-4547-8cd9-260320cb3137 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:34.702410 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c522e-3c47-4547-8cd9-260320cb3137 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:34.726276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c522e-3c47-4547-8cd9-260320cb3137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:34.733486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-6e9c522e-3c47-4547-8cd9-260320cb3137 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:34.733486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:34.733486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:34.733486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:34.733486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:34.733486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:34.733486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:34.733486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:34.733486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:34.733486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:34.733486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:34.733486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:34.733486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:34.733486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:34.733486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:34.733486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:34.735255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:34.735255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:34.735255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:34.735255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:34.735255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:34.735255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:34.735255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:34.735255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:34.735255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:34.735255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:34.735255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:34.735255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:34.735255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:34.735255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:34.735255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:34.735255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:34.736897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:34.736897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:34.736897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:34.736897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:34.736897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:34.736897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:34.736897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:34.736897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:34.736897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:34.736897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:34.736897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:34.736897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:34.736897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 271/544] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:28:34.745244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47a562-9e09-4bb6-9212-63a84e24d9b9 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:34.910364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47a562-9e09-4bb6-9212-63a84e24d9b9 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:34.985807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab3e6f-9726-4fc5-915e-ea1adb110d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:34.987438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab3e6f-9726-4fc5-915e-ea1adb110d6a None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:34.988334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab3e6f-9726-4fc5-915e-ea1adb110d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:34.989103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab3e6f-9726-4fc5-915e-ea1adb110d6a None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:34.990761 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab3e6f-9726-4fc5-915e-ea1adb110d6a None admin] RBAC: Adding query filter params (name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:34.991704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab3e6f-9726-4fc5-915e-ea1adb110d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:34.994938 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab3e6f-9726-4fc5-915e-ea1adb110d6a None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:35.014681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 274/545] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:28:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:35.020287 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c522e-3c47-4547-8cd9-260320cb3137 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:35.196853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c522e-3c47-4547-8cd9-260320cb3137 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:35.234594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2d979-ad0e-4819-924e-8e6152d6cb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:35.235239 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2d979-ad0e-4819-924e-8e6152d6cb60 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:35.235534 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2d979-ad0e-4819-924e-8e6152d6cb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:35.235808 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2d979-ad0e-4819-924e-8e6152d6cb60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:35.248691 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2d979-ad0e-4819-924e-8e6152d6cb60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:35.250255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2d979-ad0e-4819-924e-8e6152d6cb60 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:35.270112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-5cb2d979-ad0e-4819-924e-8e6152d6cb60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:35.270112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:35.270112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:35.270112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:35.270112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:35.270112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:35.270112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:35.270112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:35.270112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:35.270112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:35.270112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:35.270112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:35.270112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:35.270112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:35.270112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:35.270112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:35.272744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:35.272744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:35.272744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:35.272744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:35.272744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:35.272744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:35.272744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:35.272744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:35.272744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:35.272744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:35.272744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:35.272744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:35.272744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:35.272744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:35.272744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:35.272744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:35.272744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:35.274747 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:35.274747 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:35.274747 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:35.274747 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 272/546] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:35.282004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab3e6f-9726-4fc5-915e-ea1adb110d6a None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:35.360039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:35.530938 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab3e6f-9726-4fc5-915e-ea1adb110d6a None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:35.615980 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7d34e-3e86-410b-a921-4c214967190f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:35.617041 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7d34e-3e86-410b-a921-4c214967190f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:35.617520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7d34e-3e86-410b-a921-4c214967190f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:35.618014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7d34e-3e86-410b-a921-4c214967190f None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:35.619798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7d34e-3e86-410b-a921-4c214967190f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:35.620362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7d34e-3e86-410b-a921-4c214967190f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:35.623032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7d34e-3e86-410b-a921-4c214967190f None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:35.667721 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 275/547] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:35.676134 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2d979-ad0e-4819-924e-8e6152d6cb60 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:35.693127 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:35.897684 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2d979-ad0e-4819-924e-8e6152d6cb60 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:35.966551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a626f6a-13d9-4334-ab91-ce31d50c29ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:35.967304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a626f6a-13d9-4334-ab91-ce31d50c29ce None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:35.967604 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a626f6a-13d9-4334-ab91-ce31d50c29ce None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:35.968113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a626f6a-13d9-4334-ab91-ce31d50c29ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:35.981889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a626f6a-13d9-4334-ab91-ce31d50c29ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:35.983716 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a626f6a-13d9-4334-ab91-ce31d50c29ce None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:36.002449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-1a626f6a-13d9-4334-ab91-ce31d50c29ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 16:28:36.002449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:36.002449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:36.002449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:36.002449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:36.002449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:36.002449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:36.002449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:36.002449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:36.002449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:36.002449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:36.002449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:36.002449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:28:36.002449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:28:36.002449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:28:36.002449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:36.003446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:36.004558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:36.004558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:36.004558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:28:36.004558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:28:36.004558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:28:36.004558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:28:36.004558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:28:36.004558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:28:36.004558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 16:28:36.004558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:36.012814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 273/548] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:28:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:36.021154 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7d34e-3e86-410b-a921-4c214967190f None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:36.142531 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:36.145326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809b7b0-f120-4ca3-aabe-6b581ab3ae64 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:36.146227 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809b7b0-f120-4ca3-aabe-6b581ab3ae64 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:36.146719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809b7b0-f120-4ca3-aabe-6b581ab3ae64 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:36.148713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 274/549] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:36.164978 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332a9fd-8691-468c-8e4c-56d845230f74 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:36.165731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332a9fd-8691-468c-8e4c-56d845230f74 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:36.166694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332a9fd-8691-468c-8e4c-56d845230f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:36.167817 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7d34e-3e86-410b-a921-4c214967190f None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:36.216865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-8332a9fd-8691-468c-8e4c-56d845230f74 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:36.218615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-8332a9fd-8691-468c-8e4c-56d845230f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:36.248147 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbcc1e-872e-4dd6-b110-64bbf49b5549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:36.249182 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbcc1e-872e-4dd6-b110-64bbf49b5549 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:36.249671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbcc1e-872e-4dd6-b110-64bbf49b5549 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:36.250370 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbcc1e-872e-4dd6-b110-64bbf49b5549 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:36.251769 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbcc1e-872e-4dd6-b110-64bbf49b5549 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:36.252578 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbcc1e-872e-4dd6-b110-64bbf49b5549 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:36.258735 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbcc1e-872e-4dd6-b110-64bbf49b5549 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:36.287513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 276/550] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Sep 7 16:28:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:36.287513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2061ea-af9a-4bd6-9464-82cf4fbcfb75 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:36.287513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2061ea-af9a-4bd6-9464-82cf4fbcfb75 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:36.287513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2061ea-af9a-4bd6-9464-82cf4fbcfb75 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:36.287513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 277/551] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:36.297390 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2061ea-af9a-4bd6-9464-82cf4fbcfb75 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:36.360104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:36.375520 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 275/552] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:36.378264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b24a0-fde4-4a2f-8647-f06382b08b7b None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:36.379064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b24a0-fde4-4a2f-8647-f06382b08b7b None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:36.379907 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b24a0-fde4-4a2f-8647-f06382b08b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:36.415657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-e60b24a0-fde4-4a2f-8647-f06382b08b7b None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:36.418468 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-e60b24a0-fde4-4a2f-8647-f06382b08b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:36.450412 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2061ea-af9a-4bd6-9464-82cf4fbcfb75 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:36.494068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce914e-8de9-438a-8254-e9a5fc3a9405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:36.495045 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce914e-8de9-438a-8254-e9a5fc3a9405 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:36.495548 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce914e-8de9-438a-8254-e9a5fc3a9405 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:36.496002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce914e-8de9-438a-8254-e9a5fc3a9405 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:36.513937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:36.541363 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 276/553] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:36.586247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce914e-8de9-438a-8254-e9a5fc3a9405 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:36.588654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce914e-8de9-438a-8254-e9a5fc3a9405 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:36.723684 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 278/554] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:36.726251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b24a0-fde4-4a2f-8647-f06382b08b7b None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:36.861363 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce914e-8de9-438a-8254-e9a5fc3a9405 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:36.885791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b24a0-fde4-4a2f-8647-f06382b08b7b None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:36.950582 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:36.959642 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92e2cd-16a2-418c-aa56-754086cbb556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:36.960289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92e2cd-16a2-418c-aa56-754086cbb556 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:36.960564 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92e2cd-16a2-418c-aa56-754086cbb556 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:36.960830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92e2cd-16a2-418c-aa56-754086cbb556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:36.973469 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92e2cd-16a2-418c-aa56-754086cbb556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:36.974268 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:36.975186 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92e2cd-16a2-418c-aa56-754086cbb556 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:36.994954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-0d92e2cd-16a2-418c-aa56-754086cbb556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:36.994954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:36.994954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:36.994954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:36.994954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:36.994954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:36.994954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:36.994954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:36.994954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:36.994954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:36.994954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:36.994954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:36.994954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:36.994954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:36.994954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:36.994954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:36.996830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:36.996830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:36.996830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:36.996830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:36.996830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:36.996830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:36.996830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:36.996830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:36.996830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:36.996830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:36.996830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:36.996830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:36.996830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:36.996830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:36.996830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:36.996830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:36.996830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:36.998561 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:36.998561 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:36.998561 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:36.998561 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 277/555] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:28:36.998561 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92e2cd-16a2-418c-aa56-754086cbb556 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:37.094905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce914e-8de9-438a-8254-e9a5fc3a9405 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:37.112707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92e2cd-16a2-418c-aa56-754086cbb556 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:37.152004 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b26f76-259d-4ea3-be7b-4cd0e7df458e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:37.153054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b26f76-259d-4ea3-be7b-4cd0e7df458e None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:37.153054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b26f76-259d-4ea3-be7b-4cd0e7df458e None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:37.153291 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b26f76-259d-4ea3-be7b-4cd0e7df458e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:37.159024 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461b869-b783-42f0-a9d6-38dd5f3d44ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:37.160395 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461b869-b783-42f0-a9d6-38dd5f3d44ec None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:37.160896 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461b869-b783-42f0-a9d6-38dd5f3d44ec None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:37.161387 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461b869-b783-42f0-a9d6-38dd5f3d44ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:37.165440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b26f76-259d-4ea3-be7b-4cd0e7df458e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:37.172290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-05b26f76-259d-4ea3-be7b-4cd0e7df458e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:37.172290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:37.172290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:37.172290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:37.172290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:37.172290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:37.172290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:37.172290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:37.172290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:37.172290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:37.172290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:37.172290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:37.172290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:37.172290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:37.172290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:37.172290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:37.174080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:37.174080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:37.174080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:37.174080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:37.174080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:37.174080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:37.174080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:37.174080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:37.174080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:37.174080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:37.174080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:37.174080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:37.174080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:37.174080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:37.174080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:37.174080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:37.176273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:37.176273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:37.176273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:37.176273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:37.176273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:37.176273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:37.176273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:37.176273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:37.176273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:37.176273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:37.176273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:37.176273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:37.176273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 278/556] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:37.176273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b26f76-259d-4ea3-be7b-4cd0e7df458e None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:37.192077 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461b869-b783-42f0-a9d6-38dd5f3d44ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:37.206026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-8461b869-b783-42f0-a9d6-38dd5f3d44ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:37.206026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:37.206026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:37.206026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:37.206026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:37.206026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:37.206026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:37.206026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:37.206026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:37.206026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:37.206026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:37.206026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:37.206026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:37.206026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:37.206026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:37.206026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:37.214055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:37.214055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:37.214055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:37.214055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:37.214055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:37.214055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:37.214055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:37.214055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:37.214055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:37.214055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:37.214055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:37.214055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:37.214055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:37.214055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:37.214055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:37.214055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:37.217475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:37.217475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:37.217475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:37.217475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:37.217475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:37.217475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:37.217475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:37.217475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:37.217475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:37.217475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:37.217475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:37.217475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:37.217475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 279/557] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:28:37.217475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461b869-b783-42f0-a9d6-38dd5f3d44ec None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:37.227624 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:37.297810 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b26f76-259d-4ea3-be7b-4cd0e7df458e None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:37.338098 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ecdcc-dc1e-4903-91c3-ea3bd3f5c4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:37.338940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ecdcc-dc1e-4903-91c3-ea3bd3f5c4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:37.339208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ecdcc-dc1e-4903-91c3-ea3bd3f5c4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:37.339452 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ecdcc-dc1e-4903-91c3-ea3bd3f5c4e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:37.340103 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ecdcc-dc1e-4903-91c3-ea3bd3f5c4e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:37.340407 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ecdcc-dc1e-4903-91c3-ea3bd3f5c4e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:37.342053 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ecdcc-dc1e-4903-91c3-ea3bd3f5c4e4 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:37.347802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461b869-b783-42f0-a9d6-38dd5f3d44ec None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:37.351532 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:37.359247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 279/558] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:37.360383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ecdcc-dc1e-4903-91c3-ea3bd3f5c4e4 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:37.394525 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0f72f-6cf5-4f60-8b56-c3827fea76af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:37.395132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0f72f-6cf5-4f60-8b56-c3827fea76af None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:37.395414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0f72f-6cf5-4f60-8b56-c3827fea76af None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:37.395721 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0f72f-6cf5-4f60-8b56-c3827fea76af None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:37.396394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0f72f-6cf5-4f60-8b56-c3827fea76af None admin] RBAC: Adding query filter params (name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:37.396703 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0f72f-6cf5-4f60-8b56-c3827fea76af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:37.398154 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0f72f-6cf5-4f60-8b56-c3827fea76af None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:37.409161 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 280/559] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:28:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:37.413541 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0f72f-6cf5-4f60-8b56-c3827fea76af None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:37.535574 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:37.539557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ecdcc-dc1e-4903-91c3-ea3bd3f5c4e4 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:37.588378 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dc6a2-66b0-42a7-9484-aecd7e6603d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:37.589250 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dc6a2-66b0-42a7-9484-aecd7e6603d9 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:37.589534 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dc6a2-66b0-42a7-9484-aecd7e6603d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:37.589811 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dc6a2-66b0-42a7-9484-aecd7e6603d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:37.590658 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dc6a2-66b0-42a7-9484-aecd7e6603d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:37.590971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dc6a2-66b0-42a7-9484-aecd7e6603d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:37.591271 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0f72f-6cf5-4f60-8b56-c3827fea76af None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:37.592502 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dc6a2-66b0-42a7-9484-aecd7e6603d9 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:37.607657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 280/560] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:28:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:37.609031 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dc6a2-66b0-42a7-9484-aecd7e6603d9 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:37.662814 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a729a93-b536-4eb5-a5b9-d49c1ba9927d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:37.663869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a729a93-b536-4eb5-a5b9-d49c1ba9927d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:37.664359 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a729a93-b536-4eb5-a5b9-d49c1ba9927d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:37.664833 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a729a93-b536-4eb5-a5b9-d49c1ba9927d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:37.674714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a729a93-b536-4eb5-a5b9-d49c1ba9927d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:37.676793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a729a93-b536-4eb5-a5b9-d49c1ba9927d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:37.693042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-7a729a93-b536-4eb5-a5b9-d49c1ba9927d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:37.693042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:37.693042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:37.693042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:37.693042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:37.693042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:37.693042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:37.693042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:37.693042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:37.693042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:37.693042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:37.693042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:37.693042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:28:37.693042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:28:37.693042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:28:37.694004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:28:37.694004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:37.694004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:37.694004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:37.694004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:37.694004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:37.694004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:37.694004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:37.694004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:37.694004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:37.694004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:37.694004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:37.694004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:37.694004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:37.694004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:37.694004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:37.694004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:37.694873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:28:37.694873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:28:37.694873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:28:37.694873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:28:37.694873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:28:37.694873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:28:37.694873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:37.694873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:37.694873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 281/561] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:37.695365 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a729a93-b536-4eb5-a5b9-d49c1ba9927d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:37.732907 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:37.763616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dc6a2-66b0-42a7-9484-aecd7e6603d9 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:37.811764 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf271966-34c7-4b95-b606-863e5853523f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:37.812491 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf271966-34c7-4b95-b606-863e5853523f None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:37.812918 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf271966-34c7-4b95-b606-863e5853523f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:37.813309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf271966-34c7-4b95-b606-863e5853523f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:37.826691 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf271966-34c7-4b95-b606-863e5853523f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:37.828209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf271966-34c7-4b95-b606-863e5853523f None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:37.843208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-cf271966-34c7-4b95-b606-863e5853523f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:37.843208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:37.843208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:37.843208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:37.843208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:37.843208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:37.843208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:37.843208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:37.843208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:37.843208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:37.843208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:37.843208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:37.843208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:37.843208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:37.843208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:37.843208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:37.844364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:37.844364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:37.844364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:37.844364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:37.844364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:37.844364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:37.844364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:37.844364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:37.844364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:37.844364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:37.844364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:37.844364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:37.844364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:37.844364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:37.844364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:37.844364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:37.844364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:37.845262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:37.845262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:37.845262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:37.845442 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a729a93-b536-4eb5-a5b9-d49c1ba9927d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:37.845519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 281/562] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:37.845519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2cc23-e16e-4e08-b59e-0c46bbfafc6d None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:37.845868 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2cc23-e16e-4e08-b59e-0c46bbfafc6d None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:37.846128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2cc23-e16e-4e08-b59e-0c46bbfafc6d None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:37.847386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 282/563] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:37.848127 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2cc23-e16e-4e08-b59e-0c46bbfafc6d None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:37.869475 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:37.890734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66da5d-8769-4d9e-93ff-47d5b97d8cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:37.891527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66da5d-8769-4d9e-93ff-47d5b97d8cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:37.891914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66da5d-8769-4d9e-93ff-47d5b97d8cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:37.892365 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66da5d-8769-4d9e-93ff-47d5b97d8cb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:37.904938 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66da5d-8769-4d9e-93ff-47d5b97d8cb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:37.906422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66da5d-8769-4d9e-93ff-47d5b97d8cb6 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:37.925955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-8a66da5d-8769-4d9e-93ff-47d5b97d8cb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:37.925955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:37.925955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:37.925955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:37.925955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:37.925955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:37.925955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:37.925955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:37.925955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:37.925955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:37.925955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:37.925955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:37.925955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:37.925955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:37.925955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:37.925955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:37.927189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:37.927189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:37.927189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:37.927189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:37.927189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:37.927189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:37.927189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:37.927189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:37.927189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:37.927189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:37.927189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:37.927189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:37.927189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:37.927189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:37.927189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:37.927189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:37.927189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:37.928234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:37.928234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:37.928234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:37.928234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 282/564] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:37.928667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38798ade-a0c1-4a01-bc56-4b6642297bc8 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:37.929036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38798ade-a0c1-4a01-bc56-4b6642297bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:37.929401 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38798ade-a0c1-4a01-bc56-4b6642297bc8 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:37.931103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 283/565] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:37.932103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38798ade-a0c1-4a01-bc56-4b6642297bc8 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:37.978589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2cc23-e16e-4e08-b59e-0c46bbfafc6d None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:38.034287 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231df6c-7e00-4037-9938-740527d3bd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:38.035185 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231df6c-7e00-4037-9938-740527d3bd66 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:38.035662 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231df6c-7e00-4037-9938-740527d3bd66 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:38.036102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231df6c-7e00-4037-9938-740527d3bd66 None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:38.036863 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231df6c-7e00-4037-9938-740527d3bd66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:38.037308 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231df6c-7e00-4037-9938-740527d3bd66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:38.039815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231df6c-7e00-4037-9938-740527d3bd66 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:38.051329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:38.060212 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 283/566] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:28:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:38.061853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa4a2-25cf-45aa-b86f-087d752812de None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:38.062179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa4a2-25cf-45aa-b86f-087d752812de None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:38.062536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa4a2-25cf-45aa-b86f-087d752812de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:38.082033 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-f09fa4a2-25cf-45aa-b86f-087d752812de None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:38.083247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f09fa4a2-25cf-45aa-b86f-087d752812de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:38.091272 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38798ade-a0c1-4a01-bc56-4b6642297bc8 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:38.142059 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245d8d7-97c1-453b-95c5-4fc3106badb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:38.142680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245d8d7-97c1-453b-95c5-4fc3106badb1 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:38.142952 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245d8d7-97c1-453b-95c5-4fc3106badb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:38.143220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245d8d7-97c1-453b-95c5-4fc3106badb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:38.143890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245d8d7-97c1-453b-95c5-4fc3106badb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:38.144194 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245d8d7-97c1-453b-95c5-4fc3106badb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:38.145581 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245d8d7-97c1-453b-95c5-4fc3106badb1 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:38.158381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 284/567] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:38.159224 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245d8d7-97c1-453b-95c5-4fc3106badb1 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:38.173410 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 284/568] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:38.174718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ae171-fbaf-4bce-8aae-61f938589d9d None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:38.174997 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ae171-fbaf-4bce-8aae-61f938589d9d None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:38.175271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ae171-fbaf-4bce-8aae-61f938589d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:38.204436 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:38.214312 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-914ae171-fbaf-4bce-8aae-61f938589d9d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:38.215792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-914ae171-fbaf-4bce-8aae-61f938589d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:38.297124 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 285/569] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:38.298119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ae171-fbaf-4bce-8aae-61f938589d9d None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:38.329241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245d8d7-97c1-453b-95c5-4fc3106badb1 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:38.401233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84166e09-cbff-4da8-bb9c-2b7501445621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:38.403678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84166e09-cbff-4da8-bb9c-2b7501445621 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:38.404485 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84166e09-cbff-4da8-bb9c-2b7501445621 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:38.405287 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84166e09-cbff-4da8-bb9c-2b7501445621 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:38.406783 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84166e09-cbff-4da8-bb9c-2b7501445621 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:38.407599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84166e09-cbff-4da8-bb9c-2b7501445621 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:38.410642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84166e09-cbff-4da8-bb9c-2b7501445621 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:38.424825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:38.434196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ae171-fbaf-4bce-8aae-61f938589d9d None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:38.435673 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 285/570] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:38.441525 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84166e09-cbff-4da8-bb9c-2b7501445621 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:38.473047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:38.479933 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d4033-a702-427f-9b5f-e9fbbb7fefed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:38.480554 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d4033-a702-427f-9b5f-e9fbbb7fefed None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:38.480931 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d4033-a702-427f-9b5f-e9fbbb7fefed None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:38.484500 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d4033-a702-427f-9b5f-e9fbbb7fefed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:38.484500 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d4033-a702-427f-9b5f-e9fbbb7fefed None admin] RBAC: Adding query filter params (role.id=9b7a362fef7446e795c33b25a08f20bc, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=56cd868e866d436aa1d601f7791e812c) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:38.484500 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d4033-a702-427f-9b5f-e9fbbb7fefed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:38.484733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d4033-a702-427f-9b5f-e9fbbb7fefed None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:38.490569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 286/571] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:28:38 2022] GET /identity/v3/role_assignments?user.id=56cd868e866d436aa1d601f7791e812c&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9b7a362fef7446e795c33b25a08f20bc => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:38.491515 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d4033-a702-427f-9b5f-e9fbbb7fefed None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:38.615223 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d4033-a702-427f-9b5f-e9fbbb7fefed None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:38.626704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84166e09-cbff-4da8-bb9c-2b7501445621 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:38.658626 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e2b16-f63e-4956-9e82-0e8627729369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:38.658626 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e2b16-f63e-4956-9e82-0e8627729369 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:38.658626 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e2b16-f63e-4956-9e82-0e8627729369 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:38.658626 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e2b16-f63e-4956-9e82-0e8627729369 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:38.668558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e2b16-f63e-4956-9e82-0e8627729369 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:38.670128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e2b16-f63e-4956-9e82-0e8627729369 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:38.683602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-6d8e2b16-f63e-4956-9e82-0e8627729369 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 16:28:38.683602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:38.683602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:38.683602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:38.683602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:38.683602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:38.683602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:38.683602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:38.683602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:38.683602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:38.683602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:38.683602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:38.683602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:28:38.683602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:28:38.683602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:28:38.683602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:38.684627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:38.685611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:38.685611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:38.685611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:28:38.685611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:28:38.685611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:28:38.685611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:28:38.685611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:28:38.685611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:28:38.685611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 16:28:38.685611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:38.685611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 287/572] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:28:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:38.686930 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e2b16-f63e-4956-9e82-0e8627729369 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:38.693365 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e96ac-03f3-4372-9463-016d43b0f346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:38.694051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e96ac-03f3-4372-9463-016d43b0f346 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:38.694331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e96ac-03f3-4372-9463-016d43b0f346 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:38.694607 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e96ac-03f3-4372-9463-016d43b0f346 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:38.705849 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e96ac-03f3-4372-9463-016d43b0f346 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:38.706360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e96ac-03f3-4372-9463-016d43b0f346 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:38.720810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-908e96ac-03f3-4372-9463-016d43b0f346 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 16:28:38.720810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:38.720810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:38.720810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:38.720810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:38.720810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:38.720810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:38.720810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:38.720810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:38.720810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:38.720810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:38.720810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:38.720810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:28:38.720810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:28:38.720810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:28:38.720810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:38.723276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:38.725960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:38.725960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:38.725960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:28:38.725960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:28:38.725960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:28:38.725960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:28:38.725960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:28:38.725960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:28:38.725960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 16:28:38.725960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:38.727628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 286/573] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:28:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:38.729528 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e96ac-03f3-4372-9463-016d43b0f346 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:38.788060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:38.804181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:38.849555 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e2b16-f63e-4956-9e82-0e8627729369 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:38.858101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e96ac-03f3-4372-9463-016d43b0f346 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:38.901733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8027b3e-4c96-418f-b536-e5a757971d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:38.902315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8027b3e-4c96-418f-b536-e5a757971d0d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:38.902599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8027b3e-4c96-418f-b536-e5a757971d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:38.902980 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8027b3e-4c96-418f-b536-e5a757971d0d None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:38.903773 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8027b3e-4c96-418f-b536-e5a757971d0d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:38.904084 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8027b3e-4c96-418f-b536-e5a757971d0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:38.905771 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8027b3e-4c96-418f-b536-e5a757971d0d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:38.916576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec58434-95c7-49da-95a2-b0181893cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:38.917532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58434-95c7-49da-95a2-b0181893cb12 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:38.918026 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58434-95c7-49da-95a2-b0181893cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:38.918505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58434-95c7-49da-95a2-b0181893cb12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:38.933894 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 287/574] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Sep 7 16:28:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:38.933894 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8027b3e-4c96-418f-b536-e5a757971d0d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:38.945203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec58434-95c7-49da-95a2-b0181893cb12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:38.955771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-5ec58434-95c7-49da-95a2-b0181893cb12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:38.955771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:38.955771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:38.955771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:38.955771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:38.955771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:38.955771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:38.955771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:38.955771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:38.955771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:38.955771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:38.955771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:38.955771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:38.955771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:38.955771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:38.955771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:38.956786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:38.956786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:38.956786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:38.956786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:38.956786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:38.956786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:38.956786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:38.956786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:38.956786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:38.956786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:38.956786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:38.956786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:38.956786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:38.956786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:38.956786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:38.956786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:38.957622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:38.957622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:38.957622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:38.957622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:38.957622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:38.957622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:38.957622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:38.957622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:38.957622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:38.957622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:38.957622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:38.957622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:38.961681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 288/575] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:38.963014 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec58434-95c7-49da-95a2-b0181893cb12 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:39.072820 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8027b3e-4c96-418f-b536-e5a757971d0d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:39.091339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:39.108742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec58434-95c7-49da-95a2-b0181893cb12 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:39.113448 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e7902-d6ce-4282-b967-434cbfafa0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:39.114306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7902-d6ce-4282-b967-434cbfafa0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:39.114306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7902-d6ce-4282-b967-434cbfafa0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:39.115073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7902-d6ce-4282-b967-434cbfafa0d1 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:39.115303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e7902-d6ce-4282-b967-434cbfafa0d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:39.115641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e7902-d6ce-4282-b967-434cbfafa0d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:39.117102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e7902-d6ce-4282-b967-434cbfafa0d1 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:39.136300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:39.143927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 288/576] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Sep 7 16:28:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:39.143927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e7902-d6ce-4282-b967-434cbfafa0d1 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:39.162948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77c452-f524-4256-9dca-e2830e0e369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:39.163572 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77c452-f524-4256-9dca-e2830e0e369a None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:39.163849 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77c452-f524-4256-9dca-e2830e0e369a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:39.164119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77c452-f524-4256-9dca-e2830e0e369a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:39.181268 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77c452-f524-4256-9dca-e2830e0e369a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:39.190707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-8b77c452-f524-4256-9dca-e2830e0e369a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:39.190707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:39.190707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:39.190707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:39.190707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:39.190707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:39.190707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:39.190707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:39.190707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:39.190707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:39.190707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:39.190707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:39.190707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:39.190707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:39.190707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:39.190707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:39.192161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:39.192161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:39.192161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:39.192161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:39.192161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:39.192161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:39.192161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:39.192161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:39.192161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:39.192161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:39.192161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:39.192161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:39.192161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:39.192161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:39.192161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:39.192161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:39.193047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:39.193047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:39.193047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:39.193047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:39.193047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:39.193047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:39.193047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:39.193047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:39.193047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:39.193047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:39.193047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:39.193047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:39.193047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 289/577] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:39.194349 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77c452-f524-4256-9dca-e2830e0e369a None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:39.298549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e7902-d6ce-4282-b967-434cbfafa0d1 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:39.354372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77c452-f524-4256-9dca-e2830e0e369a None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:39.355446 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739c8da-1440-410d-84eb-d83be26d2ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:39.356154 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739c8da-1440-410d-84eb-d83be26d2ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:39.356432 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739c8da-1440-410d-84eb-d83be26d2ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:39.356705 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739c8da-1440-410d-84eb-d83be26d2ff4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:39.368399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739c8da-1440-410d-84eb-d83be26d2ff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:39.369908 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739c8da-1440-410d-84eb-d83be26d2ff4 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:39.386711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-1739c8da-1440-410d-84eb-d83be26d2ff4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:39.386711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:39.386711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:39.386711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:39.386711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:39.386711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:39.386711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:39.386711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:39.386711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:39.386711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:39.386711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:39.386711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:39.386711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:39.386711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:39.386711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:39.386711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:39.387945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:39.387945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:39.387945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:39.387945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:39.387945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:39.387945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:39.387945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:39.387945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:39.387945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:39.387945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:39.387945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:39.387945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:39.387945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:39.387945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:39.387945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:39.387945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:39.387945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:39.388975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:39.388975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:39.388975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:39.388975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 289/578] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:39.389262 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739c8da-1440-410d-84eb-d83be26d2ff4 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:39.423283 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022ac4e-175a-4322-bb7a-6e177a0dc46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:39.423875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022ac4e-175a-4322-bb7a-6e177a0dc46f None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:39.424153 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022ac4e-175a-4322-bb7a-6e177a0dc46f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:39.424442 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022ac4e-175a-4322-bb7a-6e177a0dc46f None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:39.425086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022ac4e-175a-4322-bb7a-6e177a0dc46f None admin] RBAC: Adding query filter params (name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:39.425377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022ac4e-175a-4322-bb7a-6e177a0dc46f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:39.426194 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:39.426768 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022ac4e-175a-4322-bb7a-6e177a0dc46f None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:39.438978 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 290/579] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:28:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:39.440269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022ac4e-175a-4322-bb7a-6e177a0dc46f None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:39.513544 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:39.553772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739c8da-1440-410d-84eb-d83be26d2ff4 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:39.599125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022ac4e-175a-4322-bb7a-6e177a0dc46f None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:39.613572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd5ccc-5806-4393-968a-3ab89593a824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:39.614431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd5ccc-5806-4393-968a-3ab89593a824 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:39.614704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd5ccc-5806-4393-968a-3ab89593a824 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:39.614972 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd5ccc-5806-4393-968a-3ab89593a824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:39.630326 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd5ccc-5806-4393-968a-3ab89593a824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:39.631809 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd5ccc-5806-4393-968a-3ab89593a824 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:39.645187 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e8db0-8edf-4f56-bafa-0e9b68ee746d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:39.645877 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e8db0-8edf-4f56-bafa-0e9b68ee746d None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:39.646163 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e8db0-8edf-4f56-bafa-0e9b68ee746d None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:39.646436 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e8db0-8edf-4f56-bafa-0e9b68ee746d None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:39.647103 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e8db0-8edf-4f56-bafa-0e9b68ee746d None admin] RBAC: Adding query filter params (name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:39.647408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e8db0-8edf-4f56-bafa-0e9b68ee746d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:39.648842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e8db0-8edf-4f56-bafa-0e9b68ee746d None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:39.651727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-93cd5ccc-5806-4393-968a-3ab89593a824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:39.651727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:39.651727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:39.651727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:39.651727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:39.651727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:39.651727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:39.651727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:39.651727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:39.651727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:39.651727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:39.651727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:39.651727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:39.651727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:39.651727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:39.651727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:39.652775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:39.652775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:39.652775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:39.652775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:39.652775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:39.652775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:39.652775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:39.652775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:39.652775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:39.652775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:39.652775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:39.652775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:39.652775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:39.652775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:39.652775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:39.652775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:39.652775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:39.653676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:39.653676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:39.653676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:39.657578 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 290/580] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:39.658328 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd5ccc-5806-4393-968a-3ab89593a824 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:39.671271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 291/581] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:28:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:39.672910 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e8db0-8edf-4f56-bafa-0e9b68ee746d None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:39.770402 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:39.807988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd5ccc-5806-4393-968a-3ab89593a824 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:39.817995 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:39.821130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e8db0-8edf-4f56-bafa-0e9b68ee746d None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:39.863542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6722d-76e1-48fa-8268-540f1d2325ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:39.864157 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6722d-76e1-48fa-8268-540f1d2325ab None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:39.864438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6722d-76e1-48fa-8268-540f1d2325ab None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:39.864707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6722d-76e1-48fa-8268-540f1d2325ab None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:39.865357 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6722d-76e1-48fa-8268-540f1d2325ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:39.865646 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6722d-76e1-48fa-8268-540f1d2325ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:39.867041 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6722d-76e1-48fa-8268-540f1d2325ab None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:39.877481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e2f98-d385-46c6-a093-d72521d0d1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:39.879088 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2f98-d385-46c6-a093-d72521d0d1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:39.879852 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2f98-d385-46c6-a093-d72521d0d1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:39.880342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2f98-d385-46c6-a093-d72521d0d1d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:39.881438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 291/582] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:39.882292 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6722d-76e1-48fa-8268-540f1d2325ab None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:39.901226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e2f98-d385-46c6-a093-d72521d0d1d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:39.903816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e2f98-d385-46c6-a093-d72521d0d1d9 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:39.927571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-e29e2f98-d385-46c6-a093-d72521d0d1d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:39.927571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:39.927571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:39.927571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:39.927571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:39.927571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:39.927571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:39.927571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:39.927571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:39.927571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:39.927571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:39.927571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:39.927571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:39.927571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:39.927571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:39.927571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:39.928584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:39.928584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:39.928584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:39.928584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:39.928584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:39.928584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:39.928584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:39.928584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:39.928584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:39.928584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:39.928584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:39.928584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:39.928584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:39.928584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:39.928584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:39.928584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:39.928584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:39.929468 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:39.929468 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:39.929468 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:39.932661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 292/583] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:39.933647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e2f98-d385-46c6-a093-d72521d0d1d9 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:40.009259 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6722d-76e1-48fa-8268-540f1d2325ab None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:40.049911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fc32b-c1e8-45eb-b6cc-7a60ec9eeb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:40.050921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fc32b-c1e8-45eb-b6cc-7a60ec9eeb94 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:40.051201 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fc32b-c1e8-45eb-b6cc-7a60ec9eeb94 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:40.051493 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fc32b-c1e8-45eb-b6cc-7a60ec9eeb94 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:40.052299 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fc32b-c1e8-45eb-b6cc-7a60ec9eeb94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:40.052601 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fc32b-c1e8-45eb-b6cc-7a60ec9eeb94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:40.054024 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fc32b-c1e8-45eb-b6cc-7a60ec9eeb94 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:40.062446 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:40.064350 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e2f98-d385-46c6-a093-d72521d0d1d9 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:40.074838 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 292/584] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:40.074838 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fc32b-c1e8-45eb-b6cc-7a60ec9eeb94 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:40.103813 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894e1a2-1d1e-4de3-a263-82c3dedb1b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:40.105606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894e1a2-1d1e-4de3-a263-82c3dedb1b94 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:40.105606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894e1a2-1d1e-4de3-a263-82c3dedb1b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:40.105606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894e1a2-1d1e-4de3-a263-82c3dedb1b94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:40.128712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894e1a2-1d1e-4de3-a263-82c3dedb1b94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:40.130187 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894e1a2-1d1e-4de3-a263-82c3dedb1b94 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:40.146411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-e894e1a2-1d1e-4de3-a263-82c3dedb1b94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:40.146411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:40.146411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:40.146411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:40.146411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:40.146411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:40.146411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:40.146411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:40.146411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:40.146411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:40.146411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:40.146411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:40.146411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:40.146411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:40.146411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:40.146411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:40.147428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:40.147428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:40.147428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:40.147428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:40.147428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:40.147428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:40.147428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:40.147428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:40.147428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:40.147428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:40.147428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:40.147428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:40.147428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:40.147428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:40.147428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:40.147428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:40.147428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:40.148363 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:40.148363 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:40.148363 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:40.148363 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 293/585] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:40.148363 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894e1a2-1d1e-4de3-a263-82c3dedb1b94 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:40.156772 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:40.217469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fc32b-c1e8-45eb-b6cc-7a60ec9eeb94 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:40.303381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f2da2-8a4f-411a-a802-f93ecfcaf122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:40.303962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f2da2-8a4f-411a-a802-f93ecfcaf122 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:40.304508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f2da2-8a4f-411a-a802-f93ecfcaf122 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:40.304779 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f2da2-8a4f-411a-a802-f93ecfcaf122 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:40.312750 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894e1a2-1d1e-4de3-a263-82c3dedb1b94 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:40.314436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f2da2-8a4f-411a-a802-f93ecfcaf122 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:40.316086 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f2da2-8a4f-411a-a802-f93ecfcaf122 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:40.330316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-f12f2da2-8a4f-411a-a802-f93ecfcaf122 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:40.330316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:40.330316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:40.330316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:40.330316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:40.330316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:40.330316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:40.330316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:40.330316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:40.330316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:40.330316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:40.330316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:40.330316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:28:40.330316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:28:40.330316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:28:40.337632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:28:40.337632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:40.337632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:40.337632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:40.337632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:40.337632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:40.337632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:40.337632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:40.337632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:40.337632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:40.337632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:40.337632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:40.337632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:40.337632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:40.337632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:40.337632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:40.337632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:40.338712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:28:40.338712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:28:40.338712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:28:40.338712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:28:40.338712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:28:40.338712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:28:40.338712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:40.338712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:40.338712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 293/586] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:40.338712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f2da2-8a4f-411a-a802-f93ecfcaf122 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:40.366663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f9ba1-a8db-4e15-8599-32f8029f11a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:40.367281 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f9ba1-a8db-4e15-8599-32f8029f11a9 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:40.367593 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f9ba1-a8db-4e15-8599-32f8029f11a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:40.367868 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f9ba1-a8db-4e15-8599-32f8029f11a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:40.369080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f9ba1-a8db-4e15-8599-32f8029f11a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:40.369378 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f9ba1-a8db-4e15-8599-32f8029f11a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:40.370774 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f9ba1-a8db-4e15-8599-32f8029f11a9 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:40.384820 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 294/587] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:40.385695 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f9ba1-a8db-4e15-8599-32f8029f11a9 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:40.428608 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:40.471343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:40.481006 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f2da2-8a4f-411a-a802-f93ecfcaf122 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:40.517962 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f9ba1-a8db-4e15-8599-32f8029f11a9 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:40.521481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57665b95-80e1-4992-b82c-9bd1e7e1d5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:40.522125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57665b95-80e1-4992-b82c-9bd1e7e1d5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:40.522408 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57665b95-80e1-4992-b82c-9bd1e7e1d5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:40.522712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57665b95-80e1-4992-b82c-9bd1e7e1d5b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:40.532789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57665b95-80e1-4992-b82c-9bd1e7e1d5b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:40.535055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57665b95-80e1-4992-b82c-9bd1e7e1d5b3 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:40.556011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-57665b95-80e1-4992-b82c-9bd1e7e1d5b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:40.556011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:40.556011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:40.556011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:40.556011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:40.556011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:40.556011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:40.556011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:40.556011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:40.556011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:40.556011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:40.556011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:40.556011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:28:40.556011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:28:40.556011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:28:40.556948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:28:40.556948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:40.556948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:40.556948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:40.556948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:40.556948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:40.556948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:40.556948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:40.556948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:40.556948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:40.556948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:40.556948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:40.556948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:40.556948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:40.556948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:40.556948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:40.556948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:40.557937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:28:40.557937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:28:40.557937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:28:40.557937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:28:40.557937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:28:40.557937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:28:40.557937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:40.557937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:40.563985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 294/588] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:40.565277 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57665b95-80e1-4992-b82c-9bd1e7e1d5b3 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:40.576513 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713ee6c-3804-46d2-bbe0-0a73749c93c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:40.577239 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713ee6c-3804-46d2-bbe0-0a73749c93c0 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:40.577719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713ee6c-3804-46d2-bbe0-0a73749c93c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:40.578200 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713ee6c-3804-46d2-bbe0-0a73749c93c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:40.579567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713ee6c-3804-46d2-bbe0-0a73749c93c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:40.580056 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713ee6c-3804-46d2-bbe0-0a73749c93c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:40.582991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713ee6c-3804-46d2-bbe0-0a73749c93c0 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:40.607277 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 295/589] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:40.608859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713ee6c-3804-46d2-bbe0-0a73749c93c0 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:40.726494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57665b95-80e1-4992-b82c-9bd1e7e1d5b3 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:40.750214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:40.772396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9aa847-f2ff-4be2-a058-21dd3a7ac758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:40.772932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9aa847-f2ff-4be2-a058-21dd3a7ac758 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:40.773215 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9aa847-f2ff-4be2-a058-21dd3a7ac758 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:40.773477 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9aa847-f2ff-4be2-a058-21dd3a7ac758 None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:40.774179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9aa847-f2ff-4be2-a058-21dd3a7ac758 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:40.774488 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9aa847-f2ff-4be2-a058-21dd3a7ac758 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:40.777190 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9aa847-f2ff-4be2-a058-21dd3a7ac758 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:40.778202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713ee6c-3804-46d2-bbe0-0a73749c93c0 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:40.792580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 295/590] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:28:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:40.793536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9aa847-f2ff-4be2-a058-21dd3a7ac758 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:40.817810 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:40.835093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988d457-6820-4084-b74b-fa93b9c16f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:40.836160 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988d457-6820-4084-b74b-fa93b9c16f98 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:40.836586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988d457-6820-4084-b74b-fa93b9c16f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:40.837826 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988d457-6820-4084-b74b-fa93b9c16f98 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:40.850084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988d457-6820-4084-b74b-fa93b9c16f98 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:40.851636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988d457-6820-4084-b74b-fa93b9c16f98 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:40.876466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-6988d457-6820-4084-b74b-fa93b9c16f98 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:28:40.876466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:40.876466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:40.876466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:40.876466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:40.876466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:40.876466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:40.876466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:40.876466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:40.876466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:40.876466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:40.876466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:40.876466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:28:40.876466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:28:40.876466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:28:40.876466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:40.877620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:40.878720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:40.878720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:40.878720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:28:40.878720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:28:40.878720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:28:40.878720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:28:40.878720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:28:40.878720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:28:40.878720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:28:40.878720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:40.883697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 296/591] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Sep 7 16:28:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:40.885110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988d457-6820-4084-b74b-fa93b9c16f98 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:40.934259 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9aa847-f2ff-4be2-a058-21dd3a7ac758 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:40.984018 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb3dbd-ef4f-4a7c-99a9-cdbd1334e503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:40.984638 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb3dbd-ef4f-4a7c-99a9-cdbd1334e503 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:40.984914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb3dbd-ef4f-4a7c-99a9-cdbd1334e503 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:40.985181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb3dbd-ef4f-4a7c-99a9-cdbd1334e503 None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:40.985877 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb3dbd-ef4f-4a7c-99a9-cdbd1334e503 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:40.986185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb3dbd-ef4f-4a7c-99a9-cdbd1334e503 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:40.987702 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb3dbd-ef4f-4a7c-99a9-cdbd1334e503 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:41.004918 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 296/592] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:28:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:41.006670 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc258b-c0e4-410e-9599-6e5d7815f48a None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:41.007120 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc258b-c0e4-410e-9599-6e5d7815f48a None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:41.007512 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc258b-c0e4-410e-9599-6e5d7815f48a None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:41.009512 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 297/593] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:41.011195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc258b-c0e4-410e-9599-6e5d7815f48a None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:41.021238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988d457-6820-4084-b74b-fa93b9c16f98 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:41.070304 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:41.071296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951288a0-1aac-4c6c-84ab-5bf0b0693458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:41.072727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951288a0-1aac-4c6c-84ab-5bf0b0693458 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:41.073102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951288a0-1aac-4c6c-84ab-5bf0b0693458 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:41.073526 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951288a0-1aac-4c6c-84ab-5bf0b0693458 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:41.083173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951288a0-1aac-4c6c-84ab-5bf0b0693458 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:41.084737 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951288a0-1aac-4c6c-84ab-5bf0b0693458 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:41.097990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-951288a0-1aac-4c6c-84ab-5bf0b0693458 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 16:28:41.097990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:41.097990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:41.097990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:41.097990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:41.097990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:41.097990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:41.097990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:41.097990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:41.097990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:41.097990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:41.097990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:41.097990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:28:41.097990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:28:41.097990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:28:41.097990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:41.100257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:41.102385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:41.102385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:41.102385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:28:41.102385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:28:41.102385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:28:41.102385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:28:41.102385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:28:41.102385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:28:41.102385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 16:28:41.102385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:41.102385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 297/594] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:41.102385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951288a0-1aac-4c6c-84ab-5bf0b0693458 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:41.152215 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc258b-c0e4-410e-9599-6e5d7815f48a None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:41.162324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:41.208748 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681a603-7ddd-4ecc-b5d1-19cd563bc2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:41.209887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681a603-7ddd-4ecc-b5d1-19cd563bc2a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:41.210403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681a603-7ddd-4ecc-b5d1-19cd563bc2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:41.210829 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681a603-7ddd-4ecc-b5d1-19cd563bc2a2 None admin] PATH_INFO: `/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/73216eee250744bb9d9b81dd983376ad/roles/9b7a362fef7446e795c33b25a08f20bc` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:41.240211 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681a603-7ddd-4ecc-b5d1-19cd563bc2a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1180c1ddef2b493f83c41425fd2e7917, user_id=73216eee250744bb9d9b81dd983376ad, role_id=9b7a362fef7446e795c33b25a08f20bc)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:41.242883 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681a603-7ddd-4ecc-b5d1-19cd563bc2a2 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:41.263555 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951288a0-1aac-4c6c-84ab-5bf0b0693458 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:41.304393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7dea0-b133-4d79-9a76-7f5082402e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:41.305028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7dea0-b133-4d79-9a76-7f5082402e15 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:41.305307 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7dea0-b133-4d79-9a76-7f5082402e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:41.305579 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7dea0-b133-4d79-9a76-7f5082402e15 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:41.307151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7dea0-b133-4d79-9a76-7f5082402e15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:41.307460 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7dea0-b133-4d79-9a76-7f5082402e15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:41.309141 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7dea0-b133-4d79-9a76-7f5082402e15 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:41.330519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 298/595] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Sep 7 16:28:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:41.331271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7dea0-b133-4d79-9a76-7f5082402e15 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:41.453950 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7dea0-b133-4d79-9a76-7f5082402e15 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:41.455869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:41.492919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37f02f-2f4b-4147-8210-1981436bf62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:41.494362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37f02f-2f4b-4147-8210-1981436bf62a None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:41.495183 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37f02f-2f4b-4147-8210-1981436bf62a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:41.495533 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37f02f-2f4b-4147-8210-1981436bf62a None admin] PATH_INFO: `/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/52705fc64cd54b1985ef2cb02f6c47fc/roles/9b7a362fef7446e795c33b25a08f20bc` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:41.512775 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37f02f-2f4b-4147-8210-1981436bf62a None admin] RBAC: Authorizing `identity:create_grant(project_id=1180c1ddef2b493f83c41425fd2e7917, user_id=52705fc64cd54b1985ef2cb02f6c47fc, role_id=9b7a362fef7446e795c33b25a08f20bc)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:41.514301 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37f02f-2f4b-4147-8210-1981436bf62a None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:41.633820 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 298/596] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:28:41 2022] PUT /identity/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/73216eee250744bb9d9b81dd983376ad/roles/9b7a362fef7446e795c33b25a08f20bc => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:28:41.636370 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66766ab-6453-4e87-945a-546e22de9128 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:41.636657 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66766ab-6453-4e87-945a-546e22de9128 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:41.636933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66766ab-6453-4e87-945a-546e22de9128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:41.662435 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-a66766ab-6453-4e87-945a-546e22de9128 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:41.664089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a66766ab-6453-4e87-945a-546e22de9128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:41.684067 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 299/597] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:28:41 2022] PUT /identity/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/52705fc64cd54b1985ef2cb02f6c47fc/roles/9b7a362fef7446e795c33b25a08f20bc => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:28:41.684067 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37f02f-2f4b-4147-8210-1981436bf62a None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:41.825287 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 299/598] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:41.827207 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66766ab-6453-4e87-945a-546e22de9128 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:41.892194 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:41.937964 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37f02f-2f4b-4147-8210-1981436bf62a None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:42.012375 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a570745-3b07-44fe-a8a0-f36e13e51833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:42.013839 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570745-3b07-44fe-a8a0-f36e13e51833 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:42.014395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570745-3b07-44fe-a8a0-f36e13e51833 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:42.015317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570745-3b07-44fe-a8a0-f36e13e51833 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:42.017617 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a570745-3b07-44fe-a8a0-f36e13e51833 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:42.018400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a570745-3b07-44fe-a8a0-f36e13e51833 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:42.022640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a570745-3b07-44fe-a8a0-f36e13e51833 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:42.023752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66766ab-6453-4e87-945a-546e22de9128 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:42.071596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 300/599] 10.222.0.25 () {56 vars in 1139 bytes} [Wed Sep 7 16:28:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:42.082963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a570745-3b07-44fe-a8a0-f36e13e51833 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:42.102993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f980d6-1024-4f90-a063-504df4335b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:42.104561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f980d6-1024-4f90-a063-504df4335b86 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:42.106786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f980d6-1024-4f90-a063-504df4335b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:42.109397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f980d6-1024-4f90-a063-504df4335b86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:42.133740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:42.152678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f980d6-1024-4f90-a063-504df4335b86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:42.155342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f980d6-1024-4f90-a063-504df4335b86 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:42.186241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-10f980d6-1024-4f90-a063-504df4335b86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:42.186241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:42.186241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:42.186241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:42.186241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:42.186241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:42.186241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:42.186241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:42.186241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:42.186241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:42.186241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:42.186241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:42.186241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:42.186241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:42.186241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:42.186241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:42.187431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:42.187431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:42.187431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:42.187431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:42.187431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:42.187431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:42.187431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:42.187431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:42.187431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:42.187431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:42.187431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:42.187431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:42.187431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:42.187431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:42.187431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:42.187431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:42.187431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:42.188438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:42.188438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:42.188438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:42.198514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 300/600] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:42.209754 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f980d6-1024-4f90-a063-504df4335b86 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:42.401904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a570745-3b07-44fe-a8a0-f36e13e51833 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:42.442901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:42.463280 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3615d-d017-47e0-a114-08024a65c02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:42.464273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3615d-d017-47e0-a114-08024a65c02a None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:42.464557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3615d-d017-47e0-a114-08024a65c02a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:42.464981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3615d-d017-47e0-a114-08024a65c02a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:42.479834 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3615d-d017-47e0-a114-08024a65c02a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:42.483035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3615d-d017-47e0-a114-08024a65c02a None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:42.505739 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f980d6-1024-4f90-a063-504df4335b86 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:42.520075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-bba3615d-d017-47e0-a114-08024a65c02a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:42.520075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:42.520075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:42.520075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:42.520075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:42.520075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:42.520075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:42.520075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:42.520075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:42.520075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:42.520075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:42.520075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:42.520075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:42.520075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:42.520075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:42.520075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:42.522202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:42.522202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:42.522202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:42.522202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:42.522202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:42.522202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:42.522202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:42.522202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:42.522202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:42.522202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:42.522202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:42.522202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:42.522202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:42.522202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:42.522202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:42.522202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:42.522202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:42.524493 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:42.524493 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:42.524493 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:42.524493 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 301/601] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:28:42.525766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3615d-d017-47e0-a114-08024a65c02a None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:42.581875 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a41b43-68ec-434e-b46e-700b14665fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:42.582997 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a41b43-68ec-434e-b46e-700b14665fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:42.583609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a41b43-68ec-434e-b46e-700b14665fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:42.584135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a41b43-68ec-434e-b46e-700b14665fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:42.585455 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a41b43-68ec-434e-b46e-700b14665fb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:42.586089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a41b43-68ec-434e-b46e-700b14665fb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:42.589236 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a41b43-68ec-434e-b46e-700b14665fb1 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:42.614741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 301/602] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:28:42.616530 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a41b43-68ec-434e-b46e-700b14665fb1 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:42.664762 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:42.732529 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3615d-d017-47e0-a114-08024a65c02a None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:42.773131 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461be2f2-38a6-430c-aa24-3c5b77cbcf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:42.774181 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461be2f2-38a6-430c-aa24-3c5b77cbcf90 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:42.775218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461be2f2-38a6-430c-aa24-3c5b77cbcf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:42.775752 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461be2f2-38a6-430c-aa24-3c5b77cbcf90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:42.787757 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461be2f2-38a6-430c-aa24-3c5b77cbcf90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:42.793937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-461be2f2-38a6-430c-aa24-3c5b77cbcf90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:42.793937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:42.793937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:42.793937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:42.793937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:42.793937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:42.793937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:42.793937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:42.793937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:42.793937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:42.793937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:42.793937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:42.793937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:42.793937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:42.793937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:42.793937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:42.794955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:42.794955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:42.794955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:42.794955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:42.794955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:42.794955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:42.794955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:42.794955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:42.794955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:42.794955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:42.794955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:42.794955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:42.794955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:42.794955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:42.794955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:42.794955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:42.796569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:42.796569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:42.796569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:42.796569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:42.796569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:42.796569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:42.796569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:42.796569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:42.796569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:42.796569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:42.796569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:42.796569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:42.799395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 302/603] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:42.804796 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461be2f2-38a6-430c-aa24-3c5b77cbcf90 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:42.833862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a41b43-68ec-434e-b46e-700b14665fb1 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:42.894191 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:42.905726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d22857-b70c-4263-a26d-dd6311899f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:42.911064 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d22857-b70c-4263-a26d-dd6311899f61 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:42.911064 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d22857-b70c-4263-a26d-dd6311899f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:42.911064 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d22857-b70c-4263-a26d-dd6311899f61 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:42.911064 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d22857-b70c-4263-a26d-dd6311899f61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:42.911064 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d22857-b70c-4263-a26d-dd6311899f61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:42.914989 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d22857-b70c-4263-a26d-dd6311899f61 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:42.924174 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461be2f2-38a6-430c-aa24-3c5b77cbcf90 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:42.938685 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 302/604] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:42.941937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d22857-b70c-4263-a26d-dd6311899f61 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:42.949702 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:42.963006 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd29f0-82dc-47a0-85e8-9ff786dd7394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:42.970925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd29f0-82dc-47a0-85e8-9ff786dd7394 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:42.970925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd29f0-82dc-47a0-85e8-9ff786dd7394 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:42.970925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd29f0-82dc-47a0-85e8-9ff786dd7394 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:42.971554 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd29f0-82dc-47a0-85e8-9ff786dd7394 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:42.973066 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd29f0-82dc-47a0-85e8-9ff786dd7394 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:42.986403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-b5dd29f0-82dc-47a0-85e8-9ff786dd7394 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:42.986403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:42.986403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:42.986403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:42.986403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:42.986403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:42.986403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:42.986403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:42.986403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:42.986403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:42.986403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:42.986403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:42.986403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:28:42.986403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:28:42.986403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:28:42.988207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:28:42.988207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:42.988207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:42.988207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:42.988207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:42.988207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:42.988207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:42.988207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:42.988207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:42.988207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:42.988207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:42.988207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:42.988207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:42.988207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:42.988207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:42.988207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:42.988207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:42.989998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:28:42.989998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:28:42.989998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:28:42.989998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:28:42.989998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:28:42.989998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:28:42.989998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:42.989998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:42.989998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 303/605] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:42.989998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd29f0-82dc-47a0-85e8-9ff786dd7394 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:43.118606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd29f0-82dc-47a0-85e8-9ff786dd7394 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:43.157296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d157de-6bbf-42ad-ab4a-c65bad0b1019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:43.157951 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d157de-6bbf-42ad-ab4a-c65bad0b1019 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:43.158234 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d157de-6bbf-42ad-ab4a-c65bad0b1019 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:43.158539 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d157de-6bbf-42ad-ab4a-c65bad0b1019 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:43.158963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d22857-b70c-4263-a26d-dd6311899f61 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:43.166813 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d157de-6bbf-42ad-ab4a-c65bad0b1019 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:43.168316 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d157de-6bbf-42ad-ab4a-c65bad0b1019 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:43.181821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-11d157de-6bbf-42ad-ab4a-c65bad0b1019 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:43.181821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:43.181821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:43.181821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:43.181821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:43.181821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:43.181821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:43.181821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:43.181821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:43.181821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:43.181821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:43.181821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:43.181821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:28:43.181821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:28:43.181821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:28:43.183598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:28:43.183598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:43.183598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:43.183598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:43.183598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:43.183598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:43.183598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:43.183598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:43.183598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:43.183598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:43.183598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:43.183598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:43.183598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:43.183598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:43.183598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:43.183598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:43.183598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:43.185427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:28:43.185427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:28:43.185427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:28:43.185427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:28:43.185427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:28:43.185427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:28:43.185427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:43.185427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:43.185427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 304/606] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:43.185427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d157de-6bbf-42ad-ab4a-c65bad0b1019 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:43.235805 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a5298-b05d-4fb0-9c8e-82f0209227bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:43.237037 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:43.238779 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a5298-b05d-4fb0-9c8e-82f0209227bd None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:43.239595 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a5298-b05d-4fb0-9c8e-82f0209227bd None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:43.240334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a5298-b05d-4fb0-9c8e-82f0209227bd None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:43.242561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a5298-b05d-4fb0-9c8e-82f0209227bd None admin] RBAC: Adding query filter params (name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:43.244115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a5298-b05d-4fb0-9c8e-82f0209227bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:43.246944 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a5298-b05d-4fb0-9c8e-82f0209227bd None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:43.264328 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 303/607] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:28:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:43.266481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a5298-b05d-4fb0-9c8e-82f0209227bd None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:43.304938 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d157de-6bbf-42ad-ab4a-c65bad0b1019 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:43.341842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96242b12-f1ea-4039-aad1-b77ab3229f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:43.342469 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96242b12-f1ea-4039-aad1-b77ab3229f69 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:43.342756 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96242b12-f1ea-4039-aad1-b77ab3229f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:43.343022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96242b12-f1ea-4039-aad1-b77ab3229f69 None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:43.343776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96242b12-f1ea-4039-aad1-b77ab3229f69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:43.344082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96242b12-f1ea-4039-aad1-b77ab3229f69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:43.346001 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96242b12-f1ea-4039-aad1-b77ab3229f69 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:43.359966 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 305/608] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:28:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:43.361451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96242b12-f1ea-4039-aad1-b77ab3229f69 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:43.386351 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:43.486825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96242b12-f1ea-4039-aad1-b77ab3229f69 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:43.488607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:43.496974 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a5298-b05d-4fb0-9c8e-82f0209227bd None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:43.526647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcef7b-9e68-4c63-b7bf-3e20a72ae80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:43.527292 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcef7b-9e68-4c63-b7bf-3e20a72ae80b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:43.527614 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcef7b-9e68-4c63-b7bf-3e20a72ae80b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:43.527878 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcef7b-9e68-4c63-b7bf-3e20a72ae80b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:43.538904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcef7b-9e68-4c63-b7bf-3e20a72ae80b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:43.540695 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcef7b-9e68-4c63-b7bf-3e20a72ae80b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:43.557372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-21dcef7b-9e68-4c63-b7bf-3e20a72ae80b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:43.557372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:43.557372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:43.557372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:43.557372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:43.557372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:43.557372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:43.557372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:43.557372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:43.557372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:43.557372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:43.557372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:43.557372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:43.557372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:43.557372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:43.557372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:43.559276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:43.559276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:43.559276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:43.559276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:43.559276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:43.559276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:43.559276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:43.559276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:43.559276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:43.559276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:43.559276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:43.559276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:43.559276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:43.559276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:43.559276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:43.559276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:43.559276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:43.561125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:43.561125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:43.561125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:43.563222 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 306/609] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:43.564224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcef7b-9e68-4c63-b7bf-3e20a72ae80b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:43.586207 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7361152-4f92-4035-8aa2-31a57779c7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:43.588426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7361152-4f92-4035-8aa2-31a57779c7ba None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:43.589235 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7361152-4f92-4035-8aa2-31a57779c7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:43.590090 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7361152-4f92-4035-8aa2-31a57779c7ba None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:43.591707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7361152-4f92-4035-8aa2-31a57779c7ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:43.592808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7361152-4f92-4035-8aa2-31a57779c7ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:43.596230 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7361152-4f92-4035-8aa2-31a57779c7ba None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:43.627411 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 304/610] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:28:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:43.629678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7361152-4f92-4035-8aa2-31a57779c7ba None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:43.677850 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcef7b-9e68-4c63-b7bf-3e20a72ae80b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:43.718837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc979f78-2406-44c8-b51b-c9aef1fe5c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:43.719554 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc979f78-2406-44c8-b51b-c9aef1fe5c03 None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:43.719877 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc979f78-2406-44c8-b51b-c9aef1fe5c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:43.720168 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc979f78-2406-44c8-b51b-c9aef1fe5c03 None admin] PATH_INFO: `/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/cf48978c20f04173b114e15e1ce2157c/roles/9b7a362fef7446e795c33b25a08f20bc` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:43.737671 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc979f78-2406-44c8-b51b-c9aef1fe5c03 None admin] RBAC: Authorizing `identity:create_grant(project_id=1180c1ddef2b493f83c41425fd2e7917, user_id=cf48978c20f04173b114e15e1ce2157c, role_id=9b7a362fef7446e795c33b25a08f20bc)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:43.739214 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc979f78-2406-44c8-b51b-c9aef1fe5c03 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:43.817674 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7361152-4f92-4035-8aa2-31a57779c7ba None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:43.831709 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 307/611] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:28:43 2022] PUT /identity/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/cf48978c20f04173b114e15e1ce2157c/roles/9b7a362fef7446e795c33b25a08f20bc => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:28:43.833177 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc979f78-2406-44c8-b51b-c9aef1fe5c03 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:43.846362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:43.858129 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:43.916240 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cac68-ce90-4da3-a4d5-b2754bcdcd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:43.917951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cac68-ce90-4da3-a4d5-b2754bcdcd89 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:43.918734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cac68-ce90-4da3-a4d5-b2754bcdcd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:43.919232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cac68-ce90-4da3-a4d5-b2754bcdcd89 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:43.921209 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cac68-ce90-4da3-a4d5-b2754bcdcd89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:43.922184 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cac68-ce90-4da3-a4d5-b2754bcdcd89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:43.925179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cac68-ce90-4da3-a4d5-b2754bcdcd89 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:43.956681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 305/612] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:43.965389 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cac68-ce90-4da3-a4d5-b2754bcdcd89 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:44.115727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc979f78-2406-44c8-b51b-c9aef1fe5c03 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:44.183109 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c5cba-1d9e-4935-a0b7-860daeccab68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:44.184227 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c5cba-1d9e-4935-a0b7-860daeccab68 None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:44.184666 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c5cba-1d9e-4935-a0b7-860daeccab68 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:44.185450 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c5cba-1d9e-4935-a0b7-860daeccab68 None admin] PATH_INFO: `/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/bac099b78bd04e02b8614c8afce53ab7/roles/9b7a362fef7446e795c33b25a08f20bc` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:44.191110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cac68-ce90-4da3-a4d5-b2754bcdcd89 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:44.232794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c5cba-1d9e-4935-a0b7-860daeccab68 None admin] RBAC: Authorizing `identity:create_grant(project_id=1180c1ddef2b493f83c41425fd2e7917, user_id=bac099b78bd04e02b8614c8afce53ab7, role_id=9b7a362fef7446e795c33b25a08f20bc)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:44.236610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c5cba-1d9e-4935-a0b7-860daeccab68 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:44.236729 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901dc65-a9c0-4db6-99fb-c2294c8bb223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:44.237429 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901dc65-a9c0-4db6-99fb-c2294c8bb223 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:44.237710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901dc65-a9c0-4db6-99fb-c2294c8bb223 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:44.237979 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901dc65-a9c0-4db6-99fb-c2294c8bb223 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:44.252965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901dc65-a9c0-4db6-99fb-c2294c8bb223 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:44.254512 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901dc65-a9c0-4db6-99fb-c2294c8bb223 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:44.268963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-f901dc65-a9c0-4db6-99fb-c2294c8bb223 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 16:28:44.268963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:44.268963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:44.268963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:44.268963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:44.268963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:44.268963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:44.268963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:44.268963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:44.268963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:44.268963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:44.268963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:44.268963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:28:44.268963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:28:44.268963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:28:44.268963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:44.270056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:44.271104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:44.271104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:44.271104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:28:44.271104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:28:44.271104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:28:44.271104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:28:44.271104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:28:44.271104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:28:44.271104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 16:28:44.271104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:44.271104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 306/613] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:28:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:44.272371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7540d-0e81-4627-918b-6a66bd5a1b54 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:44.272371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7540d-0e81-4627-918b-6a66bd5a1b54 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:44.272624 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7540d-0e81-4627-918b-6a66bd5a1b54 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:44.275593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 307/614] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:44.276665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7540d-0e81-4627-918b-6a66bd5a1b54 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:44.313753 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:44.335089 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 308/615] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:28:43 2022] PUT /identity/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/bac099b78bd04e02b8614c8afce53ab7/roles/9b7a362fef7446e795c33b25a08f20bc => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:28:44.335089 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0c9e8-3c5d-423c-bbb7-7e8f60b7c992 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:44.335089 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0c9e8-3c5d-423c-bbb7-7e8f60b7c992 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:44.335089 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0c9e8-3c5d-423c-bbb7-7e8f60b7c992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:44.377787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-c4b0c9e8-3c5d-423c-bbb7-7e8f60b7c992 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:44.378939 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c4b0c9e8-3c5d-423c-bbb7-7e8f60b7c992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:44.471737 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7540d-0e81-4627-918b-6a66bd5a1b54 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:44.499554 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:44.527603 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 309/616] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:44.542813 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175048d9-3e6d-4eb2-8dd0-a16dd913c6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:44.543670 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175048d9-3e6d-4eb2-8dd0-a16dd913c6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:44.544000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175048d9-3e6d-4eb2-8dd0-a16dd913c6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:44.544286 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175048d9-3e6d-4eb2-8dd0-a16dd913c6c3 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:44.545050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175048d9-3e6d-4eb2-8dd0-a16dd913c6c3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:44.545358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175048d9-3e6d-4eb2-8dd0-a16dd913c6c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:44.546868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175048d9-3e6d-4eb2-8dd0-a16dd913c6c3 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:44.587931 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 308/617] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Sep 7 16:28:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:44.593344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0c9e8-3c5d-423c-bbb7-7e8f60b7c992 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:44.734302 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0c9e8-3c5d-423c-bbb7-7e8f60b7c992 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:44.781848 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f94fe-f81e-4093-b45d-e6efaf2ea146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:44.782513 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f94fe-f81e-4093-b45d-e6efaf2ea146 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:44.782790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f94fe-f81e-4093-b45d-e6efaf2ea146 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:44.783061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f94fe-f81e-4093-b45d-e6efaf2ea146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:44.795898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f94fe-f81e-4093-b45d-e6efaf2ea146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:44.805154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f94fe-f81e-4093-b45d-e6efaf2ea146 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:44.823786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-d10f94fe-f81e-4093-b45d-e6efaf2ea146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:44.823786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:44.823786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:44.823786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:44.823786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:44.823786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:44.823786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:44.823786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:44.823786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:44.823786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:44.823786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:44.823786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:44.823786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:44.823786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:44.823786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:44.823786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:44.824815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:44.824815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:44.824815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:44.824815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:44.824815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:44.824815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:44.824815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:44.824815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:44.824815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:44.824815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:44.824815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:44.824815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:44.824815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:44.824815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:44.824815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:44.824815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:44.824815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:44.825838 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:44.825838 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:44.825838 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:44.825838 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 310/618] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:28:44.833152 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175048d9-3e6d-4eb2-8dd0-a16dd913c6c3 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:44.873505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f94fe-f81e-4093-b45d-e6efaf2ea146 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:44.919358 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:45.006806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f94fe-f81e-4093-b45d-e6efaf2ea146 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:45.062464 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccc158-175b-4887-9b3e-9c953c58a003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:45.063757 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:45.064794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccc158-175b-4887-9b3e-9c953c58a003 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:45.065100 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccc158-175b-4887-9b3e-9c953c58a003 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:45.065378 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccc158-175b-4887-9b3e-9c953c58a003 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:45.080087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175048d9-3e6d-4eb2-8dd0-a16dd913c6c3 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:45.104623 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccc158-175b-4887-9b3e-9c953c58a003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:45.110257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-74ccc158-175b-4887-9b3e-9c953c58a003 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:45.110257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:45.110257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:45.110257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:45.110257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:45.110257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:45.110257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:45.110257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:45.110257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:45.110257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:45.110257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:45.110257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:45.110257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:45.110257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:45.110257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:45.110257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:45.112594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:45.112594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:45.112594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:45.112594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:45.112594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:45.112594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:45.112594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:45.112594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:45.112594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:45.112594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:45.112594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:45.112594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:45.112594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:45.112594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:45.112594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:45.112594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:45.114705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:45.114705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:45.114705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:45.114705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:45.114705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:45.114705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:45.114705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:45.114705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:45.114705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:45.114705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:45.114705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:45.114705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:45.119589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 311/619] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:45.121974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccc158-175b-4887-9b3e-9c953c58a003 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:45.129116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75e36d-3369-4af8-a221-79d1e2748199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:45.129744 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75e36d-3369-4af8-a221-79d1e2748199 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:45.130031 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75e36d-3369-4af8-a221-79d1e2748199 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:45.130298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75e36d-3369-4af8-a221-79d1e2748199 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:45.130948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75e36d-3369-4af8-a221-79d1e2748199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:45.131248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75e36d-3369-4af8-a221-79d1e2748199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:45.132702 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75e36d-3369-4af8-a221-79d1e2748199 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:45.148337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 309/620] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:45.154113 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75e36d-3369-4af8-a221-79d1e2748199 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:45.283598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:45.292727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccc158-175b-4887-9b3e-9c953c58a003 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:45.349749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f31d7f-0e9b-4842-af82-5dc43ca55064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:45.350380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f31d7f-0e9b-4842-af82-5dc43ca55064 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:45.350667 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f31d7f-0e9b-4842-af82-5dc43ca55064 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:45.350942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f31d7f-0e9b-4842-af82-5dc43ca55064 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:45.351654 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f31d7f-0e9b-4842-af82-5dc43ca55064 None admin] RBAC: Adding query filter params (name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:45.351961 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f31d7f-0e9b-4842-af82-5dc43ca55064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:45.354412 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f31d7f-0e9b-4842-af82-5dc43ca55064 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:45.385015 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 312/621] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:28:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:45.386205 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f31d7f-0e9b-4842-af82-5dc43ca55064 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:45.461476 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75e36d-3369-4af8-a221-79d1e2748199 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:45.513449 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335026df-a887-4aa6-be6e-008984911e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:45.514505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335026df-a887-4aa6-be6e-008984911e8f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:45.515007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335026df-a887-4aa6-be6e-008984911e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:45.515534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335026df-a887-4aa6-be6e-008984911e8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:45.523517 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335026df-a887-4aa6-be6e-008984911e8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:45.526349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335026df-a887-4aa6-be6e-008984911e8f None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:45.539453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-335026df-a887-4aa6-be6e-008984911e8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:45.539453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:45.539453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:45.539453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:45.539453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:45.539453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:45.539453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:45.539453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:45.539453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:45.539453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:45.539453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:45.539453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:45.539453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:28:45.539453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:28:45.539453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:28:45.540584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:28:45.540584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:45.540584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:45.540584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:45.540584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:45.540584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:45.540584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:45.540584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:45.540584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:45.540584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:45.540584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:45.540584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:45.540584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:45.540584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:45.540584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:45.540584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:45.540584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:45.541496 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:28:45.541496 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:28:45.541496 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:28:45.541496 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:28:45.541496 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:28:45.541496 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:28:45.541496 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:45.541496 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:45.544057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 310/622] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:45.549992 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e065ca-deed-4698-8b48-cc74f88f95da None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:45.550995 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e065ca-deed-4698-8b48-cc74f88f95da None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:45.551545 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e065ca-deed-4698-8b48-cc74f88f95da None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:45.553471 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 311/623] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:45.554574 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e065ca-deed-4698-8b48-cc74f88f95da None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:45.573341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:45.600445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f31d7f-0e9b-4842-af82-5dc43ca55064 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:45.654784 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e44c9-9409-47a7-b9d5-7009316775c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:45.655889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e44c9-9409-47a7-b9d5-7009316775c6 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:45.656406 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e44c9-9409-47a7-b9d5-7009316775c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:45.657410 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e44c9-9409-47a7-b9d5-7009316775c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:45.674935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e44c9-9409-47a7-b9d5-7009316775c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:45.677956 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e44c9-9409-47a7-b9d5-7009316775c6 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:45.711128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-0f3e44c9-9409-47a7-b9d5-7009316775c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:45.711128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:45.711128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:45.711128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:45.711128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:45.711128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:45.711128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:45.711128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:45.711128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:45.711128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:45.711128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:45.711128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:45.711128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:45.711128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:45.711128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:45.711128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:45.712790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:45.712790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:45.712790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:45.712790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:45.712790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:45.712790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:45.712790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:45.712790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:45.712790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:45.712790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:45.712790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:45.712790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:45.712790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:45.712790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:45.712790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:45.712790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:45.712790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:45.713889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:45.713889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:45.713889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:45.714066 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 313/624] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:45.717252 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e065ca-deed-4698-8b48-cc74f88f95da None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:45.720178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d76fcd-4393-40a9-89fe-ed6de09aeb6e None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:45.720667 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d76fcd-4393-40a9-89fe-ed6de09aeb6e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:45.721969 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d76fcd-4393-40a9-89fe-ed6de09aeb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:45.757953 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31b14e-d2df-4155-8caa-9ce9ec77d045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:45.759594 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31b14e-d2df-4155-8caa-9ce9ec77d045 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:45.760125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31b14e-d2df-4155-8caa-9ce9ec77d045 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:45.760613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31b14e-d2df-4155-8caa-9ce9ec77d045 None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:45.761195 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-a1d76fcd-4393-40a9-89fe-ed6de09aeb6e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:45.761794 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31b14e-d2df-4155-8caa-9ce9ec77d045 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:45.762312 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31b14e-d2df-4155-8caa-9ce9ec77d045 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:45.763241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a1d76fcd-4393-40a9-89fe-ed6de09aeb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:45.764239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31b14e-d2df-4155-8caa-9ce9ec77d045 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:45.769006 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:45.783420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 312/625] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:28:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:45.784743 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31b14e-d2df-4155-8caa-9ce9ec77d045 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:45.863913 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:45.898867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31b14e-d2df-4155-8caa-9ce9ec77d045 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:45.908190 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 314/626] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:45.909715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d76fcd-4393-40a9-89fe-ed6de09aeb6e None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:45.938278 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18031b56-8172-49f9-bd2c-2e055b6cbe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:45.939271 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18031b56-8172-49f9-bd2c-2e055b6cbe3c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:45.939816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18031b56-8172-49f9-bd2c-2e055b6cbe3c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:45.940293 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18031b56-8172-49f9-bd2c-2e055b6cbe3c None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:45.941150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18031b56-8172-49f9-bd2c-2e055b6cbe3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:45.941659 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18031b56-8172-49f9-bd2c-2e055b6cbe3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:45.943251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18031b56-8172-49f9-bd2c-2e055b6cbe3c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:45.957051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 313/627] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:45.963617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18031b56-8172-49f9-bd2c-2e055b6cbe3c None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:46.125195 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d76fcd-4393-40a9-89fe-ed6de09aeb6e None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:46.176550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df3441-7791-427f-b243-f00e82d076ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:46.178474 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df3441-7791-427f-b243-f00e82d076ec None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:46.179871 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df3441-7791-427f-b243-f00e82d076ec None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:46.180576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df3441-7791-427f-b243-f00e82d076ec None admin] PATH_INFO: `/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/56cd868e866d436aa1d601f7791e812c/roles/9b7a362fef7446e795c33b25a08f20bc` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:46.213419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18031b56-8172-49f9-bd2c-2e055b6cbe3c None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:46.214935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:46.226026 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df3441-7791-427f-b243-f00e82d076ec None admin] RBAC: Authorizing `identity:create_grant(project_id=1180c1ddef2b493f83c41425fd2e7917, user_id=56cd868e866d436aa1d601f7791e812c, role_id=9b7a362fef7446e795c33b25a08f20bc)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:46.229707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df3441-7791-427f-b243-f00e82d076ec None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:46.273899 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:46.284228 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba56d0-c5ac-4bd7-88bd-2cb7bd287e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:46.285304 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba56d0-c5ac-4bd7-88bd-2cb7bd287e08 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:46.285712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba56d0-c5ac-4bd7-88bd-2cb7bd287e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:46.285993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba56d0-c5ac-4bd7-88bd-2cb7bd287e08 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:46.300426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba56d0-c5ac-4bd7-88bd-2cb7bd287e08 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:46.302933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba56d0-c5ac-4bd7-88bd-2cb7bd287e08 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:46.327780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-39ba56d0-c5ac-4bd7-88bd-2cb7bd287e08 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 16:28:46.327780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:46.327780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:46.327780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:46.327780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:46.327780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:46.327780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:46.327780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:46.327780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:46.327780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:46.327780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:46.327780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:46.327780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:28:46.327780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:28:46.327780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:28:46.327780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:46.328859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:46.329878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:46.329878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:46.329878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:28:46.329878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:28:46.329878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:28:46.329878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:28:46.329878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:28:46.329878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:28:46.329878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 16:28:46.329878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:46.331737 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 314/628] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:28:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:46.333300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 315/629] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:28:45 2022] PUT /identity/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/56cd868e866d436aa1d601f7791e812c/roles/9b7a362fef7446e795c33b25a08f20bc => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:28:46.340430 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba56d0-c5ac-4bd7-88bd-2cb7bd287e08 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:46.387225 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df3441-7791-427f-b243-f00e82d076ec None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:46.472389 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba56d0-c5ac-4bd7-88bd-2cb7bd287e08 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:46.532484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381e2b2-7ce2-486a-826d-d17d5bec17cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:46.533430 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381e2b2-7ce2-486a-826d-d17d5bec17cc None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:46.533866 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381e2b2-7ce2-486a-826d-d17d5bec17cc None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:46.534304 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381e2b2-7ce2-486a-826d-d17d5bec17cc None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:46.535237 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381e2b2-7ce2-486a-826d-d17d5bec17cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:46.535800 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381e2b2-7ce2-486a-826d-d17d5bec17cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:46.537457 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381e2b2-7ce2-486a-826d-d17d5bec17cc None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:46.581780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 315/630] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Sep 7 16:28:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:46.605339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381e2b2-7ce2-486a-826d-d17d5bec17cc None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:46.637091 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df3441-7791-427f-b243-f00e82d076ec None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:46.685608 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c753448-707a-4d29-b0ca-76f783755997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:46.686276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c753448-707a-4d29-b0ca-76f783755997 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:46.686556 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c753448-707a-4d29-b0ca-76f783755997 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:46.686823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c753448-707a-4d29-b0ca-76f783755997 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:46.701282 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c753448-707a-4d29-b0ca-76f783755997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:46.706269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-0c753448-707a-4d29-b0ca-76f783755997 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:46.706269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:46.706269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:46.706269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:46.706269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:46.706269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:46.706269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:46.706269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:46.706269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:46.706269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:46.706269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:46.706269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:46.706269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:46.706269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:46.706269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:46.706269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:46.708154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:46.708154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:46.708154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:46.708154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:46.708154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:46.708154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:46.708154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:46.708154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:46.708154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:46.708154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:46.708154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:46.708154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:46.708154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:46.708154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:46.708154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:46.708154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:46.712229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:46.712229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:46.712229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:46.712229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:46.712229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:46.712229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:46.712229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:46.712229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:46.712229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:46.712229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:46.712229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:46.712229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:46.712229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 316/631] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:28:46.712229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cde0e-ebe6-4a90-a0ea-13cfbf4e0d33 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:46.722351 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cde0e-ebe6-4a90-a0ea-13cfbf4e0d33 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:46.722351 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cde0e-ebe6-4a90-a0ea-13cfbf4e0d33 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:46.722351 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 317/632] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:46.722351 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cde0e-ebe6-4a90-a0ea-13cfbf4e0d33 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:46.734546 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:46.805244 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:46.818354 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381e2b2-7ce2-486a-826d-d17d5bec17cc None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:46.870602 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d31b3-e671-4820-804d-766add70ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:46.871272 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d31b3-e671-4820-804d-766add70ef93 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:46.872273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d31b3-e671-4820-804d-766add70ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:46.872559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d31b3-e671-4820-804d-766add70ef93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:46.897127 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cde0e-ebe6-4a90-a0ea-13cfbf4e0d33 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:46.956919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819f2bf-ea99-4065-a83d-99e6c1e80c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:46.957659 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819f2bf-ea99-4065-a83d-99e6c1e80c1b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:46.957999 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819f2bf-ea99-4065-a83d-99e6c1e80c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:46.958332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819f2bf-ea99-4065-a83d-99e6c1e80c1b None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:46.959089 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819f2bf-ea99-4065-a83d-99e6c1e80c1b None admin] RBAC: Adding query filter params (name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:46.959512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819f2bf-ea99-4065-a83d-99e6c1e80c1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:46.961178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819f2bf-ea99-4065-a83d-99e6c1e80c1b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:46.966372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d31b3-e671-4820-804d-766add70ef93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:46.968074 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d31b3-e671-4820-804d-766add70ef93 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:46.973106 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 318/633] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:28:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:46.974805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea3431-3004-4697-a701-a7b017e13939 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:46.975280 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea3431-3004-4697-a701-a7b017e13939 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:46.975643 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea3431-3004-4697-a701-a7b017e13939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:46.996934 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-61ea3431-3004-4697-a701-a7b017e13939 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:46.998346 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-61ea3431-3004-4697-a701-a7b017e13939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:47.038261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:47.099734 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 319/634] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:47.101187 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea3431-3004-4697-a701-a7b017e13939 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:47.124147 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 316/635] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:47.131249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d31b3-e671-4820-804d-766add70ef93 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:47.167870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:47.258248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea3431-3004-4697-a701-a7b017e13939 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:47.310565 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35891288-b4e6-49b4-bf5e-56f52bdd1347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:47.311210 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35891288-b4e6-49b4-bf5e-56f52bdd1347 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:47.311500 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35891288-b4e6-49b4-bf5e-56f52bdd1347 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:47.311806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35891288-b4e6-49b4-bf5e-56f52bdd1347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:47.324075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35891288-b4e6-49b4-bf5e-56f52bdd1347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:47.325766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35891288-b4e6-49b4-bf5e-56f52bdd1347 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:47.345218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-35891288-b4e6-49b4-bf5e-56f52bdd1347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:47.345218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:47.345218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:47.345218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:47.345218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:47.345218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:47.345218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:47.345218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:47.345218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:47.345218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:47.345218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:47.345218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:47.345218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:47.345218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:47.345218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:47.345218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:47.347681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:47.347681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:47.347681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:47.347681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:47.347681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:47.347681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:47.347681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:47.347681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:47.347681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:47.347681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:47.347681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:47.347681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:47.347681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:47.347681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:47.347681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:47.347681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:47.347681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:47.350071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:47.350071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:47.350071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:47.350071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 320/636] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:47.350071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af54e8-79a5-4e4d-81a2-0ea0028c233e None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:47.350071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af54e8-79a5-4e4d-81a2-0ea0028c233e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:47.350676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d31b3-e671-4820-804d-766add70ef93 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:47.355707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af54e8-79a5-4e4d-81a2-0ea0028c233e None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:47.355707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 321/637] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:47.361451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af54e8-79a5-4e4d-81a2-0ea0028c233e None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:47.400559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d26dee-3892-46d4-87ae-1cfc824efc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:47.401127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d26dee-3892-46d4-87ae-1cfc824efc8c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:47.401409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d26dee-3892-46d4-87ae-1cfc824efc8c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:47.401680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d26dee-3892-46d4-87ae-1cfc824efc8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:47.413650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d26dee-3892-46d4-87ae-1cfc824efc8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:47.415792 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d26dee-3892-46d4-87ae-1cfc824efc8c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:47.426454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:47.435239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-d6d26dee-3892-46d4-87ae-1cfc824efc8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:47.435239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:47.435239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:47.435239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:47.435239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:47.435239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:47.435239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:47.435239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:47.435239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:47.435239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:47.435239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:47.435239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:47.435239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:47.435239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:47.435239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:47.435239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:47.436830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:47.436830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:47.436830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:47.436830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:47.436830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:47.436830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:47.436830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:47.436830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:47.436830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:47.436830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:47.436830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:47.436830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:47.436830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:47.436830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:47.436830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:47.436830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:47.436830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:47.437741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:47.437741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:47.437741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:47.441230 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 317/638] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:47.443081 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dce4b-d8a0-4d6d-bc90-79ec6de6a1d1 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:47.443252 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dce4b-d8a0-4d6d-bc90-79ec6de6a1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:47.443647 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dce4b-d8a0-4d6d-bc90-79ec6de6a1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:47.464920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-fc1dce4b-d8a0-4d6d-bc90-79ec6de6a1d1 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:47.466139 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-fc1dce4b-d8a0-4d6d-bc90-79ec6de6a1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:47.507798 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:47.522042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af54e8-79a5-4e4d-81a2-0ea0028c233e None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:47.559520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 318/639] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:47.559520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dce4b-d8a0-4d6d-bc90-79ec6de6a1d1 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:47.588878 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8bb00-0b76-4b11-bd25-54cd9ea43806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:47.590157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8bb00-0b76-4b11-bd25-54cd9ea43806 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:47.590436 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8bb00-0b76-4b11-bd25-54cd9ea43806 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:47.590711 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8bb00-0b76-4b11-bd25-54cd9ea43806 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:47.591667 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8bb00-0b76-4b11-bd25-54cd9ea43806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:47.591978 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8bb00-0b76-4b11-bd25-54cd9ea43806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:47.593700 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8bb00-0b76-4b11-bd25-54cd9ea43806 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:47.610931 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 322/640] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:47.611946 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8bb00-0b76-4b11-bd25-54cd9ea43806 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:47.707656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dce4b-d8a0-4d6d-bc90-79ec6de6a1d1 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:47.742189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:47.749959 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be1ee0-2e73-4e25-af72-50a2d7954fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:47.751127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be1ee0-2e73-4e25-af72-50a2d7954fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:47.751393 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be1ee0-2e73-4e25-af72-50a2d7954fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:47.751798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be1ee0-2e73-4e25-af72-50a2d7954fe7 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:47.757010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be1ee0-2e73-4e25-af72-50a2d7954fe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:47.757010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be1ee0-2e73-4e25-af72-50a2d7954fe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:47.757010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be1ee0-2e73-4e25-af72-50a2d7954fe7 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:47.763732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8bb00-0b76-4b11-bd25-54cd9ea43806 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:47.781575 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 319/641] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:47.781575 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be1ee0-2e73-4e25-af72-50a2d7954fe7 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:47.809744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa6eb2-dd8b-47cf-a7c5-8fc284005e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:47.810699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa6eb2-dd8b-47cf-a7c5-8fc284005e9f None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:47.811159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa6eb2-dd8b-47cf-a7c5-8fc284005e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:47.811654 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa6eb2-dd8b-47cf-a7c5-8fc284005e9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:47.824453 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa6eb2-dd8b-47cf-a7c5-8fc284005e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:47.830664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-69aa6eb2-dd8b-47cf-a7c5-8fc284005e9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:47.830664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:47.830664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:47.830664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:47.830664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:47.830664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:47.830664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:47.830664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:47.830664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:47.830664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:47.830664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:47.830664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:47.830664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:47.830664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:47.830664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:47.830664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:47.831660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:47.831660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:47.831660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:47.831660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:47.831660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:47.831660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:47.831660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:47.831660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:47.831660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:47.831660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:47.831660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:47.831660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:47.831660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:47.831660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:47.831660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:47.831660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:47.832521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:47.832521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:47.832521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:47.832521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:47.832521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:47.832521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:47.832521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:47.832521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:47.832521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:47.832521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:47.832521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:47.832521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:47.834903 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 323/642] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:47.835997 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa6eb2-dd8b-47cf-a7c5-8fc284005e9f None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:47.855064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:47.904503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be1ee0-2e73-4e25-af72-50a2d7954fe7 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:47.948080 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a3de7-de9e-4da1-8358-f3368154465d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:47.948833 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a3de7-de9e-4da1-8358-f3368154465d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:47.949179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a3de7-de9e-4da1-8358-f3368154465d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:47.949542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a3de7-de9e-4da1-8358-f3368154465d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:47.960322 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a3de7-de9e-4da1-8358-f3368154465d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:47.963253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a3de7-de9e-4da1-8358-f3368154465d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:47.966492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa6eb2-dd8b-47cf-a7c5-8fc284005e9f None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:47.983204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-264a3de7-de9e-4da1-8358-f3368154465d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 16:28:47.983204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:47.983204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:47.983204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:47.983204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:47.983204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:47.983204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:47.983204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:47.983204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:47.983204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:47.983204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:47.983204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:47.983204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:28:47.983204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:28:47.983204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:28:47.983204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:47.984865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:47.986036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:47.986036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:47.986036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:28:47.986036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:28:47.986036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:28:47.986036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:28:47.986036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:28:47.986036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:28:47.986036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 16:28:47.986036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:47.986036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 320/643] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:28:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:47.986980 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a3de7-de9e-4da1-8358-f3368154465d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:48.037853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d01fd7-6f5c-4364-88b7-aef5e37dc3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:48.039334 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d01fd7-6f5c-4364-88b7-aef5e37dc3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:48.040236 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d01fd7-6f5c-4364-88b7-aef5e37dc3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:48.040994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d01fd7-6f5c-4364-88b7-aef5e37dc3b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:48.042590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:48.053082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d01fd7-6f5c-4364-88b7-aef5e37dc3b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:48.056429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d01fd7-6f5c-4364-88b7-aef5e37dc3b6 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:48.078580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-01d01fd7-6f5c-4364-88b7-aef5e37dc3b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:48.078580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:48.078580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:48.078580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:48.078580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:48.078580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:48.078580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:48.078580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:48.078580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:48.078580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:48.078580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:48.078580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:48.078580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:28:48.078580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:28:48.078580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:28:48.079812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:28:48.079812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:48.079812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:48.079812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:48.079812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:48.079812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:48.079812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:48.079812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:48.079812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:48.079812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:48.079812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:48.079812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:48.079812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:48.079812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:48.079812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:48.079812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:48.079812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:48.080887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:28:48.080887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:28:48.080887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:28:48.080887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:28:48.080887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:28:48.080887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:28:48.080887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:48.080887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:48.080887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 324/644] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:48.081980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d01fd7-6f5c-4364-88b7-aef5e37dc3b6 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:48.104290 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a3de7-de9e-4da1-8358-f3368154465d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:48.146481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef0ba6-d8e4-4919-a56c-400114dbe21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:48.147090 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef0ba6-d8e4-4919-a56c-400114dbe21f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:48.147362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef0ba6-d8e4-4919-a56c-400114dbe21f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:48.147669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef0ba6-d8e4-4919-a56c-400114dbe21f None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:48.148326 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef0ba6-d8e4-4919-a56c-400114dbe21f None admin] RBAC: Adding query filter params (name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:48.148621 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef0ba6-d8e4-4919-a56c-400114dbe21f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:48.150028 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef0ba6-d8e4-4919-a56c-400114dbe21f None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:48.160260 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 321/645] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:28:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:48.165664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef0ba6-d8e4-4919-a56c-400114dbe21f None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:48.214613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:48.257788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d01fd7-6f5c-4364-88b7-aef5e37dc3b6 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:48.315261 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fd3e2-138c-456f-8ad5-660a29ffe40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:48.316025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fd3e2-138c-456f-8ad5-660a29ffe40a None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:48.316466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fd3e2-138c-456f-8ad5-660a29ffe40a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:48.316900 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fd3e2-138c-456f-8ad5-660a29ffe40a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:48.335038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573fd3e2-138c-456f-8ad5-660a29ffe40a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:48.345196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-573fd3e2-138c-456f-8ad5-660a29ffe40a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:48.345196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:48.345196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:48.345196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:48.345196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:48.345196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:48.345196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:48.345196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:48.345196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:48.345196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:48.345196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:48.345196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:48.345196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:48.345196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:48.345196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:48.345196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:48.346586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:48.346586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:48.346586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:48.346586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:48.346586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:48.346586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:48.346586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:48.346586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:48.346586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:48.346586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:48.346586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:48.346586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:48.346586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:48.346586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:48.346586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:48.346586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:48.348119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:48.348119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:48.348119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:48.348119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:48.348119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:48.348119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:48.348119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:48.348119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:48.348119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:48.348119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:48.348119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:48.348119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:48.348119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 325/646] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:48.348119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fd3e2-138c-456f-8ad5-660a29ffe40a None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:48.357462 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef0ba6-d8e4-4919-a56c-400114dbe21f None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:48.379948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:48.419701 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b2576-3289-403b-8350-2b3f08d7c5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:48.420343 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b2576-3289-403b-8350-2b3f08d7c5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:48.420618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b2576-3289-403b-8350-2b3f08d7c5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:48.420883 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b2576-3289-403b-8350-2b3f08d7c5e0 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:48.421909 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b2576-3289-403b-8350-2b3f08d7c5e0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:48.422399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b2576-3289-403b-8350-2b3f08d7c5e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:48.424671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b2576-3289-403b-8350-2b3f08d7c5e0 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:48.457830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 322/647] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Sep 7 16:28:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:48.457830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b2576-3289-403b-8350-2b3f08d7c5e0 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:48.514025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fd3e2-138c-456f-8ad5-660a29ffe40a None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:48.556693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c1643-0325-4837-a981-1d7518b86de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:48.557529 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1643-0325-4837-a981-1d7518b86de8 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:48.557902 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1643-0325-4837-a981-1d7518b86de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:48.558311 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1643-0325-4837-a981-1d7518b86de8 None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:48.559008 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c1643-0325-4837-a981-1d7518b86de8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:48.559313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c1643-0325-4837-a981-1d7518b86de8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:48.560802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c1643-0325-4837-a981-1d7518b86de8 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:48.562616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:48.582988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 326/648] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:28:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:48.583885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c1643-0325-4837-a981-1d7518b86de8 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:48.585508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b2576-3289-403b-8350-2b3f08d7c5e0 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:48.640269 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e300d6-7119-406d-89fb-11777f5411b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:48.640924 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e300d6-7119-406d-89fb-11777f5411b2 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:48.641201 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e300d6-7119-406d-89fb-11777f5411b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:48.641479 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e300d6-7119-406d-89fb-11777f5411b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:48.660326 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e300d6-7119-406d-89fb-11777f5411b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:48.662303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e300d6-7119-406d-89fb-11777f5411b2 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:48.691345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-17e300d6-7119-406d-89fb-11777f5411b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:48.691345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:48.691345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:48.691345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:48.691345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:48.691345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:48.691345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:48.691345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:48.691345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:48.691345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:48.691345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:48.691345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:48.691345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:48.691345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:48.691345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:48.691345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:48.692860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:48.692860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:48.692860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:48.692860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:48.692860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:48.692860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:48.692860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:48.692860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:48.692860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:48.692860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:48.692860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:48.692860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:48.692860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:48.692860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:48.692860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:48.692860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:48.692860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:48.693763 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:48.693763 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:48.693763 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:48.693763 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 323/649] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:48.694486 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e300d6-7119-406d-89fb-11777f5411b2 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:48.708653 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c1643-0325-4837-a981-1d7518b86de8 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:48.735596 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:48.750195 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbead97-bfcd-4efa-9dc2-8fae3fb4cc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:48.750733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbead97-bfcd-4efa-9dc2-8fae3fb4cc48 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:48.751007 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbead97-bfcd-4efa-9dc2-8fae3fb4cc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:48.751273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbead97-bfcd-4efa-9dc2-8fae3fb4cc48 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:48.751965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbead97-bfcd-4efa-9dc2-8fae3fb4cc48 None admin] RBAC: Adding query filter params (name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:48.752270 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbead97-bfcd-4efa-9dc2-8fae3fb4cc48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:48.753633 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbead97-bfcd-4efa-9dc2-8fae3fb4cc48 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:48.763450 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 327/650] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:28:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:48.765317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbead97-bfcd-4efa-9dc2-8fae3fb4cc48 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:48.844528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:48.873269 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e300d6-7119-406d-89fb-11777f5411b2 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:48.908313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbead97-bfcd-4efa-9dc2-8fae3fb4cc48 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:48.920309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1790f9-96cb-4409-b485-96d4ffca0387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:48.921199 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1790f9-96cb-4409-b485-96d4ffca0387 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:48.921472 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1790f9-96cb-4409-b485-96d4ffca0387 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:48.921748 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1790f9-96cb-4409-b485-96d4ffca0387 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:48.948306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f835b-51f6-4c61-a982-be28d15fecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:48.948927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f835b-51f6-4c61-a982-be28d15fecab None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:48.949209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f835b-51f6-4c61-a982-be28d15fecab None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:48.949476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f835b-51f6-4c61-a982-be28d15fecab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:48.950213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f835b-51f6-4c61-a982-be28d15fecab None admin] RBAC: Adding query filter params (role.id=9b7a362fef7446e795c33b25a08f20bc, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=52705fc64cd54b1985ef2cb02f6c47fc) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:48.950515 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f835b-51f6-4c61-a982-be28d15fecab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:48.952015 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f835b-51f6-4c61-a982-be28d15fecab None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:48.958562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 328/651] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:28:48 2022] GET /identity/v3/role_assignments?user.id=52705fc64cd54b1985ef2cb02f6c47fc&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9b7a362fef7446e795c33b25a08f20bc => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:48.959399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f835b-51f6-4c61-a982-be28d15fecab None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:49.050221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1790f9-96cb-4409-b485-96d4ffca0387 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:49.053130 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1790f9-96cb-4409-b485-96d4ffca0387 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:49.119713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:49.128652 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f835b-51f6-4c61-a982-be28d15fecab None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:49.168605 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:49.199258 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d658f-9887-4ec8-a889-861f7a75fa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:49.199533 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d658f-9887-4ec8-a889-861f7a75fa31 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:49.199822 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d658f-9887-4ec8-a889-861f7a75fa31 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:49.200096 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d658f-9887-4ec8-a889-861f7a75fa31 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:49.200756 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d658f-9887-4ec8-a889-861f7a75fa31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:49.201056 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d658f-9887-4ec8-a889-861f7a75fa31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:49.202497 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d658f-9887-4ec8-a889-861f7a75fa31 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:49.220553 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 329/652] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:49.222087 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d658f-9887-4ec8-a889-861f7a75fa31 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:49.244011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 324/653] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:49.245761 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd7483-f6cd-452c-a918-1d12796389c7 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:49.246245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd7483-f6cd-452c-a918-1d12796389c7 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:49.246741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd7483-f6cd-452c-a918-1d12796389c7 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:49.248975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 325/654] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:49.249773 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd7483-f6cd-452c-a918-1d12796389c7 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:49.388473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d658f-9887-4ec8-a889-861f7a75fa31 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:49.404814 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd7483-f6cd-452c-a918-1d12796389c7 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:49.443328 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:49.460767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d2c46-56a7-423d-9b96-5aff28efda38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:49.461523 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d2c46-56a7-423d-9b96-5aff28efda38 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:49.462342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d2c46-56a7-423d-9b96-5aff28efda38 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:49.462857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d2c46-56a7-423d-9b96-5aff28efda38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:49.464295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f710cee-82cd-44a8-94d9-e3a1460d9d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:49.465149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f710cee-82cd-44a8-94d9-e3a1460d9d54 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:49.465570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f710cee-82cd-44a8-94d9-e3a1460d9d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:49.465992 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f710cee-82cd-44a8-94d9-e3a1460d9d54 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:49.476657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d2c46-56a7-423d-9b96-5aff28efda38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:49.478149 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d2c46-56a7-423d-9b96-5aff28efda38 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:49.484607 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f710cee-82cd-44a8-94d9-e3a1460d9d54 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:49.486134 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f710cee-82cd-44a8-94d9-e3a1460d9d54 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:49.499904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-4f710cee-82cd-44a8-94d9-e3a1460d9d54 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:28:49.499904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:49.499904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:49.499904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:49.499904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:49.499904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:49.499904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:49.499904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:49.499904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:49.499904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:49.499904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:49.499904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:49.499904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:28:49.499904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:28:49.499904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:28:49.499904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:49.500951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:49.501939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:49.501939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:49.501939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:28:49.501939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:28:49.501939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:28:49.501939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:28:49.501939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:28:49.501939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:28:49.501939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:28:49.501939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:49.502508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-658d2c46-56a7-423d-9b96-5aff28efda38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:49.502508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:49.502508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:49.502508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:49.502508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:49.502508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:49.502508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:49.502508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:49.502508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:49.502508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:49.502508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:49.502508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:49.502508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:49.502508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:49.502508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:49.502508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:49.503364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:49.503364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:49.503364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:49.503364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:49.503364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:49.503364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:49.503364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:49.503364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:49.503364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:49.503364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:49.503364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:49.503364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:49.503364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:49.503364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:49.503364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:49.503364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:49.503364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:49.506712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:49.506712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:49.506712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:49.507361 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 326/655] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Sep 7 16:28:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:49.507361 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f710cee-82cd-44a8-94d9-e3a1460d9d54 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:49.509565 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 330/656] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:49.510266 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a2159-ab12-4514-a130-eea2376a4d72 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:49.510442 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a2159-ab12-4514-a130-eea2376a4d72 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:49.510682 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a2159-ab12-4514-a130-eea2376a4d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:49.542324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-f05a2159-ab12-4514-a130-eea2376a4d72 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:49.544347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f05a2159-ab12-4514-a130-eea2376a4d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:49.585426 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:49.661144 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f710cee-82cd-44a8-94d9-e3a1460d9d54 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:49.669333 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 331/657] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:49.671923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a2159-ab12-4514-a130-eea2376a4d72 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:49.728542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfa960-c6e3-4edb-b840-917453171731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:49.729680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfa960-c6e3-4edb-b840-917453171731 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:49.730268 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfa960-c6e3-4edb-b840-917453171731 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:49.730708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfa960-c6e3-4edb-b840-917453171731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:49.751265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dfa960-c6e3-4edb-b840-917453171731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:49.753012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dfa960-c6e3-4edb-b840-917453171731 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:49.775300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-73dfa960-c6e3-4edb-b840-917453171731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:49.775300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:49.775300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:49.775300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:49.775300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:49.775300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:49.775300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:49.775300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:49.775300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:49.775300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:49.775300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:49.775300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:49.775300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:49.775300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:49.775300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:49.775300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:49.776372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:49.776372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:49.776372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:49.776372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:49.776372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:49.776372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:49.776372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:49.776372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:49.776372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:49.776372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:49.776372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:49.776372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:49.776372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:49.776372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:49.776372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:49.776372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:49.776372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:49.777303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:49.777303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:49.777303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:49.781738 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 327/658] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:49.782772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfa960-c6e3-4edb-b840-917453171731 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:49.859464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:49.905028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a2159-ab12-4514-a130-eea2376a4d72 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:49.968821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5c0ba-cf26-4406-ba85-0f9a9f51da15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:49.969733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5c0ba-cf26-4406-ba85-0f9a9f51da15 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:49.970025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5c0ba-cf26-4406-ba85-0f9a9f51da15 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:49.970514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5c0ba-cf26-4406-ba85-0f9a9f51da15 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:49.971910 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5c0ba-cf26-4406-ba85-0f9a9f51da15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:49.972431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5c0ba-cf26-4406-ba85-0f9a9f51da15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:49.976006 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5c0ba-cf26-4406-ba85-0f9a9f51da15 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:50.004289 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfa960-c6e3-4edb-b840-917453171731 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:50.014426 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 332/659] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Sep 7 16:28:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:50.014426 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5c0ba-cf26-4406-ba85-0f9a9f51da15 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:50.039005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:50.064417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552e912-e6fb-42e0-911a-9f73a52f5500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:50.065038 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552e912-e6fb-42e0-911a-9f73a52f5500 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:50.065317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552e912-e6fb-42e0-911a-9f73a52f5500 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:50.065599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552e912-e6fb-42e0-911a-9f73a52f5500 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:50.067001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552e912-e6fb-42e0-911a-9f73a52f5500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:50.067307 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552e912-e6fb-42e0-911a-9f73a52f5500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:50.068798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552e912-e6fb-42e0-911a-9f73a52f5500 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:50.085298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 328/660] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:50.087114 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552e912-e6fb-42e0-911a-9f73a52f5500 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:50.164195 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5c0ba-cf26-4406-ba85-0f9a9f51da15 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:50.203928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0e216-b63a-4af5-9911-b5a9339b66b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:50.204564 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0e216-b63a-4af5-9911-b5a9339b66b4 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:50.204819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0e216-b63a-4af5-9911-b5a9339b66b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:50.205091 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0e216-b63a-4af5-9911-b5a9339b66b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:50.205736 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0e216-b63a-4af5-9911-b5a9339b66b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:50.206036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0e216-b63a-4af5-9911-b5a9339b66b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:50.207423 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0e216-b63a-4af5-9911-b5a9339b66b4 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:50.222862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 333/661] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:50.223832 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0e216-b63a-4af5-9911-b5a9339b66b4 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:50.253391 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:50.263056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552e912-e6fb-42e0-911a-9f73a52f5500 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:50.319238 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff81b0-1f74-41f8-b1af-ab06cd274938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:50.320422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff81b0-1f74-41f8-b1af-ab06cd274938 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:50.321476 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff81b0-1f74-41f8-b1af-ab06cd274938 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:50.322037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff81b0-1f74-41f8-b1af-ab06cd274938 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:50.340503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff81b0-1f74-41f8-b1af-ab06cd274938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:50.347062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-39ff81b0-1f74-41f8-b1af-ab06cd274938 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:50.347062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:50.347062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:50.347062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:50.347062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:50.347062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:50.347062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:50.347062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:50.347062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:50.347062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:50.347062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:50.347062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:50.347062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:50.347062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:50.347062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:50.347062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:50.349588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:50.349588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:50.349588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:50.349588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:50.349588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:50.349588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:50.349588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:50.349588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:50.349588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:50.349588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:50.349588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:50.349588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:50.349588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:50.349588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:50.349588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:50.349588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:50.351445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:50.351445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:50.351445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:50.351445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:50.351445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:50.351445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:50.351445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:50.351445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:50.351445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:50.351445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:50.351445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:50.351445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:50.351445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 329/662] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:50.351445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff81b0-1f74-41f8-b1af-ab06cd274938 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:50.362557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:50.385829 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0e216-b63a-4af5-9911-b5a9339b66b4 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:50.432405 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9bd22-e539-451e-ada2-7bef703ca9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:50.433225 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9bd22-e539-451e-ada2-7bef703ca9cd None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:50.433505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9bd22-e539-451e-ada2-7bef703ca9cd None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:50.433781 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9bd22-e539-451e-ada2-7bef703ca9cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:50.512676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff81b0-1f74-41f8-b1af-ab06cd274938 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:50.517939 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9bd22-e539-451e-ada2-7bef703ca9cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:50.520801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9bd22-e539-451e-ada2-7bef703ca9cd None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:50.556277 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ed848-3e92-49b4-8bdf-caf9ffb0f959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:50.557332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ed848-3e92-49b4-8bdf-caf9ffb0f959 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:50.557824 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ed848-3e92-49b4-8bdf-caf9ffb0f959 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:50.558298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ed848-3e92-49b4-8bdf-caf9ffb0f959 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:50.572393 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ed848-3e92-49b4-8bdf-caf9ffb0f959 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:50.574583 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ed848-3e92-49b4-8bdf-caf9ffb0f959 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:50.593965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-0c2ed848-3e92-49b4-8bdf-caf9ffb0f959 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 16:28:50.593965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:50.593965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:50.593965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:50.593965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:50.593965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:50.593965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:50.593965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:50.593965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:50.593965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:50.593965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:50.593965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:50.593965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:28:50.593965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:28:50.593965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:28:50.593965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:50.596372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:50.598233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:50.598233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:50.598233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:28:50.598233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:28:50.598233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:28:50.598233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:28:50.598233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:28:50.598233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:28:50.598233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 16:28:50.598233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:50.598233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 330/663] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:50.598233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ed848-3e92-49b4-8bdf-caf9ffb0f959 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:50.622923 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:50.687167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:50.720066 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 334/664] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:50.720066 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9bd22-e539-451e-ada2-7bef703ca9cd None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:50.796341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ed848-3e92-49b4-8bdf-caf9ffb0f959 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:50.840706 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d6db3-4618-4c1f-973d-0b9a6c5478fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:50.841355 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d6db3-4618-4c1f-973d-0b9a6c5478fa None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:50.841646 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d6db3-4618-4c1f-973d-0b9a6c5478fa None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:50.841922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d6db3-4618-4c1f-973d-0b9a6c5478fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:50.850307 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d6db3-4618-4c1f-973d-0b9a6c5478fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:50.851798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d6db3-4618-4c1f-973d-0b9a6c5478fa None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:50.865212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-fd0d6db3-4618-4c1f-973d-0b9a6c5478fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:50.865212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:50.865212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:50.865212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:50.865212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:50.865212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:50.865212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:50.865212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:50.865212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:50.865212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:50.865212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:50.865212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:50.865212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:28:50.865212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:28:50.865212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:28:50.866573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:28:50.866573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:50.866573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:50.866573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:50.866573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:50.866573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:50.866573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:50.866573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:50.866573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:50.866573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:50.866573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:50.866573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:50.866573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:50.866573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:50.866573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:50.866573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:50.866573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:50.867941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:28:50.867941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:28:50.867941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:28:50.867941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:28:50.867941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:28:50.867941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:28:50.867941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:50.867941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:50.867941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 331/665] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:50.867941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d6db3-4618-4c1f-973d-0b9a6c5478fa None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:50.886344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9bd22-e539-451e-ada2-7bef703ca9cd None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:50.938765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152036d-096a-4dbd-90d2-9815f8c6281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:50.939854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152036d-096a-4dbd-90d2-9815f8c6281e None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:50.940317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152036d-096a-4dbd-90d2-9815f8c6281e None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:50.940730 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152036d-096a-4dbd-90d2-9815f8c6281e None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:50.941909 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152036d-096a-4dbd-90d2-9815f8c6281e None admin] RBAC: Adding query filter params (name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:50.942440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152036d-096a-4dbd-90d2-9815f8c6281e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:50.945025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152036d-096a-4dbd-90d2-9815f8c6281e None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:50.961020 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 335/666] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:28:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:50.971187 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152036d-096a-4dbd-90d2-9815f8c6281e None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:50.992330 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:51.037269 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d6db3-4618-4c1f-973d-0b9a6c5478fa None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:51.045662 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:51.094853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cc325-c340-4182-ad73-55563bc3cf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:51.095949 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc325-c340-4182-ad73-55563bc3cf4e None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:51.096437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc325-c340-4182-ad73-55563bc3cf4e None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:51.096982 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc325-c340-4182-ad73-55563bc3cf4e None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:51.097925 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cc325-c340-4182-ad73-55563bc3cf4e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:51.098438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cc325-c340-4182-ad73-55563bc3cf4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:51.100469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cc325-c340-4182-ad73-55563bc3cf4e None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:51.124332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 332/667] 10.222.0.25 () {56 vars in 1139 bytes} [Wed Sep 7 16:28:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:51.131937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cc325-c340-4182-ad73-55563bc3cf4e None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:51.154417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152036d-096a-4dbd-90d2-9815f8c6281e None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:51.203002 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41e37b-39ec-4611-b0f1-96d3a482e43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:51.203922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41e37b-39ec-4611-b0f1-96d3a482e43e None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:51.204343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41e37b-39ec-4611-b0f1-96d3a482e43e None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:51.204755 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41e37b-39ec-4611-b0f1-96d3a482e43e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:51.219849 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41e37b-39ec-4611-b0f1-96d3a482e43e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:51.221707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41e37b-39ec-4611-b0f1-96d3a482e43e None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:51.241771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-cb41e37b-39ec-4611-b0f1-96d3a482e43e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:51.241771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:51.241771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:51.241771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:51.241771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:51.241771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:51.241771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:51.241771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:51.241771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:51.241771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:51.241771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:51.241771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:51.241771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:51.241771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:51.241771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:51.241771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:51.244482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:51.244482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:51.244482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:51.244482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:51.244482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:51.244482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:51.244482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:51.244482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:51.244482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:51.244482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:51.244482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:51.244482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:51.244482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:51.244482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:51.244482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:51.244482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:51.244482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:51.245497 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:51.245497 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:51.245497 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:51.250874 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 336/668] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:51.250874 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41e37b-39ec-4611-b0f1-96d3a482e43e None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:51.332700 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cc325-c340-4182-ad73-55563bc3cf4e None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:51.383313 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:51.392795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189da6b-6adb-4abd-ab21-b3c96dab2c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:51.395078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189da6b-6adb-4abd-ab21-b3c96dab2c01 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:51.395792 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189da6b-6adb-4abd-ab21-b3c96dab2c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:51.397068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189da6b-6adb-4abd-ab21-b3c96dab2c01 None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:51.398551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189da6b-6adb-4abd-ab21-b3c96dab2c01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:51.400153 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189da6b-6adb-4abd-ab21-b3c96dab2c01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:51.403190 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189da6b-6adb-4abd-ab21-b3c96dab2c01 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:51.424772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 333/669] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:28:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:51.425759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189da6b-6adb-4abd-ab21-b3c96dab2c01 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:51.426590 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:51.444116 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41e37b-39ec-4611-b0f1-96d3a482e43e None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:51.509424 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfca946-a8bc-4b91-b935-2e6657755a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:51.510503 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfca946-a8bc-4b91-b935-2e6657755a86 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:51.511008 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfca946-a8bc-4b91-b935-2e6657755a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:51.511494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfca946-a8bc-4b91-b935-2e6657755a86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:51.533062 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfca946-a8bc-4b91-b935-2e6657755a86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:51.535871 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfca946-a8bc-4b91-b935-2e6657755a86 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:51.563797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-edfca946-a8bc-4b91-b935-2e6657755a86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:51.563797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:51.563797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:51.563797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:51.563797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:51.563797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:51.563797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:51.563797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:51.563797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:51.563797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:51.563797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:51.563797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:51.563797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:51.563797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:51.563797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:51.563797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:51.564858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:51.564858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:51.564858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:51.564858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:51.564858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:51.564858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:51.564858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:51.564858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:51.564858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:51.564858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:51.564858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:51.564858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:51.564858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:51.564858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:51.564858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:51.564858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:51.564858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:51.565753 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:51.565753 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:51.565753 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:51.565931 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 337/670] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:51.567302 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfca946-a8bc-4b91-b935-2e6657755a86 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:51.624844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189da6b-6adb-4abd-ab21-b3c96dab2c01 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:51.672026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85cf7b-c588-4cc1-8572-9b424bce901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:51.672783 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85cf7b-c588-4cc1-8572-9b424bce901c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:51.673151 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85cf7b-c588-4cc1-8572-9b424bce901c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:51.673514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85cf7b-c588-4cc1-8572-9b424bce901c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:51.712816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfca946-a8bc-4b91-b935-2e6657755a86 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:51.752315 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99c5bd-1191-4b13-aa94-dbec3c22e124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:51.752942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99c5bd-1191-4b13-aa94-dbec3c22e124 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:51.753222 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99c5bd-1191-4b13-aa94-dbec3c22e124 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:51.753495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99c5bd-1191-4b13-aa94-dbec3c22e124 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:51.754147 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99c5bd-1191-4b13-aa94-dbec3c22e124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:51.754449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99c5bd-1191-4b13-aa94-dbec3c22e124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:51.755870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99c5bd-1191-4b13-aa94-dbec3c22e124 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:51.769171 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 338/671] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:51.770038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99c5bd-1191-4b13-aa94-dbec3c22e124 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:51.776029 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:51.783144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:51.793192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85cf7b-c588-4cc1-8572-9b424bce901c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:51.795881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85cf7b-c588-4cc1-8572-9b424bce901c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:51.949083 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99c5bd-1191-4b13-aa94-dbec3c22e124 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:51.984645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 334/672] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:51.985546 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85cf7b-c588-4cc1-8572-9b424bce901c None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:51.992978 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b019555-91b1-41f3-9646-3d29b4a39615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:51.993698 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b019555-91b1-41f3-9646-3d29b4a39615 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:51.994037 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b019555-91b1-41f3-9646-3d29b4a39615 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:51.994365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b019555-91b1-41f3-9646-3d29b4a39615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:51.995185 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b019555-91b1-41f3-9646-3d29b4a39615 None admin] RBAC: Adding query filter params (role.id=9b7a362fef7446e795c33b25a08f20bc, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=73216eee250744bb9d9b81dd983376ad) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:51.995602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b019555-91b1-41f3-9646-3d29b4a39615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:51.997224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b019555-91b1-41f3-9646-3d29b4a39615 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:52.005863 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 339/673] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:28:51 2022] GET /identity/v3/role_assignments?user.id=73216eee250744bb9d9b81dd983376ad&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9b7a362fef7446e795c33b25a08f20bc => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:52.008362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c896f5-ead9-4c8f-8a2a-8a94451b145a None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:52.008800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c896f5-ead9-4c8f-8a2a-8a94451b145a None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:52.009352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c896f5-ead9-4c8f-8a2a-8a94451b145a None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:52.011695 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 340/674] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:52.013065 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c896f5-ead9-4c8f-8a2a-8a94451b145a None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:52.140774 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:52.160128 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:52.178110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85cf7b-c588-4cc1-8572-9b424bce901c None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:52.191438 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c896f5-ead9-4c8f-8a2a-8a94451b145a None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:52.245892 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765478d3-fa7d-4a59-8741-0f9a9978c4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:52.246550 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765478d3-fa7d-4a59-8741-0f9a9978c4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:52.246824 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765478d3-fa7d-4a59-8741-0f9a9978c4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:52.247099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765478d3-fa7d-4a59-8741-0f9a9978c4a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:52.247797 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765478d3-fa7d-4a59-8741-0f9a9978c4a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:52.248099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765478d3-fa7d-4a59-8741-0f9a9978c4a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:52.249528 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765478d3-fa7d-4a59-8741-0f9a9978c4a7 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:52.252297 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c257c5-eb49-4478-b4db-2cef8ccbd527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:52.253312 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c257c5-eb49-4478-b4db-2cef8ccbd527 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:52.254472 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c257c5-eb49-4478-b4db-2cef8ccbd527 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:52.254472 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c257c5-eb49-4478-b4db-2cef8ccbd527 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:52.265837 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 335/675] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:52.269410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765478d3-fa7d-4a59-8741-0f9a9978c4a7 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:52.269618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c257c5-eb49-4478-b4db-2cef8ccbd527 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:52.271063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c257c5-eb49-4478-b4db-2cef8ccbd527 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:52.291631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-c0c257c5-eb49-4478-b4db-2cef8ccbd527 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:52.291631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:52.291631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:52.291631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:52.291631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:52.291631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:52.291631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:52.291631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:52.291631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:52.291631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:52.291631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:52.291631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:52.291631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:28:52.291631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:28:52.291631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:28:52.292919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:28:52.292919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:52.292919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:52.292919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:52.292919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:52.292919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:52.292919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:52.292919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:52.292919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:52.292919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:52.292919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:52.292919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:52.292919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:52.292919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:52.292919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:52.292919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:52.292919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:52.294713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:28:52.294713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:28:52.294713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:28:52.294713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:28:52.294713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:28:52.294713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:28:52.294713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:52.294713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:52.294713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 341/676] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:52.294713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5fc62-0c92-4d28-8860-cab8d32cbd5a None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:52.295915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5fc62-0c92-4d28-8860-cab8d32cbd5a None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:52.295915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5fc62-0c92-4d28-8860-cab8d32cbd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:52.327797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-cdf5fc62-0c92-4d28-8860-cab8d32cbd5a None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:52.329430 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-cdf5fc62-0c92-4d28-8860-cab8d32cbd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:52.455538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 342/677] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:52.455854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765478d3-fa7d-4a59-8741-0f9a9978c4a7 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:52.455952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5fc62-0c92-4d28-8860-cab8d32cbd5a None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:52.516788 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8a3c1-38f2-4ee6-8216-f49fedf65780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:52.517839 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8a3c1-38f2-4ee6-8216-f49fedf65780 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:52.518343 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8a3c1-38f2-4ee6-8216-f49fedf65780 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:52.518831 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8a3c1-38f2-4ee6-8216-f49fedf65780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:52.542618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8a3c1-38f2-4ee6-8216-f49fedf65780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:52.544766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:52.546158 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8a3c1-38f2-4ee6-8216-f49fedf65780 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:52.574848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-45b8a3c1-38f2-4ee6-8216-f49fedf65780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:52.574848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:52.574848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:52.574848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:52.574848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:52.574848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:52.574848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:52.574848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:52.574848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:52.574848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:52.574848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:52.574848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:52.574848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:52.574848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:52.574848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:52.574848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:52.575954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:52.575954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:52.575954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:52.575954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:52.575954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:52.575954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:52.575954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:52.575954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:52.575954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:52.575954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:52.575954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:52.575954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:52.575954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:52.575954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:52.575954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:52.575954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:52.575954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:52.577392 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:52.577392 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:52.577392 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:52.584023 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 336/678] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:52.585254 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8a3c1-38f2-4ee6-8216-f49fedf65780 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:52.594238 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:52.625263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5fc62-0c92-4d28-8860-cab8d32cbd5a None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:52.689908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539dad3-ff28-4be5-be5e-bacc55cbcd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:52.691150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539dad3-ff28-4be5-be5e-bacc55cbcd70 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:52.691961 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539dad3-ff28-4be5-be5e-bacc55cbcd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:52.692680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539dad3-ff28-4be5-be5e-bacc55cbcd70 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:52.705129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539dad3-ff28-4be5-be5e-bacc55cbcd70 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:52.707342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539dad3-ff28-4be5-be5e-bacc55cbcd70 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:52.724854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-d539dad3-ff28-4be5-be5e-bacc55cbcd70 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 16:28:52.724854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:52.724854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:52.724854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:52.724854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:52.724854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:52.724854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:52.724854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:52.724854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:52.724854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:52.724854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:52.724854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:52.724854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:28:52.724854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:28:52.724854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:28:52.724854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:52.725872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:52.727509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:52.727509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:52.727509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:28:52.727509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:28:52.727509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:28:52.727509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:28:52.727509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:28:52.727509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:28:52.727509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 16:28:52.727509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:52.734733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 343/679] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:28:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:52.734733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539dad3-ff28-4be5-be5e-bacc55cbcd70 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:52.772088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8a3c1-38f2-4ee6-8216-f49fedf65780 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:52.826313 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596302a-64ae-4ef7-8fe9-cb1cf12caef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:52.827270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596302a-64ae-4ef7-8fe9-cb1cf12caef3 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:52.827752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596302a-64ae-4ef7-8fe9-cb1cf12caef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:52.828186 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596302a-64ae-4ef7-8fe9-cb1cf12caef3 None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:52.829320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596302a-64ae-4ef7-8fe9-cb1cf12caef3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:52.829753 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596302a-64ae-4ef7-8fe9-cb1cf12caef3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:52.832299 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596302a-64ae-4ef7-8fe9-cb1cf12caef3 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:52.863654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 337/680] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:28:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:52.863654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596302a-64ae-4ef7-8fe9-cb1cf12caef3 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:52.915579 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539dad3-ff28-4be5-be5e-bacc55cbcd70 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:52.954526 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:52.968027 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:52.981695 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5c3ea-304c-4d6b-ae11-0c4590f719af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:52.982558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5c3ea-304c-4d6b-ae11-0c4590f719af None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:52.982836 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5c3ea-304c-4d6b-ae11-0c4590f719af None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:52.983111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5c3ea-304c-4d6b-ae11-0c4590f719af None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:52.983905 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5c3ea-304c-4d6b-ae11-0c4590f719af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:52.984211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5c3ea-304c-4d6b-ae11-0c4590f719af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:52.986069 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5c3ea-304c-4d6b-ae11-0c4590f719af None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:53.015770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 344/681] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:53.015770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5c3ea-304c-4d6b-ae11-0c4590f719af None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:53.053735 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596302a-64ae-4ef7-8fe9-cb1cf12caef3 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:53.118859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ed908-b022-48cb-9494-980f2db31d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:53.119817 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ed908-b022-48cb-9494-980f2db31d27 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:53.120249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ed908-b022-48cb-9494-980f2db31d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:53.120704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ed908-b022-48cb-9494-980f2db31d27 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:53.121957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ed908-b022-48cb-9494-980f2db31d27 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:53.122456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ed908-b022-48cb-9494-980f2db31d27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:53.124780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ed908-b022-48cb-9494-980f2db31d27 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:53.155004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 338/682] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Sep 7 16:28:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:53.156426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ed908-b022-48cb-9494-980f2db31d27 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:53.203410 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5c3ea-304c-4d6b-ae11-0c4590f719af None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:53.254779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff8538-0eae-4eaf-9e69-44533af4dd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:53.255434 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff8538-0eae-4eaf-9e69-44533af4dd3c None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:53.255753 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff8538-0eae-4eaf-9e69-44533af4dd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:53.256027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff8538-0eae-4eaf-9e69-44533af4dd3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:53.267808 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff8538-0eae-4eaf-9e69-44533af4dd3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:53.269274 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff8538-0eae-4eaf-9e69-44533af4dd3c None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:53.285896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-5eff8538-0eae-4eaf-9e69-44533af4dd3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:53.285896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:53.285896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:53.285896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:53.285896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:53.285896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:53.285896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:53.285896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:53.285896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:53.285896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:53.285896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:53.285896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:53.285896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:53.285896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:53.285896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:53.285896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:53.286922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:53.286922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:53.286922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:53.286922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:53.286922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:53.286922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:53.286922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:53.286922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:53.286922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:53.286922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:53.286922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:53.286922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:53.286922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:53.286922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:53.286922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:53.286922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:53.286922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:53.288275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:53.288275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:53.288275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:53.288275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 345/683] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:53.288530 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff8538-0eae-4eaf-9e69-44533af4dd3c None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:53.311568 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ed908-b022-48cb-9494-980f2db31d27 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:53.340803 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:53.344348 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:53.363002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb78eec-fa55-4466-990a-af5bddd1bc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:53.363924 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb78eec-fa55-4466-990a-af5bddd1bc4d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:53.364440 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb78eec-fa55-4466-990a-af5bddd1bc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:53.364892 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb78eec-fa55-4466-990a-af5bddd1bc4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:53.366318 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb78eec-fa55-4466-990a-af5bddd1bc4d None admin] RBAC: Adding query filter params (role.id=9b7a362fef7446e795c33b25a08f20bc, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=cf48978c20f04173b114e15e1ce2157c) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:53.366865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb78eec-fa55-4466-990a-af5bddd1bc4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:53.369750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb78eec-fa55-4466-990a-af5bddd1bc4d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:53.382910 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 339/684] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:28:53 2022] GET /identity/v3/role_assignments?user.id=cf48978c20f04173b114e15e1ce2157c&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9b7a362fef7446e795c33b25a08f20bc => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:53.382910 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb78eec-fa55-4466-990a-af5bddd1bc4d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:53.448145 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff8538-0eae-4eaf-9e69-44533af4dd3c None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:53.495283 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e7c6a-7c94-46d8-baa9-da46a014fe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:53.496422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e7c6a-7c94-46d8-baa9-da46a014fe26 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:53.496991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e7c6a-7c94-46d8-baa9-da46a014fe26 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:53.497460 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e7c6a-7c94-46d8-baa9-da46a014fe26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:53.506098 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e7c6a-7c94-46d8-baa9-da46a014fe26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:53.509126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e7c6a-7c94-46d8-baa9-da46a014fe26 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:53.523039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-6e7e7c6a-7c94-46d8-baa9-da46a014fe26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:53.523039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:53.523039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:53.523039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:53.523039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:53.523039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:53.523039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:53.523039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:53.523039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:53.523039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:53.523039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:53.523039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:53.523039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:28:53.523039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:28:53.523039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:28:53.524589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:28:53.524589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:53.524589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:53.524589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:53.524589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:53.524589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:53.524589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:53.524589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:53.524589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:53.524589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:53.524589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:53.524589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:53.524589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:53.524589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:53.524589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:53.524589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:53.524589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:53.525717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:28:53.525717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:28:53.525717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:28:53.525717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:28:53.525717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:28:53.525717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:28:53.525717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:53.525717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:53.528500 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 346/685] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:53.529770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e7c6a-7c94-46d8-baa9-da46a014fe26 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:53.552743 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb78eec-fa55-4466-990a-af5bddd1bc4d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:53.607915 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a35d5f-3426-4d17-9a6a-6b3937a381a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:53.608973 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a35d5f-3426-4d17-9a6a-6b3937a381a8 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:53.609549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a35d5f-3426-4d17-9a6a-6b3937a381a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:53.610049 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a35d5f-3426-4d17-9a6a-6b3937a381a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:53.690124 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:53.694087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:53.709637 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e7c6a-7c94-46d8-baa9-da46a014fe26 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:53.721036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a35d5f-3426-4d17-9a6a-6b3937a381a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:53.724113 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a35d5f-3426-4d17-9a6a-6b3937a381a8 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:53.779749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9396b-c8b2-4cf7-b7a2-d9373153519f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:53.780733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9396b-c8b2-4cf7-b7a2-d9373153519f None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:53.781178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9396b-c8b2-4cf7-b7a2-d9373153519f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:53.781658 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9396b-c8b2-4cf7-b7a2-d9373153519f None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:53.782955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9396b-c8b2-4cf7-b7a2-d9373153519f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:53.783454 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9396b-c8b2-4cf7-b7a2-d9373153519f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:53.786196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9396b-c8b2-4cf7-b7a2-d9373153519f None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:53.815011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 347/686] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:53.816709 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9396b-c8b2-4cf7-b7a2-d9373153519f None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:53.898417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 340/687] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:28:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:28:53.900806 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a35d5f-3426-4d17-9a6a-6b3937a381a8 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:53.994438 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9396b-c8b2-4cf7-b7a2-d9373153519f None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:54.030209 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:54.042218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3790b5-1e87-4583-90dd-1f4d0e77e6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:54.042974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3790b5-1e87-4583-90dd-1f4d0e77e6dc None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:54.043614 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3790b5-1e87-4583-90dd-1f4d0e77e6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:54.043614 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3790b5-1e87-4583-90dd-1f4d0e77e6dc None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:54.044403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3790b5-1e87-4583-90dd-1f4d0e77e6dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:54.044716 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3790b5-1e87-4583-90dd-1f4d0e77e6dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:54.046232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3790b5-1e87-4583-90dd-1f4d0e77e6dc None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:54.051345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a35d5f-3426-4d17-9a6a-6b3937a381a8 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:54.067266 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 348/688] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:28:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:54.068449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3790b5-1e87-4583-90dd-1f4d0e77e6dc None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:54.085752 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:54.096987 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798a959-e167-415e-bef1-bd00ad012614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:54.099696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798a959-e167-415e-bef1-bd00ad012614 None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:54.099696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798a959-e167-415e-bef1-bd00ad012614 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:54.099696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798a959-e167-415e-bef1-bd00ad012614 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:54.099696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798a959-e167-415e-bef1-bd00ad012614 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:54.101449 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798a959-e167-415e-bef1-bd00ad012614 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:54.184016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3790b5-1e87-4583-90dd-1f4d0e77e6dc None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:54.195241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 341/689] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:28:53 2022] POST /identity/v3/users => generated 254 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:28:54.197782 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798a959-e167-415e-bef1-bd00ad012614 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:54.226147 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b77909-7919-4a07-90ad-03de95c917ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:54.227271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b77909-7919-4a07-90ad-03de95c917ee None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:54.227680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b77909-7919-4a07-90ad-03de95c917ee None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:54.227965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b77909-7919-4a07-90ad-03de95c917ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:54.241438 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b77909-7919-4a07-90ad-03de95c917ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:54.243853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b77909-7919-4a07-90ad-03de95c917ee None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:54.262218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-75b77909-7919-4a07-90ad-03de95c917ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:54.262218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:54.262218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:54.262218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:54.262218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:54.262218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:54.262218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:54.262218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:54.262218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:54.262218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:54.262218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:54.262218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:54.262218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:54.262218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:54.262218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:54.262218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:54.272792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:54.272792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:54.272792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:54.272792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:54.272792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:54.272792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:54.272792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:54.272792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:54.272792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:54.272792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:54.272792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:54.272792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:54.272792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:54.272792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:54.272792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:54.272792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:54.272792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:54.274399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:54.274399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:54.274399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:54.274399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 349/690] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:54.274399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b77909-7919-4a07-90ad-03de95c917ee None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:54.404081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:54.448153 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798a959-e167-415e-bef1-bd00ad012614 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:54.495893 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6832481-11a2-493a-aeb7-26507e5752ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:54.496128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b77909-7919-4a07-90ad-03de95c917ee None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:54.497733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6832481-11a2-493a-aeb7-26507e5752ce None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:54.497733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6832481-11a2-493a-aeb7-26507e5752ce None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:54.497733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6832481-11a2-493a-aeb7-26507e5752ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:54.498416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6832481-11a2-493a-aeb7-26507e5752ce None admin] RBAC: Adding query filter params (role.id=9b7a362fef7446e795c33b25a08f20bc, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=bac099b78bd04e02b8614c8afce53ab7) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:54.498724 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6832481-11a2-493a-aeb7-26507e5752ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:54.500303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6832481-11a2-493a-aeb7-26507e5752ce None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:54.511702 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 342/691] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:28:54 2022] GET /identity/v3/role_assignments?user.id=bac099b78bd04e02b8614c8afce53ab7&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9b7a362fef7446e795c33b25a08f20bc => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:54.567378 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee0931-a56d-4727-867b-330ba5c00bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:54.568313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee0931-a56d-4727-867b-330ba5c00bcf None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:54.568731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee0931-a56d-4727-867b-330ba5c00bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:54.569139 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee0931-a56d-4727-867b-330ba5c00bcf None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:54.570197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee0931-a56d-4727-867b-330ba5c00bcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:54.571451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee0931-a56d-4727-867b-330ba5c00bcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:54.573560 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee0931-a56d-4727-867b-330ba5c00bcf None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:54.598911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 350/692] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:28:54.605444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6832481-11a2-493a-aeb7-26507e5752ce None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:54.629509 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:54.749810 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d955b4-2f9f-4c17-91cf-40e4673ff3dd None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:54.750150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d955b4-2f9f-4c17-91cf-40e4673ff3dd None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:54.750372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d955b4-2f9f-4c17-91cf-40e4673ff3dd None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:54.751756 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 351/693] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:54.757586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cb072-dd20-4b96-8bb8-5c7d316deba0 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:54.758386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cb072-dd20-4b96-8bb8-5c7d316deba0 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:54.758665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cb072-dd20-4b96-8bb8-5c7d316deba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:54.782569 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6832481-11a2-493a-aeb7-26507e5752ce None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:54.793804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-1f1cb072-dd20-4b96-8bb8-5c7d316deba0 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:54.795040 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1f1cb072-dd20-4b96-8bb8-5c7d316deba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:54.833057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06475b-1371-46f7-bfcd-cadfd76479a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:54.834275 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06475b-1371-46f7-bfcd-cadfd76479a6 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:54.834710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06475b-1371-46f7-bfcd-cadfd76479a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:54.835416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06475b-1371-46f7-bfcd-cadfd76479a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:54.848294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06475b-1371-46f7-bfcd-cadfd76479a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:54.852292 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06475b-1371-46f7-bfcd-cadfd76479a6 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:54.869141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-2a06475b-1371-46f7-bfcd-cadfd76479a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:54.869141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:54.869141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:54.869141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:54.869141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:54.869141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:54.869141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:54.869141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:54.869141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:54.869141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:54.869141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:54.869141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:54.869141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:28:54.869141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:28:54.869141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:28:54.870106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:28:54.870106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:54.870106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:54.870106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:54.870106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:54.870106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:54.870106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:54.870106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:54.870106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:54.870106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:54.870106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:54.870106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:54.870106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:54.870106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:54.870106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:54.870106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:54.870106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:54.871000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:28:54.871000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:28:54.871000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:28:54.871000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:28:54.871000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:28:54.871000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:28:54.871000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:28:54.871000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:54.871000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 343/694] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:28:54.883154 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06475b-1371-46f7-bfcd-cadfd76479a6 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:54.910533 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 352/695] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:28:54.981364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:55.026633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06475b-1371-46f7-bfcd-cadfd76479a6 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:55.069170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fd7b1-2692-4753-a93a-b9bfb8484a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:55.070137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fd7b1-2692-4753-a93a-b9bfb8484a04 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:55.070884 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fd7b1-2692-4753-a93a-b9bfb8484a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:55.071447 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fd7b1-2692-4753-a93a-b9bfb8484a04 None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:55.072431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752fd7b1-2692-4753-a93a-b9bfb8484a04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:55.072926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752fd7b1-2692-4753-a93a-b9bfb8484a04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:55.074585 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752fd7b1-2692-4753-a93a-b9bfb8484a04 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:55.093391 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 344/696] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:28:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:55.104087 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cb072-dd20-4b96-8bb8-5c7d316deba0 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:55.174653 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:55.225398 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cb072-dd20-4b96-8bb8-5c7d316deba0 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:55.265653 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a3872-9b24-414c-9bd9-d522e0cf1d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:55.266279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a3872-9b24-414c-9bd9-d522e0cf1d01 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:55.266558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a3872-9b24-414c-9bd9-d522e0cf1d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:55.266826 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a3872-9b24-414c-9bd9-d522e0cf1d01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:55.267590 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a3872-9b24-414c-9bd9-d522e0cf1d01 None admin] RBAC: Adding query filter params (role.id=9b7a362fef7446e795c33b25a08f20bc, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=56cd868e866d436aa1d601f7791e812c) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:55.267896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a3872-9b24-414c-9bd9-d522e0cf1d01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:55.269346 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a3872-9b24-414c-9bd9-d522e0cf1d01 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:55.277336 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 353/697] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:28:55 2022] GET /identity/v3/role_assignments?user.id=56cd868e866d436aa1d601f7791e812c&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9b7a362fef7446e795c33b25a08f20bc => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:28:55.334782 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fd7b1-2692-4753-a93a-b9bfb8484a04 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:55.456065 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fd7b1-2692-4753-a93a-b9bfb8484a04 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:55.489540 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:55.504412 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c36c6-4a81-4626-bdba-f4702a415149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:55.505094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c36c6-4a81-4626-bdba-f4702a415149 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:55.508777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c36c6-4a81-4626-bdba-f4702a415149 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:55.508777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c36c6-4a81-4626-bdba-f4702a415149 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:55.508777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c36c6-4a81-4626-bdba-f4702a415149 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:55.508777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c36c6-4a81-4626-bdba-f4702a415149 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:55.523055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-306c36c6-4a81-4626-bdba-f4702a415149 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 16:28:55.523055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:55.523055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:28:55.523055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:28:55.523055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:28:55.523055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:28:55.523055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:28:55.523055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:28:55.523055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 16:28:55.523055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:55.523055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:28:55.523055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:55.523055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:55.523055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:55.523055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:55.523055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:55.523055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:55.525057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:55.525057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:55.525057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:55.525057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:55.525057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:55.525057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:55.525057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:28:55.525057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:28:55.525057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:28:55.525057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:28:55.525057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:55.525057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:55.525057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:55.525057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:55.525057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:55.525057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:55.526526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:55.526526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:55.526526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:55.526526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:55.526526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:55.526526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:55.526526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:55.526526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:55.526526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:55.526526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:55.526526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:28:55.526526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:28:55.526526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 16:28:55.526526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:55.526526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 345/698] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Sep 7 16:28:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:55.531885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a3872-9b24-414c-9bd9-d522e0cf1d01 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:55.706434 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a3872-9b24-414c-9bd9-d522e0cf1d01 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:55.728959 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:55.749346 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d58d1-7e43-477c-bd80-341e5b3576eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:55.750039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d58d1-7e43-477c-bd80-341e5b3576eb None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:55.750325 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d58d1-7e43-477c-bd80-341e5b3576eb None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:55.750598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d58d1-7e43-477c-bd80-341e5b3576eb None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:55.751254 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d58d1-7e43-477c-bd80-341e5b3576eb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:55.751589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d58d1-7e43-477c-bd80-341e5b3576eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:55.753072 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d58d1-7e43-477c-bd80-341e5b3576eb None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:55.762949 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 354/699] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Sep 7 16:28:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:55.769485 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c36c6-4a81-4626-bdba-f4702a415149 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:55.968387 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c36c6-4a81-4626-bdba-f4702a415149 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:56.033901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0a774-5742-4013-8d46-bc09dd24822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:56.034977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0a774-5742-4013-8d46-bc09dd24822b None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:56.035468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0a774-5742-4013-8d46-bc09dd24822b None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:56.036060 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0a774-5742-4013-8d46-bc09dd24822b None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:56.037274 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0a774-5742-4013-8d46-bc09dd24822b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:56.037810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0a774-5742-4013-8d46-bc09dd24822b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:56.040611 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0a774-5742-4013-8d46-bc09dd24822b None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:56.052483 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 346/700] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Sep 7 16:28:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:28:57.146078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06ca4b-fbaf-4c39-9709-699c08050b27 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:57.147119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06ca4b-fbaf-4c39-9709-699c08050b27 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:57.147716 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06ca4b-fbaf-4c39-9709-699c08050b27 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:57.150587 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 355/701] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:28:57.156632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c35415-2308-49b3-b504-bdeaf6622422 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:57.157578 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c35415-2308-49b3-b504-bdeaf6622422 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:57.158054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c35415-2308-49b3-b504-bdeaf6622422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:57.186012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-03c35415-2308-49b3-b504-bdeaf6622422 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:57.186915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9ef77-1b66-42de-bb94-3ed1dc763c97 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:57.187255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-03c35415-2308-49b3-b504-bdeaf6622422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:57.187670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9ef77-1b66-42de-bb94-3ed1dc763c97 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:57.188150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9ef77-1b66-42de-bb94-3ed1dc763c97 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:57.189843 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 356/702] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:28:57.206189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e1dde-a2f7-4297-9a8a-55a3c7518a75 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:57.206665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e1dde-a2f7-4297-9a8a-55a3c7518a75 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:57.208600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e1dde-a2f7-4297-9a8a-55a3c7518a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:57.247237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-b94e1dde-a2f7-4297-9a8a-55a3c7518a75 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:57.252833 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b94e1dde-a2f7-4297-9a8a-55a3c7518a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:57.275890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:57.301259 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 347/703] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 16:28:57.389245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 357/704] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:57.546686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19559841-ffc4-441c-89fa-ba0e22d0748c None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:57.547035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19559841-ffc4-441c-89fa-ba0e22d0748c None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:57.547228 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19559841-ffc4-441c-89fa-ba0e22d0748c None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:57.552823 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 348/705] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:28:57.561271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0469d12-36f3-494b-806c-1f7167ac00c8 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:57.561877 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0469d12-36f3-494b-806c-1f7167ac00c8 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:57.562351 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0469d12-36f3-494b-806c-1f7167ac00c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:57.612150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-b0469d12-36f3-494b-806c-1f7167ac00c8 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:57.613840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b0469d12-36f3-494b-806c-1f7167ac00c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:57.718171 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19559841-ffc4-441c-89fa-ba0e22d0748c None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:57.857415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 358/706] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:57.920633 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0469d12-36f3-494b-806c-1f7167ac00c8 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:58.024310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:58.044181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19559841-ffc4-441c-89fa-ba0e22d0748c None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:58.144916 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0469d12-36f3-494b-806c-1f7167ac00c8 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:58.193260 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22ec26-339f-4ae3-8e35-3933cbde3d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:58.194659 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22ec26-339f-4ae3-8e35-3933cbde3d54 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:58.196186 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22ec26-339f-4ae3-8e35-3933cbde3d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:58.197228 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22ec26-339f-4ae3-8e35-3933cbde3d54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:58.212378 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7867341-9871-4183-a7b4-4e6e96265bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:58.214001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7867341-9871-4183-a7b4-4e6e96265bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:58.214558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7867341-9871-4183-a7b4-4e6e96265bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:58.215038 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7867341-9871-4183-a7b4-4e6e96265bf7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:58.222050 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22ec26-339f-4ae3-8e35-3933cbde3d54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:58.229986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7867341-9871-4183-a7b4-4e6e96265bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:28:58.233310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-bf22ec26-339f-4ae3-8e35-3933cbde3d54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:28:58.233310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:58.233310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:58.233310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:58.233310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:58.233310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:58.233310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:58.233310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:58.233310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:58.233310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:58.233310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:58.233310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:58.233310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:58.233310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:58.233310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:58.233310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:58.240231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:58.240231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:58.240231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:58.240231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:58.240231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:58.240231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:58.240231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:58.240231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:58.240231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:58.240231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:58.240231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:58.240231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:58.240231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:58.240231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:58.240231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:58.240231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:58.241107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:58.241107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:58.241107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:58.241107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:58.241107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:58.241107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:58.241107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:58.241107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:58.241107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:58.241107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:58.241107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:28:58.241107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:58.241107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 359/707] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:28:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:58.241107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22ec26-339f-4ae3-8e35-3933cbde3d54 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:58.241872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-c7867341-9871-4183-a7b4-4e6e96265bf7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:58.241872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:58.241872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:58.241872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:58.241872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:58.241872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:58.241872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:58.241872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:58.241872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:58.241872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:58.241872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:58.241872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:58.241872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:28:58.241872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:28:58.241872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:28:58.241872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:28:58.245977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:28:58.245977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:28:58.245977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:28:58.245977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:28:58.245977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:58.245977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:58.245977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:58.245977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:58.245977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:58.245977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:58.245977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:58.245977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:58.245977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:58.245977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:58.245977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:58.245977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:58.253197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:58.253197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:58.253197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:58.253197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:58.253197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:28:58.253197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:28:58.253197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:28:58.253197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:28:58.253197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:28:58.253197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:28:58.253197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:28:58.253197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:58.253197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 349/708] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:28:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 526 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:28:58.260324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7867341-9871-4183-a7b4-4e6e96265bf7 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:58.371499 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:58.414391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22ec26-339f-4ae3-8e35-3933cbde3d54 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:58.416685 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:58.461770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5350e-f5b9-4aed-b8a4-f0a66e48cfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:58.463266 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5350e-f5b9-4aed-b8a4-f0a66e48cfdd None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:58.463754 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5350e-f5b9-4aed-b8a4-f0a66e48cfdd None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:58.464175 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5350e-f5b9-4aed-b8a4-f0a66e48cfdd None admin] PATH_INFO: `/v3/services/network` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:58.464941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5350e-f5b9-4aed-b8a4-f0a66e48cfdd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:58.466851 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5350e-f5b9-4aed-b8a4-f0a66e48cfdd None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:58.478015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7867341-9871-4183-a7b4-4e6e96265bf7 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:58.480786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-a5a5350e-f5b9-4aed-b8a4-f0a66e48cfdd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 16:28:58.480786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:58.480786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:28:58.480786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:28:58.480786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:28:58.480786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:28:58.480786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:28:58.480786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:28:58.480786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 16:28:58.480786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:58.480786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:28:58.480786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:58.480786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:58.480786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:58.480786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:58.480786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:58.480786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:58.481801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:58.481801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:58.481801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:58.481801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:58.481801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:58.481801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:58.481801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:28:58.481801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:28:58.481801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:28:58.481801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:28:58.481801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:58.481801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:58.481801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:58.481801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:58.481801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:58.481801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:58.482644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:58.482644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:58.482644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:58.482644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:58.482644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:58.482644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:58.482644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:58.482644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:58.482644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:58.482644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:58.482644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:28:58.482644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:28:58.482644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 16:28:58.482644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:58.486401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 360/709] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:28:58 2022] GET /identity/v3/services/network => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:58.487655 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5350e-f5b9-4aed-b8a4-f0a66e48cfdd None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:58.547567 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae856d-b4d2-48ce-ab0e-f62df6a17646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:58.548759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae856d-b4d2-48ce-ab0e-f62df6a17646 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:58.549226 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae856d-b4d2-48ce-ab0e-f62df6a17646 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:58.549825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae856d-b4d2-48ce-ab0e-f62df6a17646 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:58.551236 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae856d-b4d2-48ce-ab0e-f62df6a17646 None admin] RBAC: Adding query filter params (name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:58.552083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae856d-b4d2-48ce-ab0e-f62df6a17646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:58.555610 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae856d-b4d2-48ce-ab0e-f62df6a17646 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:58.573682 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 350/710] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:28:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:58.575681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae856d-b4d2-48ce-ab0e-f62df6a17646 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:58.622385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5350e-f5b9-4aed-b8a4-f0a66e48cfdd None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:58.670382 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f785b-472c-43c4-94bd-4191ae4b6c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:58.671287 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f785b-472c-43c4-94bd-4191ae4b6c8b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:58.671772 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f785b-472c-43c4-94bd-4191ae4b6c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:58.672189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f785b-472c-43c4-94bd-4191ae4b6c8b None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:58.673012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f785b-472c-43c4-94bd-4191ae4b6c8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:58.673462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f785b-472c-43c4-94bd-4191ae4b6c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:58.675150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f785b-472c-43c4-94bd-4191ae4b6c8b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:58.686250 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 361/711] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:28:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:58.687355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f785b-472c-43c4-94bd-4191ae4b6c8b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:58.723812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:58.780068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae856d-b4d2-48ce-ab0e-f62df6a17646 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:58.797782 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:58.811641 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f785b-472c-43c4-94bd-4191ae4b6c8b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:58.845868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad309b-5ba7-4a41-9fc2-38c116a18239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:58.847539 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad309b-5ba7-4a41-9fc2-38c116a18239 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:58.849385 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad309b-5ba7-4a41-9fc2-38c116a18239 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:58.850178 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad309b-5ba7-4a41-9fc2-38c116a18239 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:58.851699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad309b-5ba7-4a41-9fc2-38c116a18239 None admin] RBAC: Adding query filter params (name=network) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:58.852494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad309b-5ba7-4a41-9fc2-38c116a18239 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:58.853500 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ce553-a3ac-4d1a-b3da-fc2e5b0e9127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:58.854259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ce553-a3ac-4d1a-b3da-fc2e5b0e9127 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:58.854641 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ce553-a3ac-4d1a-b3da-fc2e5b0e9127 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:58.855017 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ce553-a3ac-4d1a-b3da-fc2e5b0e9127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:58.856625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad309b-5ba7-4a41-9fc2-38c116a18239 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:58.866135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 351/712] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Sep 7 16:28:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:58.868989 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad309b-5ba7-4a41-9fc2-38c116a18239 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:58.870123 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ce553-a3ac-4d1a-b3da-fc2e5b0e9127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:58.871746 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ce553-a3ac-4d1a-b3da-fc2e5b0e9127 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:58.888898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-700ce553-a3ac-4d1a-b3da-fc2e5b0e9127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:58.888898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:58.888898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:58.888898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:58.888898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:58.888898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:58.888898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:58.888898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:58.888898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:58.888898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:58.888898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:58.888898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:58.888898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:58.888898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:58.888898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:58.888898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:58.891027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:58.891027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:58.891027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:58.891027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:58.891027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:58.891027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:58.891027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:58.891027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:58.891027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:58.891027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:58.891027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:58.891027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:58.891027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:58.891027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:58.891027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:58.891027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:58.891027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:58.893122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:58.893122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:58.893122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:58.893122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 362/713] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:58.894125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ce553-a3ac-4d1a-b3da-fc2e5b0e9127 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:58.994089 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:59.026506 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ce553-a3ac-4d1a-b3da-fc2e5b0e9127 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:59.076105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad309b-5ba7-4a41-9fc2-38c116a18239 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:59.109959 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecb346-8db5-4378-aa84-dbd4c7efee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:59.111034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecb346-8db5-4378-aa84-dbd4c7efee86 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:59.111578 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecb346-8db5-4378-aa84-dbd4c7efee86 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:59.112056 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecb346-8db5-4378-aa84-dbd4c7efee86 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:59.113228 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecb346-8db5-4378-aa84-dbd4c7efee86 None admin] RBAC: Adding query filter params (type=network) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:59.113779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecb346-8db5-4378-aa84-dbd4c7efee86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:59.116349 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecb346-8db5-4378-aa84-dbd4c7efee86 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:59.127814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 363/714] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Sep 7 16:28:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:59.127814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecb346-8db5-4378-aa84-dbd4c7efee86 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:59.130266 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851d852-7711-4b67-9f1b-8fb049de1993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:59.131394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851d852-7711-4b67-9f1b-8fb049de1993 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:59.131893 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851d852-7711-4b67-9f1b-8fb049de1993 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:59.132337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851d852-7711-4b67-9f1b-8fb049de1993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:59.156967 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851d852-7711-4b67-9f1b-8fb049de1993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:59.159992 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851d852-7711-4b67-9f1b-8fb049de1993 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:59.191590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-b851d852-7711-4b67-9f1b-8fb049de1993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:59.191590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:59.191590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:59.191590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:59.191590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:59.191590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:59.191590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:59.191590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:59.191590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:59.191590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:59.191590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:59.191590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:59.191590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:28:59.191590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:28:59.191590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:28:59.191590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:28:59.205202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:59.205202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:59.205202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:59.205202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:59.205202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:59.205202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:59.205202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:59.205202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:59.205202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:59.205202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:59.205202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:59.205202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:59.205202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:59.205202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:59.205202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:59.205202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:59.205202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:28:59.206265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:28:59.206265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:28:59.206265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:59.206265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 352/715] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:59.206265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373dfca-96d7-40f2-9df6-a742a17f305d None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:59.206265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373dfca-96d7-40f2-9df6-a742a17f305d None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:59.206265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373dfca-96d7-40f2-9df6-a742a17f305d None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:59.206265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 353/716] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:59.206265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373dfca-96d7-40f2-9df6-a742a17f305d None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:59.257713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:59.265479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecb346-8db5-4378-aa84-dbd4c7efee86 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:59.309020 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20578d-ee88-4244-a6d2-cfb4448f5602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:59.309749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20578d-ee88-4244-a6d2-cfb4448f5602 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:59.310039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20578d-ee88-4244-a6d2-cfb4448f5602 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:59.310323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20578d-ee88-4244-a6d2-cfb4448f5602 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:59.310989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20578d-ee88-4244-a6d2-cfb4448f5602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:59.311292 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20578d-ee88-4244-a6d2-cfb4448f5602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:59.312762 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20578d-ee88-4244-a6d2-cfb4448f5602 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:59.327267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 364/717] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:59.328837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee46dc-42f8-4239-a13a-5643516ff676 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:59.329125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee46dc-42f8-4239-a13a-5643516ff676 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:59.329397 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee46dc-42f8-4239-a13a-5643516ff676 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:59.330830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 365/718] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:28:59.332102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce6ff8-c438-49e5-94e5-26d2b699f49a None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:59.332381 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce6ff8-c438-49e5-94e5-26d2b699f49a None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:59.332650 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce6ff8-c438-49e5-94e5-26d2b699f49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:59.341892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:59.358097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-41ce6ff8-c438-49e5-94e5-26d2b699f49a None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:59.360201 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-41ce6ff8-c438-49e5-94e5-26d2b699f49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:59.420636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373dfca-96d7-40f2-9df6-a742a17f305d None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:59.462019 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 366/719] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:59.463887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce6ff8-c438-49e5-94e5-26d2b699f49a None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:59.500705 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294815bf-38a2-4083-a952-a8d77b3fdbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:59.501764 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294815bf-38a2-4083-a952-a8d77b3fdbfa None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:59.502233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294815bf-38a2-4083-a952-a8d77b3fdbfa None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:59.502704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294815bf-38a2-4083-a952-a8d77b3fdbfa None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:59.503853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294815bf-38a2-4083-a952-a8d77b3fdbfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:28:59.504725 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294815bf-38a2-4083-a952-a8d77b3fdbfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:59.508190 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294815bf-38a2-4083-a952-a8d77b3fdbfa None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:59.536360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 354/720] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:28:59.538600 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dee9ec-60ea-4408-99f2-53363d3a6b6c None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:59.539249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dee9ec-60ea-4408-99f2-53363d3a6b6c None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:59.539249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dee9ec-60ea-4408-99f2-53363d3a6b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:59.572551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-65dee9ec-60ea-4408-99f2-53363d3a6b6c None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:28:59.574558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-65dee9ec-60ea-4408-99f2-53363d3a6b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:28:59.656276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce6ff8-c438-49e5-94e5-26d2b699f49a None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:59.693740 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 355/721] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:28:59.695112 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dee9ec-60ea-4408-99f2-53363d3a6b6c None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:59.711302 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609ce04-d43b-40f7-83c0-7090a87bbff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:59.715102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ce04-d43b-40f7-83c0-7090a87bbff6 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:59.717503 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ce04-d43b-40f7-83c0-7090a87bbff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:59.718165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ce04-d43b-40f7-83c0-7090a87bbff6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:59.722467 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:59.725549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:28:59.740124 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609ce04-d43b-40f7-83c0-7090a87bbff6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:59.741621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609ce04-d43b-40f7-83c0-7090a87bbff6 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:59.794414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-0609ce04-d43b-40f7-83c0-7090a87bbff6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 16:28:59.794414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:59.794414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:59.794414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:59.794414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:59.794414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:59.794414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:59.794414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:59.794414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:59.794414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:59.794414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:59.794414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:59.794414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:28:59.794414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:28:59.794414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:28:59.794414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:59.796273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:59.799191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:59.799191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:59.799191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:28:59.799191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:28:59.799191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:28:59.799191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:28:59.799191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:28:59.799191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:28:59.799191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 16:28:59.799191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:28:59.799191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 367/722] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Sep 7 16:28:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:59.809219 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609ce04-d43b-40f7-83c0-7090a87bbff6 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:28:59.843684 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dee9ec-60ea-4408-99f2-53363d3a6b6c None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:28:59.895842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8fb5c-ef36-4e4f-9e16-bcc7eb4ab261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:28:59.897377 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8fb5c-ef36-4e4f-9e16-bcc7eb4ab261 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:28:59.899026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8fb5c-ef36-4e4f-9e16-bcc7eb4ab261 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:28:59.899511 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8fb5c-ef36-4e4f-9e16-bcc7eb4ab261 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:28:59.909219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8fb5c-ef36-4e4f-9e16-bcc7eb4ab261 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:28:59.911165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8fb5c-ef36-4e4f-9e16-bcc7eb4ab261 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:28:59.926337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-b1e8fb5c-ef36-4e4f-9e16-bcc7eb4ab261 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:28:59.926337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:28:59.926337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:28:59.926337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:28:59.926337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:28:59.926337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:28:59.926337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:28:59.926337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:28:59.926337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:28:59.926337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:28:59.926337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:28:59.926337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:28:59.926337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:28:59.926337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:28:59.926337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:28:59.926337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:28:59.928288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:28:59.930255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:28:59.930255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:28:59.930255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:28:59.930255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:28:59.930255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:28:59.930255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:28:59.930255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:28:59.930255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:28:59.930255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:28:59.930255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:28:59.930255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 356/723] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Sep 7 16:28:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:28:59.938970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8fb5c-ef36-4e4f-9e16-bcc7eb4ab261 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:00.084600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609ce04-d43b-40f7-83c0-7090a87bbff6 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:00.099175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8fb5c-ef36-4e4f-9e16-bcc7eb4ab261 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:00.102945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:00.129741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc767e0-8321-4c70-833b-1699ea3dd148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:00.130657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc767e0-8321-4c70-833b-1699ea3dd148 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:00.130935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc767e0-8321-4c70-833b-1699ea3dd148 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:00.131279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc767e0-8321-4c70-833b-1699ea3dd148 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:00.132140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc767e0-8321-4c70-833b-1699ea3dd148 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:00.132643 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc767e0-8321-4c70-833b-1699ea3dd148 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:00.134801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc767e0-8321-4c70-833b-1699ea3dd148 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:00.158169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 368/724] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Sep 7 16:28:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:00.159683 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc767e0-8321-4c70-833b-1699ea3dd148 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:00.167355 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80d119-49c0-4e43-8c5d-4571e2a019f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:00.168463 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80d119-49c0-4e43-8c5d-4571e2a019f8 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:00.168957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80d119-49c0-4e43-8c5d-4571e2a019f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:00.169398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80d119-49c0-4e43-8c5d-4571e2a019f8 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:00.170789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80d119-49c0-4e43-8c5d-4571e2a019f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:00.171347 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80d119-49c0-4e43-8c5d-4571e2a019f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:00.174408 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80d119-49c0-4e43-8c5d-4571e2a019f8 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:00.213976 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 357/725] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Sep 7 16:28:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:00.215613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80d119-49c0-4e43-8c5d-4571e2a019f8 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:00.286572 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:00.370765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc767e0-8321-4c70-833b-1699ea3dd148 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:00.392315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80d119-49c0-4e43-8c5d-4571e2a019f8 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:00.414892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660d570-10cb-4803-8c3d-5babb3afeb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:00.415563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660d570-10cb-4803-8c3d-5babb3afeb9b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:00.415843 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660d570-10cb-4803-8c3d-5babb3afeb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:00.416110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660d570-10cb-4803-8c3d-5babb3afeb9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:00.428964 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660d570-10cb-4803-8c3d-5babb3afeb9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:29:00.434011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-6660d570-10cb-4803-8c3d-5babb3afeb9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:29:00.434011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:00.434011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:00.434011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:00.434011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:00.434011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:00.434011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:00.434011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:00.434011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:00.434011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:00.434011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:00.434011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:00.434011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:29:00.434011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:29:00.434011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:29:00.434011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:29:00.436213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:29:00.436213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:29:00.436213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:29:00.436213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:29:00.436213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:00.436213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:00.436213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:00.436213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:00.436213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:00.436213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:00.436213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:00.436213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:00.436213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:00.436213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:00.436213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:00.436213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:00.437857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:00.437857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:00.437857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:00.437857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:00.437857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:29:00.437857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:29:00.437857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:29:00.437857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:29:00.437857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:29:00.437857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:29:00.437857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:29:00.437857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:00.437857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 369/726] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:29:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:00.437857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660d570-10cb-4803-8c3d-5babb3afeb9b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:00.453685 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:00.463798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5626d11-c380-4faa-b225-920cdc34feeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:00.465210 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5626d11-c380-4faa-b225-920cdc34feeb None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:00.465526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5626d11-c380-4faa-b225-920cdc34feeb None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:00.465866 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5626d11-c380-4faa-b225-920cdc34feeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:00.553675 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5626d11-c380-4faa-b225-920cdc34feeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:00.555222 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5626d11-c380-4faa-b225-920cdc34feeb None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:00.591099 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660d570-10cb-4803-8c3d-5babb3afeb9b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:00.607984 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:00.633939 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71742d5c-d15a-46a1-870e-dca1f5a02c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:00.634395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71742d5c-d15a-46a1-870e-dca1f5a02c7e None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:00.634679 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71742d5c-d15a-46a1-870e-dca1f5a02c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:00.634955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71742d5c-d15a-46a1-870e-dca1f5a02c7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:00.703634 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 358/727] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:29:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:29:00.704588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5626d11-c380-4faa-b225-920cdc34feeb None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:00.738415 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:00.764450 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71742d5c-d15a-46a1-870e-dca1f5a02c7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:00.767180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71742d5c-d15a-46a1-870e-dca1f5a02c7e None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:00.819317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5626d11-c380-4faa-b225-920cdc34feeb None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:00.885577 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc9bc8-5aa0-4700-ae57-eadaab0d35e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:00.886539 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc9bc8-5aa0-4700-ae57-eadaab0d35e8 None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:00.887029 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc9bc8-5aa0-4700-ae57-eadaab0d35e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:00.887559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc9bc8-5aa0-4700-ae57-eadaab0d35e8 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:00.888772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc9bc8-5aa0-4700-ae57-eadaab0d35e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:00.891404 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc9bc8-5aa0-4700-ae57-eadaab0d35e8 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:00.904292 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 370/728] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:29:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:29:00.904292 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71742d5c-d15a-46a1-870e-dca1f5a02c7e None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:00.921171 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:01.019719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71742d5c-d15a-46a1-870e-dca1f5a02c7e None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:01.030807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 359/729] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Sep 7 16:29:00 2022] POST /identity/v3/services => generated 251 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:29:01.031960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc9bc8-5aa0-4700-ae57-eadaab0d35e8 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:01.094986 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24283e6-cc6a-476f-aac8-60a1b464546c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:01.096077 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24283e6-cc6a-476f-aac8-60a1b464546c None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:01.096700 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24283e6-cc6a-476f-aac8-60a1b464546c None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:01.097157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24283e6-cc6a-476f-aac8-60a1b464546c None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:01.098676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24283e6-cc6a-476f-aac8-60a1b464546c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:01.099246 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24283e6-cc6a-476f-aac8-60a1b464546c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:01.102039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24283e6-cc6a-476f-aac8-60a1b464546c None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:01.119753 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 371/730] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:29:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:01.121211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24283e6-cc6a-476f-aac8-60a1b464546c None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:01.252103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:01.262726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc9bc8-5aa0-4700-ae57-eadaab0d35e8 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:01.277657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:01.314859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838739c8-3de6-4a8e-9570-7ddc8d37e591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:01.315650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838739c8-3de6-4a8e-9570-7ddc8d37e591 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:01.315934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838739c8-3de6-4a8e-9570-7ddc8d37e591 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:01.316202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838739c8-3de6-4a8e-9570-7ddc8d37e591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:01.333444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838739c8-3de6-4a8e-9570-7ddc8d37e591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:01.336845 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838739c8-3de6-4a8e-9570-7ddc8d37e591 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:01.353319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24283e6-cc6a-476f-aac8-60a1b464546c None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:01.386055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-838739c8-3de6-4a8e-9570-7ddc8d37e591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:01.386055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:01.386055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:01.386055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:01.386055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:01.386055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:01.386055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:01.386055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:01.386055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:01.386055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:01.386055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:01.386055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:01.386055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:01.386055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:01.386055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:01.386055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:01.387101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:01.387101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:01.387101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:01.387101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:01.387101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:01.387101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:01.387101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:01.387101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:01.387101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:01.387101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:01.387101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:01.387101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:01.387101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:01.387101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:01.387101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:01.387101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:01.387101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:01.388071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:01.388071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:01.388071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:01.390178 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 360/731] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:01.392242 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838739c8-3de6-4a8e-9570-7ddc8d37e591 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:01.428179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b2849-8c91-4f4b-a78c-af245d43b9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:01.429671 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b2849-8c91-4f4b-a78c-af245d43b9be None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:01.430315 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b2849-8c91-4f4b-a78c-af245d43b9be None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:01.431037 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b2849-8c91-4f4b-a78c-af245d43b9be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:01.454000 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b2849-8c91-4f4b-a78c-af245d43b9be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:01.457088 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b2849-8c91-4f4b-a78c-af245d43b9be None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:01.489612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-bf0b2849-8c91-4f4b-a78c-af245d43b9be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:01.489612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:01.489612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:01.489612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:01.489612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:01.489612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:01.489612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:01.489612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:01.489612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:01.489612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:01.489612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:01.489612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:01.489612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:01.489612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:01.489612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:01.489612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:01.491787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:01.491787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:01.491787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:01.491787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:01.491787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:01.491787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:01.491787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:01.491787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:01.491787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:01.491787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:01.491787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:01.491787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:01.491787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:01.491787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:01.491787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:01.491787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:01.491787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:01.494723 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:01.494723 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:01.494723 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:01.495362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 372/732] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:01.503076 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b2849-8c91-4f4b-a78c-af245d43b9be None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:01.601977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838739c8-3de6-4a8e-9570-7ddc8d37e591 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:01.671508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aab81-43a6-4889-9b4a-65864b96f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:01.671508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aab81-43a6-4889-9b4a-65864b96f7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:01.671508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aab81-43a6-4889-9b4a-65864b96f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:01.671508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aab81-43a6-4889-9b4a-65864b96f7b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:01.689157 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534aab81-43a6-4889-9b4a-65864b96f7b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:01.692249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534aab81-43a6-4889-9b4a-65864b96f7b5 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:01.704562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b2849-8c91-4f4b-a78c-af245d43b9be None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:01.724218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:01.730103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-534aab81-43a6-4889-9b4a-65864b96f7b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:01.730103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:01.730103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:01.730103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:01.730103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:01.730103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:01.730103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:01.730103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:01.730103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:01.730103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:01.730103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:01.730103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:01.730103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:01.730103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:01.730103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:01.730103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:01.731256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:01.731256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:01.731256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:01.731256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:01.731256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:01.731256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:01.731256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:01.731256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:01.731256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:01.731256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:01.731256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:01.731256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:01.731256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:01.731256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:01.731256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:01.731256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:01.731256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:01.732205 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:01.732205 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:01.732205 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:01.732506 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 361/733] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:01.733909 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aab81-43a6-4889-9b4a-65864b96f7b5 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:01.739715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:01.754737 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18605483-7d9a-4b9b-a00b-906f66ff4107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:01.755250 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605483-7d9a-4b9b-a00b-906f66ff4107 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:01.755575 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605483-7d9a-4b9b-a00b-906f66ff4107 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:01.755853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605483-7d9a-4b9b-a00b-906f66ff4107 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:01.756512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18605483-7d9a-4b9b-a00b-906f66ff4107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:01.756814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18605483-7d9a-4b9b-a00b-906f66ff4107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:01.759107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18605483-7d9a-4b9b-a00b-906f66ff4107 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:01.775924 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 373/734] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:01.776921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18605483-7d9a-4b9b-a00b-906f66ff4107 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:01.897285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18605483-7d9a-4b9b-a00b-906f66ff4107 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:01.936650 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbefabe-48ab-4420-b562-f6bf4b5c0cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:01.937272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbefabe-48ab-4420-b562-f6bf4b5c0cdb None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:01.937549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbefabe-48ab-4420-b562-f6bf4b5c0cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:01.937818 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbefabe-48ab-4420-b562-f6bf4b5c0cdb None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:01.938464 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbefabe-48ab-4420-b562-f6bf4b5c0cdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:01.938761 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbefabe-48ab-4420-b562-f6bf4b5c0cdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:01.940221 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbefabe-48ab-4420-b562-f6bf4b5c0cdb None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:01.957928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aab81-43a6-4889-9b4a-65864b96f7b5 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:01.958395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 374/735] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:01.959377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbefabe-48ab-4420-b562-f6bf4b5c0cdb None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:02.008101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:02.029993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dc759-e9f2-42bc-a4cf-5dee1c9efeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:02.032175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dc759-e9f2-42bc-a4cf-5dee1c9efeb0 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:02.032175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dc759-e9f2-42bc-a4cf-5dee1c9efeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:02.032175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dc759-e9f2-42bc-a4cf-5dee1c9efeb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:02.032175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2dc759-e9f2-42bc-a4cf-5dee1c9efeb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:02.032467 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2dc759-e9f2-42bc-a4cf-5dee1c9efeb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:02.033845 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2dc759-e9f2-42bc-a4cf-5dee1c9efeb0 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:02.051635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 362/736] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:02.052637 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dc759-e9f2-42bc-a4cf-5dee1c9efeb0 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:02.072609 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbefabe-48ab-4420-b562-f6bf4b5c0cdb None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:02.111846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1c8b3-d3a4-4ea0-b65f-bb850e989861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:02.112492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1c8b3-d3a4-4ea0-b65f-bb850e989861 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:02.112771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1c8b3-d3a4-4ea0-b65f-bb850e989861 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:02.113043 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1c8b3-d3a4-4ea0-b65f-bb850e989861 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:02.120966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:02.121924 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1c8b3-d3a4-4ea0-b65f-bb850e989861 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:02.123418 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1c8b3-d3a4-4ea0-b65f-bb850e989861 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:02.138391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-83d1c8b3-d3a4-4ea0-b65f-bb850e989861 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:02.138391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:02.138391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:02.138391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:02.138391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:02.138391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:02.138391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:02.138391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:02.138391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:02.138391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:02.138391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:02.138391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:02.138391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:29:02.138391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:29:02.138391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:29:02.140911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:29:02.140911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:02.140911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:02.140911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:02.140911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:02.140911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:02.140911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:02.140911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:02.140911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:02.140911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:02.140911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:02.140911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:02.140911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:02.140911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:02.140911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:02.140911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:02.140911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:02.143125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:29:02.143125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:29:02.143125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:29:02.143125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:29:02.143125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:29:02.143125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:29:02.143125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:02.143125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:02.143125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 375/737] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:02.143125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1c8b3-d3a4-4ea0-b65f-bb850e989861 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:02.174447 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dc759-e9f2-42bc-a4cf-5dee1c9efeb0 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:02.217300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e0df8-c666-4711-b1ef-a22bbeb70957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:02.218075 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e0df8-c666-4711-b1ef-a22bbeb70957 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:02.218464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e0df8-c666-4711-b1ef-a22bbeb70957 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:02.218840 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e0df8-c666-4711-b1ef-a22bbeb70957 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:02.235089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e0df8-c666-4711-b1ef-a22bbeb70957 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:02.237667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e0df8-c666-4711-b1ef-a22bbeb70957 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:02.261105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-865e0df8-c666-4711-b1ef-a22bbeb70957 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 16:29:02.261105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:02.261105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:02.261105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:02.261105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:02.261105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:02.261105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:02.261105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:02.261105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:02.261105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:02.261105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:02.261105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:02.261105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:29:02.261105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:29:02.261105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:29:02.261105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:02.263329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:02.265750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:02.265750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:02.265750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:29:02.265750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:29:02.265750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:29:02.265750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:29:02.265750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:29:02.265750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:29:02.265750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 16:29:02.265750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:02.265750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 363/738] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:29:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:02.265750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e0df8-c666-4711-b1ef-a22bbeb70957 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:02.309211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1c8b3-d3a4-4ea0-b65f-bb850e989861 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:02.312160 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:02.361205 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4826e-fc54-402a-a83e-d59124e5b8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:02.363659 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4826e-fc54-402a-a83e-d59124e5b8fb None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:02.364418 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4826e-fc54-402a-a83e-d59124e5b8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:02.365048 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4826e-fc54-402a-a83e-d59124e5b8fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:02.377877 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4826e-fc54-402a-a83e-d59124e5b8fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:02.381208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4826e-fc54-402a-a83e-d59124e5b8fb None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:02.405562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-dea4826e-fc54-402a-a83e-d59124e5b8fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:02.405562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:02.405562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:02.405562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:02.405562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:02.405562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:02.405562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:02.405562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:02.405562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:02.405562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:02.405562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:02.405562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:02.405562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:29:02.405562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:29:02.405562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:29:02.407259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:29:02.407259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:02.407259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:02.407259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:02.407259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:02.407259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:02.407259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:02.407259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:02.407259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:02.407259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:02.407259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:02.407259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:02.407259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:02.407259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:02.407259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:02.407259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:02.407259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:02.409080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:29:02.409080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:29:02.409080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:29:02.409080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:29:02.409080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:29:02.409080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:29:02.409080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:02.409080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:02.412992 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 376/739] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:02.415742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4826e-fc54-402a-a83e-d59124e5b8fb None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:02.433772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e0df8-c666-4711-b1ef-a22bbeb70957 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:02.456237 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:02.481759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcfa46-b54e-43b9-87fe-239c837a2bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:02.482484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcfa46-b54e-43b9-87fe-239c837a2bad None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:02.482840 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcfa46-b54e-43b9-87fe-239c837a2bad None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:02.483125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcfa46-b54e-43b9-87fe-239c837a2bad None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:02.485078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcfa46-b54e-43b9-87fe-239c837a2bad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:02.485643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcfa46-b54e-43b9-87fe-239c837a2bad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:02.489223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcfa46-b54e-43b9-87fe-239c837a2bad None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:02.513194 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 364/740] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:02.514061 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fca4ad-0f48-415a-9a8b-a93a11da2761 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:02.514363 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fca4ad-0f48-415a-9a8b-a93a11da2761 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:02.514618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fca4ad-0f48-415a-9a8b-a93a11da2761 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:02.519565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 365/741] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:02.519565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fca4ad-0f48-415a-9a8b-a93a11da2761 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:02.568999 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4826e-fc54-402a-a83e-d59124e5b8fb None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:02.615204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222b8b1-81cd-4af6-9205-e9037807040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:02.615876 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222b8b1-81cd-4af6-9205-e9037807040a None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:02.616157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222b8b1-81cd-4af6-9205-e9037807040a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:02.616432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222b8b1-81cd-4af6-9205-e9037807040a None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:02.617202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222b8b1-81cd-4af6-9205-e9037807040a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:02.617513 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222b8b1-81cd-4af6-9205-e9037807040a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:02.618984 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222b8b1-81cd-4af6-9205-e9037807040a None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:02.640903 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 377/742] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Sep 7 16:29:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:02.641778 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222b8b1-81cd-4af6-9205-e9037807040a None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:02.675405 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fca4ad-0f48-415a-9a8b-a93a11da2761 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:02.694418 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:02.722104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99453c37-91e3-4889-b631-71017fc4c60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:02.722968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99453c37-91e3-4889-b631-71017fc4c60e None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:02.723772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99453c37-91e3-4889-b631-71017fc4c60e None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:02.724258 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99453c37-91e3-4889-b631-71017fc4c60e None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:02.725554 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99453c37-91e3-4889-b631-71017fc4c60e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:02.725901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99453c37-91e3-4889-b631-71017fc4c60e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:02.728311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99453c37-91e3-4889-b631-71017fc4c60e None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:02.756189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 366/743] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:02.758862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eadfb5-f39e-4b32-8cde-c2fad9820de3 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:02.759347 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eadfb5-f39e-4b32-8cde-c2fad9820de3 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:02.759867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eadfb5-f39e-4b32-8cde-c2fad9820de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:02.785136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-e3eadfb5-f39e-4b32-8cde-c2fad9820de3 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:02.786614 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e3eadfb5-f39e-4b32-8cde-c2fad9820de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:02.825675 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:02.864908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222b8b1-81cd-4af6-9205-e9037807040a None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:02.904239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 367/744] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 16:29:02.905756 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eadfb5-f39e-4b32-8cde-c2fad9820de3 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:02.937221 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a57767-bc37-42e1-bdec-ffc2caf1952c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:02.939177 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a57767-bc37-42e1-bdec-ffc2caf1952c None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:02.940044 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a57767-bc37-42e1-bdec-ffc2caf1952c None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:02.941418 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a57767-bc37-42e1-bdec-ffc2caf1952c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:02.943975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a57767-bc37-42e1-bdec-ffc2caf1952c None admin] RBAC: Adding query filter params (role.id=9b7a362fef7446e795c33b25a08f20bc, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=87ba67fc171b4258b6fda72094ed11c3) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:02.945382 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a57767-bc37-42e1-bdec-ffc2caf1952c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:02.948739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a57767-bc37-42e1-bdec-ffc2caf1952c None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:02.971771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 378/745] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:29:02 2022] GET /identity/v3/role_assignments?user.id=87ba67fc171b4258b6fda72094ed11c3&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9b7a362fef7446e795c33b25a08f20bc => generated 259 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:02.971771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a57767-bc37-42e1-bdec-ffc2caf1952c None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:03.200805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:03.236400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a57767-bc37-42e1-bdec-ffc2caf1952c None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:03.263197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eadfb5-f39e-4b32-8cde-c2fad9820de3 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:03.312835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291b79e-0d02-45ac-9ad1-6a8bc0c72987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:03.315420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291b79e-0d02-45ac-9ad1-6a8bc0c72987 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:03.316358 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291b79e-0d02-45ac-9ad1-6a8bc0c72987 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:03.317168 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291b79e-0d02-45ac-9ad1-6a8bc0c72987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:03.319153 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291b79e-0d02-45ac-9ad1-6a8bc0c72987 None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=cf48978c20f04173b114e15e1ce2157c) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:03.320569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291b79e-0d02-45ac-9ad1-6a8bc0c72987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:03.324768 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291b79e-0d02-45ac-9ad1-6a8bc0c72987 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:03.343848 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 379/746] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:29:02 2022] GET /identity/v3/role_assignments?user.id=cf48978c20f04173b114e15e1ce2157c&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 259 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:03.343848 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291b79e-0d02-45ac-9ad1-6a8bc0c72987 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:03.357825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bf8a1-ba14-4f99-9af2-928cfb3116a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:03.358762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bf8a1-ba14-4f99-9af2-928cfb3116a9 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:03.359174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bf8a1-ba14-4f99-9af2-928cfb3116a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:03.359619 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bf8a1-ba14-4f99-9af2-928cfb3116a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:03.442382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:03.591656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bf8a1-ba14-4f99-9af2-928cfb3116a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:03.594469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bf8a1-ba14-4f99-9af2-928cfb3116a9 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:03.707296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291b79e-0d02-45ac-9ad1-6a8bc0c72987 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:03.849047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cfc73-a40c-4eb6-93b9-df53289573c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:03.849928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cfc73-a40c-4eb6-93b9-df53289573c0 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:03.850402 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cfc73-a40c-4eb6-93b9-df53289573c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:03.850897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cfc73-a40c-4eb6-93b9-df53289573c0 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:03.852765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cfc73-a40c-4eb6-93b9-df53289573c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:03.855227 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cfc73-a40c-4eb6-93b9-df53289573c0 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:03.899092 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 368/747] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:29:02 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 994 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 16:29:03.905200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb6293-1eaf-4863-9bbd-6ae5a8c8b0f4 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:03.907863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb6293-1eaf-4863-9bbd-6ae5a8c8b0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:03.907863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb6293-1eaf-4863-9bbd-6ae5a8c8b0f4 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:03.909622 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 369/748] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:03.912374 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb6293-1eaf-4863-9bbd-6ae5a8c8b0f4 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:03.979645 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 380/749] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Sep 7 16:29:03 2022] POST /identity/v3/services => generated 240 bytes in 640 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:29:03.982480 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b811b-998c-4e42-9126-f171a826f06f None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:03.983336 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b811b-998c-4e42-9126-f171a826f06f None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:03.984120 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b811b-998c-4e42-9126-f171a826f06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:04.018171 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-588b811b-998c-4e42-9126-f171a826f06f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:04.020838 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-588b811b-998c-4e42-9126-f171a826f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:04.025799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:04.057136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:04.181256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb6293-1eaf-4863-9bbd-6ae5a8c8b0f4 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:04.264678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c841693-b5cf-4132-b03d-8767667dcb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:04.265244 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 381/750] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:04.272398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c841693-b5cf-4132-b03d-8767667dcb75 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:04.273166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c841693-b5cf-4132-b03d-8767667dcb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:04.273464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c841693-b5cf-4132-b03d-8767667dcb75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:04.295895 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c841693-b5cf-4132-b03d-8767667dcb75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:04.298940 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c841693-b5cf-4132-b03d-8767667dcb75 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:04.331295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-8c841693-b5cf-4132-b03d-8767667dcb75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:04.331295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:04.331295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:04.331295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:04.331295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:04.331295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:04.331295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:04.331295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:04.331295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:04.331295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:04.331295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:04.331295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:04.331295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:04.331295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:04.331295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:04.331295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:04.333173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:04.333173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:04.333173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:04.333173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:04.333173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:04.333173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:04.333173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:04.333173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:04.333173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:04.333173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:04.333173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:04.333173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:04.333173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:04.333173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:04.333173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:04.333173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:04.333173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:04.334939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:04.334939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:04.334939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:04.334939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 370/751] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:04.345463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b811b-998c-4e42-9126-f171a826f06f None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:04.514049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b811b-998c-4e42-9126-f171a826f06f None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:04.586867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9a19b-e00d-42c2-b5be-3cf408c34ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:04.587935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a19b-e00d-42c2-b5be-3cf408c34ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:04.588351 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a19b-e00d-42c2-b5be-3cf408c34ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:04.588630 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a19b-e00d-42c2-b5be-3cf408c34ef4 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:04.589306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9a19b-e00d-42c2-b5be-3cf408c34ef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:04.589674 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9a19b-e00d-42c2-b5be-3cf408c34ef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:04.591453 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9a19b-e00d-42c2-b5be-3cf408c34ef4 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:04.603937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:04.615947 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 382/752] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:04.624984 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c841693-b5cf-4132-b03d-8767667dcb75 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:04.687675 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9a19b-e00d-42c2-b5be-3cf408c34ef4 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:04.848887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c841693-b5cf-4132-b03d-8767667dcb75 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:04.864416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:04.900343 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79a264-473a-4d0e-9c31-c8d859ca0d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:04.901864 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79a264-473a-4d0e-9c31-c8d859ca0d25 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:04.902355 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79a264-473a-4d0e-9c31-c8d859ca0d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:04.902857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79a264-473a-4d0e-9c31-c8d859ca0d25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:04.910257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9a19b-e00d-42c2-b5be-3cf408c34ef4 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:04.915212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79a264-473a-4d0e-9c31-c8d859ca0d25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:04.917096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79a264-473a-4d0e-9c31-c8d859ca0d25 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:04.943942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-5f79a264-473a-4d0e-9c31-c8d859ca0d25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:04.943942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:04.943942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:04.943942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:04.943942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:04.943942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:04.943942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:04.943942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:04.943942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:04.943942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:04.943942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:04.943942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:04.943942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:29:04.943942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:29:04.943942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:29:04.945510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:29:04.945510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:04.945510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:04.945510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:04.945510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:04.945510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:04.945510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:04.945510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:04.945510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:04.945510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:04.945510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:04.945510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:04.945510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:04.945510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:04.945510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:04.945510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:04.945510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:04.946414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:29:04.946414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:29:04.946414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:29:04.946414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:29:04.946414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:29:04.946414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:29:04.946414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:04.946414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:04.948968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 371/753] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:04.955047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79a264-473a-4d0e-9c31-c8d859ca0d25 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:04.960892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d291c73-5878-4a98-be71-51987667d1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:04.961573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d291c73-5878-4a98-be71-51987667d1ba None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:04.961860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d291c73-5878-4a98-be71-51987667d1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:04.962134 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d291c73-5878-4a98-be71-51987667d1ba None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:04.962802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d291c73-5878-4a98-be71-51987667d1ba None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:04.965359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d291c73-5878-4a98-be71-51987667d1ba None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:04.981440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-3d291c73-5878-4a98-be71-51987667d1ba None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 16:29:04.981440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:04.981440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:04.981440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:04.981440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:04.981440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:04.981440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:04.981440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:04.981440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 16:29:04.981440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:04.981440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:04.981440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:04.981440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:04.981440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:04.981440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:04.981440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:04.981440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:04.982495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:04.982495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:04.982495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:04.982495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:04.982495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:04.982495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:04.982495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:04.982495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:04.982495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:04.982495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:04.982495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:04.982495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:04.982495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:04.982495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:04.982495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:04.982495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:04.983329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:04.983329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:04.983329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:04.983329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:04.983329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:04.983329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:04.983329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:04.983329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:04.983329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:04.983329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:04.983329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:04.983329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:04.983329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 16:29:04.983329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:04.992138 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 383/754] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Sep 7 16:29:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:05.000648 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d291c73-5878-4a98-be71-51987667d1ba None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:05.081595 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79a264-473a-4d0e-9c31-c8d859ca0d25 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:05.094878 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:05.123353 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4abf0-1fc2-456b-bfbc-099b78e3490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:05.124417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4abf0-1fc2-456b-bfbc-099b78e3490a None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:05.124909 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4abf0-1fc2-456b-bfbc-099b78e3490a None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:05.125385 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4abf0-1fc2-456b-bfbc-099b78e3490a None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:05.126314 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4abf0-1fc2-456b-bfbc-099b78e3490a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:05.126857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4abf0-1fc2-456b-bfbc-099b78e3490a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:05.128610 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4abf0-1fc2-456b-bfbc-099b78e3490a None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:05.144483 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 372/755] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:29:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:05.149938 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d291c73-5878-4a98-be71-51987667d1ba None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:05.151374 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4abf0-1fc2-456b-bfbc-099b78e3490a None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:05.186033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:05.192705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16a8c0-c30f-4e95-b733-5d4cb570a5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:05.193491 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16a8c0-c30f-4e95-b733-5d4cb570a5be None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:05.193802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16a8c0-c30f-4e95-b733-5d4cb570a5be None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:05.194162 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16a8c0-c30f-4e95-b733-5d4cb570a5be None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:05.196978 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16a8c0-c30f-4e95-b733-5d4cb570a5be None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:05.199314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16a8c0-c30f-4e95-b733-5d4cb570a5be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:05.207923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16a8c0-c30f-4e95-b733-5d4cb570a5be None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:05.221489 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 384/756] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Sep 7 16:29:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:05.230909 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16a8c0-c30f-4e95-b733-5d4cb570a5be None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:05.270556 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4abf0-1fc2-456b-bfbc-099b78e3490a None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:05.317487 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9bbef-43dd-4343-97bc-364a184352fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:05.318115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9bbef-43dd-4343-97bc-364a184352fd None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:05.318403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9bbef-43dd-4343-97bc-364a184352fd None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:05.318675 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9bbef-43dd-4343-97bc-364a184352fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:05.319571 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9bbef-43dd-4343-97bc-364a184352fd None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=56cd868e866d436aa1d601f7791e812c) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:05.320300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9bbef-43dd-4343-97bc-364a184352fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:05.321776 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9bbef-43dd-4343-97bc-364a184352fd None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:05.334629 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 373/757] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:29:05 2022] GET /identity/v3/role_assignments?user.id=56cd868e866d436aa1d601f7791e812c&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:05.475388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16a8c0-c30f-4e95-b733-5d4cb570a5be None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:05.534181 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:05.555587 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6402d-e5a3-472e-ae71-794ae7c1a32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:05.556622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6402d-e5a3-472e-ae71-794ae7c1a32a None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:05.556969 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6402d-e5a3-472e-ae71-794ae7c1a32a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:05.557513 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6402d-e5a3-472e-ae71-794ae7c1a32a None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:05.558713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6402d-e5a3-472e-ae71-794ae7c1a32a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:05.559306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6402d-e5a3-472e-ae71-794ae7c1a32a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:05.561870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6402d-e5a3-472e-ae71-794ae7c1a32a None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:05.575528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 385/758] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Sep 7 16:29:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:05.581458 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9bbef-43dd-4343-97bc-364a184352fd None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:05.764014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:05.772221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9bbef-43dd-4343-97bc-364a184352fd None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:05.816179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085df66-b212-4584-a0b1-db37dd11d2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:05.816819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085df66-b212-4584-a0b1-db37dd11d2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:05.817100 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085df66-b212-4584-a0b1-db37dd11d2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:05.817376 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085df66-b212-4584-a0b1-db37dd11d2c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:05.818087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085df66-b212-4584-a0b1-db37dd11d2c8 None admin] RBAC: Adding query filter params (interface=public, service_id=470186b20e7f4a379d9684ba2d94e3e5, region_id=RegionOne) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:05.818399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085df66-b212-4584-a0b1-db37dd11d2c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:05.820356 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085df66-b212-4584-a0b1-db37dd11d2c8 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:05.829207 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 374/759] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Sep 7 16:29:05 2022] GET /identity/v3/endpoints?service_id=470186b20e7f4a379d9684ba2d94e3e5&interface=public®ion_id=RegionOne => generated 194 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:05.834596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6402d-e5a3-472e-ae71-794ae7c1a32a None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:05.981811 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6402d-e5a3-472e-ae71-794ae7c1a32a None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:06.019375 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264283d3-be07-487e-87a2-650f58fa9233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:06.019928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264283d3-be07-487e-87a2-650f58fa9233 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:06.020197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264283d3-be07-487e-87a2-650f58fa9233 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:06.020474 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264283d3-be07-487e-87a2-650f58fa9233 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:06.021082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264283d3-be07-487e-87a2-650f58fa9233 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:06.022459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264283d3-be07-487e-87a2-650f58fa9233 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:06.029122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 386/760] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Sep 7 16:29:05 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:06.371039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b75d6-6b62-4806-a6d0-e6efe8e5a7e0 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:06.371589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b75d6-6b62-4806-a6d0-e6efe8e5a7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:06.371589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b75d6-6b62-4806-a6d0-e6efe8e5a7e0 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:06.373290 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 375/761] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:06.391094 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d2b1c-5b34-47f1-9d33-bb121141f295 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:06.391813 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d2b1c-5b34-47f1-9d33-bb121141f295 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:06.392440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d2b1c-5b34-47f1-9d33-bb121141f295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:06.430071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-8d8d2b1c-5b34-47f1-9d33-bb121141f295 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:06.432586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-8d8d2b1c-5b34-47f1-9d33-bb121141f295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:06.549393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:06.582518 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 387/762] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:06.792780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca0ada-d0e3-42a5-a163-a31804469963 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:06.793190 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca0ada-d0e3-42a5-a163-a31804469963 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:06.793664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca0ada-d0e3-42a5-a163-a31804469963 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:06.796502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 376/763] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:06.803164 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51be8a0-10a5-406e-b6a0-7e8d6aefe0ee None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:06.803732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51be8a0-10a5-406e-b6a0-7e8d6aefe0ee None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:06.804410 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51be8a0-10a5-406e-b6a0-7e8d6aefe0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:06.847324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-e51be8a0-10a5-406e-b6a0-7e8d6aefe0ee None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:06.849580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-e51be8a0-10a5-406e-b6a0-7e8d6aefe0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:06.935062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca0ada-d0e3-42a5-a163-a31804469963 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:06.998064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 388/764] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:07.386437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca0ada-d0e3-42a5-a163-a31804469963 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:07.387690 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2536d-e6fa-45cf-a398-4bc174574dd2 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:07.387985 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2536d-e6fa-45cf-a398-4bc174574dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:07.388255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2536d-e6fa-45cf-a398-4bc174574dd2 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:07.389902 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 389/765] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:07.396413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e300c04-0f0d-4e4c-83a9-ece38e9c7503 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:07.396797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e300c04-0f0d-4e4c-83a9-ece38e9c7503 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:07.396955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e300c04-0f0d-4e4c-83a9-ece38e9c7503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:07.440208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-2e300c04-0f0d-4e4c-83a9-ece38e9c7503 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:07.441433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2e300c04-0f0d-4e4c-83a9-ece38e9c7503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:07.456672 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02796090-c6d6-4de2-a6c9-d10233375567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:07.457349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02796090-c6d6-4de2-a6c9-d10233375567 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:07.457618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02796090-c6d6-4de2-a6c9-d10233375567 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:07.457883 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02796090-c6d6-4de2-a6c9-d10233375567 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:07.485901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02796090-c6d6-4de2-a6c9-d10233375567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:29:07.491758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-02796090-c6d6-4de2-a6c9-d10233375567 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:29:07.491758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:07.491758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:07.491758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:07.491758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:07.491758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:07.491758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:07.491758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:07.491758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:07.491758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:07.491758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:07.491758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:07.491758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:29:07.491758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:29:07.491758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:29:07.491758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:29:07.493726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:29:07.493726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:29:07.493726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:29:07.493726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:29:07.493726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:07.493726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:07.493726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:07.493726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:07.493726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:07.493726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:07.493726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:07.493726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:07.493726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:07.493726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:07.493726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:07.493726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:07.495426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:07.495426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:07.495426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:07.495426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:07.495426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:29:07.495426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:29:07.495426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:29:07.495426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:29:07.495426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:29:07.495426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:29:07.495426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:29:07.495426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:07.495426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 377/766] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:29:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 559 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:07.509337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02796090-c6d6-4de2-a6c9-d10233375567 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:07.560128 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:07.641010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 390/767] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:07.712943 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02796090-c6d6-4de2-a6c9-d10233375567 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:07.733802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e300c04-0f0d-4e4c-83a9-ece38e9c7503 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:07.796261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70f55e-1bd8-4409-a124-524c419af201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:07.796888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70f55e-1bd8-4409-a124-524c419af201 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:07.797168 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70f55e-1bd8-4409-a124-524c419af201 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:07.797441 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70f55e-1bd8-4409-a124-524c419af201 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:07.798124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70f55e-1bd8-4409-a124-524c419af201 None admin] RBAC: Adding query filter params (name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:07.798430 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70f55e-1bd8-4409-a124-524c419af201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:07.799866 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70f55e-1bd8-4409-a124-524c419af201 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:07.823696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 378/768] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:29:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:07.844074 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70f55e-1bd8-4409-a124-524c419af201 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:07.848800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:07.977570 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e300c04-0f0d-4e4c-83a9-ece38e9c7503 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:08.050649 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5fd48-ae8a-4bd8-83df-55d0ba5734de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:08.051783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5fd48-ae8a-4bd8-83df-55d0ba5734de None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:08.052254 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5fd48-ae8a-4bd8-83df-55d0ba5734de None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:08.052729 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5fd48-ae8a-4bd8-83df-55d0ba5734de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:08.099242 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5fd48-ae8a-4bd8-83df-55d0ba5734de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:29:08.112668 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:08.118845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-97b5fd48-ae8a-4bd8-83df-55d0ba5734de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:29:08.118845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:08.118845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:08.118845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:08.118845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:08.118845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:08.118845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:08.118845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:08.118845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:08.118845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:08.118845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:08.118845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:08.118845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:29:08.118845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:29:08.118845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:29:08.118845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:29:08.119893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:29:08.119893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:29:08.119893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:29:08.119893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:29:08.119893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:08.119893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:08.119893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:08.119893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:08.119893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:08.119893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:08.119893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:08.119893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:08.119893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:08.119893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:08.119893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:08.119893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:08.120726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:08.120726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:08.120726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:08.120726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:08.120726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:29:08.120726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:29:08.120726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:29:08.120726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:29:08.120726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:29:08.120726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:29:08.120726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:29:08.120726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:08.125353 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 391/769] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:29:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:08.134355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5fd48-ae8a-4bd8-83df-55d0ba5734de None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:08.177550 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70f55e-1bd8-4409-a124-524c419af201 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:08.253216 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73fbb6-62ff-4713-9130-ae5a874e9af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:08.253978 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73fbb6-62ff-4713-9130-ae5a874e9af8 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:08.254263 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73fbb6-62ff-4713-9130-ae5a874e9af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:08.254540 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73fbb6-62ff-4713-9130-ae5a874e9af8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:08.268074 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73fbb6-62ff-4713-9130-ae5a874e9af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:08.269625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73fbb6-62ff-4713-9130-ae5a874e9af8 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:08.288759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-8a73fbb6-62ff-4713-9130-ae5a874e9af8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:08.288759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:08.288759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:08.288759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:08.288759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:08.288759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:08.288759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:08.288759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:08.288759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:08.288759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:08.288759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:08.288759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:08.288759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:08.288759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:08.288759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:08.288759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:08.291002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:08.291002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:08.291002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:08.291002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:08.291002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:08.291002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:08.291002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:08.291002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:08.291002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:08.291002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:08.291002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:08.291002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:08.291002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:08.291002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:08.291002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:08.291002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:08.291002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:08.293223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:08.293223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:08.293223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:08.293223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 379/770] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:08.293223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73fbb6-62ff-4713-9130-ae5a874e9af8 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:08.401702 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5fd48-ae8a-4bd8-83df-55d0ba5734de None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:08.406689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:08.429690 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73fbb6-62ff-4713-9130-ae5a874e9af8 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:08.474355 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd18156-68d9-43b4-87c4-134a67e739e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:08.474802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741dcdc-af19-409b-b07b-f25eb38fcf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:08.475555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd18156-68d9-43b4-87c4-134a67e739e9 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:08.475987 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd18156-68d9-43b4-87c4-134a67e739e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:08.476522 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd18156-68d9-43b4-87c4-134a67e739e9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:08.477174 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741dcdc-af19-409b-b07b-f25eb38fcf26 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:08.477467 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd18156-68d9-43b4-87c4-134a67e739e9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:08.477719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741dcdc-af19-409b-b07b-f25eb38fcf26 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:08.478225 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741dcdc-af19-409b-b07b-f25eb38fcf26 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:08.479370 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd18156-68d9-43b4-87c4-134a67e739e9 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:08.479602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741dcdc-af19-409b-b07b-f25eb38fcf26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:08.480168 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741dcdc-af19-409b-b07b-f25eb38fcf26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:08.482094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:08.482963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741dcdc-af19-409b-b07b-f25eb38fcf26 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:08.493311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-abd18156-68d9-43b4-87c4-134a67e739e9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 16:29:08.493311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:08.493311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:08.493311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:08.493311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:08.493311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:08.493311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:08.493311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:08.493311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 16:29:08.493311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:08.493311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:08.493311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:08.493311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:08.493311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:08.493311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:08.493311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:08.493311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:08.494617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:08.494617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:08.494617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:08.494617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:08.494617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:08.494617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:08.494617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:08.494617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:08.494617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:08.494617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:08.494617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:08.494617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:08.494617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:08.494617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:08.494617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:08.494617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:08.495633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:08.495633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:08.495633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:08.495633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:08.495633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:08.495633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:08.495633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:08.495633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:08.495633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:08.495633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:08.495633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:08.495633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:08.495633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 16:29:08.495633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:08.498679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 380/771] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:08 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:08.499898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd18156-68d9-43b4-87c4-134a67e739e9 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:08.514440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 392/772] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:29:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:08.515711 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741dcdc-af19-409b-b07b-f25eb38fcf26 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:08.688359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741dcdc-af19-409b-b07b-f25eb38fcf26 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:08.691358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd18156-68d9-43b4-87c4-134a67e739e9 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:08.732712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead747df-796e-4298-bc69-4f7337125a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:08.733605 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead747df-796e-4298-bc69-4f7337125a3c None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:08.733883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead747df-796e-4298-bc69-4f7337125a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:08.734156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead747df-796e-4298-bc69-4f7337125a3c None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:08.734790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead747df-796e-4298-bc69-4f7337125a3c None admin] RBAC: Adding query filter params (name=network) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:08.735102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead747df-796e-4298-bc69-4f7337125a3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:08.736564 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead747df-796e-4298-bc69-4f7337125a3c None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:08.742444 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 393/773] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Sep 7 16:29:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:08.743923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead747df-796e-4298-bc69-4f7337125a3c None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:08.770504 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419fb84-465d-495f-aa67-e903d734ec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:08.772271 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419fb84-465d-495f-aa67-e903d734ec68 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:08.774096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419fb84-465d-495f-aa67-e903d734ec68 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:08.774834 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419fb84-465d-495f-aa67-e903d734ec68 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:08.776593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419fb84-465d-495f-aa67-e903d734ec68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:08.777110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419fb84-465d-495f-aa67-e903d734ec68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:08.779700 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419fb84-465d-495f-aa67-e903d734ec68 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:08.789715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:08.808465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 381/774] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:08.810180 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe45c4-1aa8-4fe3-972e-4f34abefa2d3 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:08.810621 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe45c4-1aa8-4fe3-972e-4f34abefa2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:08.811026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe45c4-1aa8-4fe3-972e-4f34abefa2d3 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:08.815400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 382/775] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:08.815400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe45c4-1aa8-4fe3-972e-4f34abefa2d3 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:08.909201 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead747df-796e-4298-bc69-4f7337125a3c None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:08.909458 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:08.950555 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d26f2-5c43-4b90-8d0a-04190c6685f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:08.951195 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d26f2-5c43-4b90-8d0a-04190c6685f5 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:08.951496 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d26f2-5c43-4b90-8d0a-04190c6685f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:08.951784 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d26f2-5c43-4b90-8d0a-04190c6685f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:08.956871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe45c4-1aa8-4fe3-972e-4f34abefa2d3 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:08.963614 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d26f2-5c43-4b90-8d0a-04190c6685f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:08.965079 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d26f2-5c43-4b90-8d0a-04190c6685f5 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:08.980140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-dc9d26f2-5c43-4b90-8d0a-04190c6685f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:08.980140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:08.980140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:08.980140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:08.980140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:08.980140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:08.980140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:08.980140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:08.980140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:08.980140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:08.980140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:08.980140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:08.980140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:08.980140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:08.980140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:08.980140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:08.981870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:08.981870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:08.981870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:08.981870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:08.981870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:08.981870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:08.981870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:08.981870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:08.981870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:08.981870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:08.981870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:08.981870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:08.981870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:08.981870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:08.981870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:08.981870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:08.981870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:08.984010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:08.984010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:08.984010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:08.984010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 394/776] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:08.984010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d26f2-5c43-4b90-8d0a-04190c6685f5 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:09.002481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818bb1b-c118-4377-8b35-2383327e9107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:09.003168 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818bb1b-c118-4377-8b35-2383327e9107 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:09.003629 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818bb1b-c118-4377-8b35-2383327e9107 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:09.003962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818bb1b-c118-4377-8b35-2383327e9107 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:09.004869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818bb1b-c118-4377-8b35-2383327e9107 None admin] RBAC: Adding query filter params (type=network) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:09.005252 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818bb1b-c118-4377-8b35-2383327e9107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:09.007402 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818bb1b-c118-4377-8b35-2383327e9107 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:09.013306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 383/777] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Sep 7 16:29:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:09.014766 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7244e-7c16-4e5b-a1cf-2d86ba4434c5 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:09.015110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7244e-7c16-4e5b-a1cf-2d86ba4434c5 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:09.015497 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7244e-7c16-4e5b-a1cf-2d86ba4434c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:09.035611 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-d8b7244e-7c16-4e5b-a1cf-2d86ba4434c5 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:09.036747 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-d8b7244e-7c16-4e5b-a1cf-2d86ba4434c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:09.080797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:09.101634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d26f2-5c43-4b90-8d0a-04190c6685f5 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:09.112101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 384/778] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:09.113372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9390ca-8388-4f6c-bcb2-d17f115d2762 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:09.113649 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9390ca-8388-4f6c-bcb2-d17f115d2762 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:09.113958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9390ca-8388-4f6c-bcb2-d17f115d2762 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:09.115197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 385/779] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:09.115955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9390ca-8388-4f6c-bcb2-d17f115d2762 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:09.144451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e87d2f-2d10-4ba8-8d40-bc78c52876cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:09.145358 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e87d2f-2d10-4ba8-8d40-bc78c52876cf None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:09.145835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e87d2f-2d10-4ba8-8d40-bc78c52876cf None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:09.146111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e87d2f-2d10-4ba8-8d40-bc78c52876cf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:09.156181 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e87d2f-2d10-4ba8-8d40-bc78c52876cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:09.157652 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e87d2f-2d10-4ba8-8d40-bc78c52876cf None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:09.173629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-f4e87d2f-2d10-4ba8-8d40-bc78c52876cf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 16:29:09.173629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:09.173629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:09.173629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:09.173629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:09.173629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:09.173629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:09.173629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:09.173629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:09.173629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:09.173629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:09.173629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:09.173629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:29:09.173629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:29:09.173629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:29:09.173629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:09.175399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:09.178557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:09.178557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:09.178557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:29:09.178557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:29:09.178557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:29:09.178557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:29:09.178557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:29:09.178557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:29:09.178557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 16:29:09.178557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:09.178557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 395/780] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Sep 7 16:29:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:09.178557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e87d2f-2d10-4ba8-8d40-bc78c52876cf None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:09.187684 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:09.251932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9390ca-8388-4f6c-bcb2-d17f115d2762 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:09.298035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65833ff8-507c-48f1-a048-dd60a0db8718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:09.298611 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65833ff8-507c-48f1-a048-dd60a0db8718 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:09.298884 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65833ff8-507c-48f1-a048-dd60a0db8718 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:09.299150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65833ff8-507c-48f1-a048-dd60a0db8718 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:09.299853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65833ff8-507c-48f1-a048-dd60a0db8718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:09.300152 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65833ff8-507c-48f1-a048-dd60a0db8718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:09.301700 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65833ff8-507c-48f1-a048-dd60a0db8718 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:09.316770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e87d2f-2d10-4ba8-8d40-bc78c52876cf None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:09.316962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 386/781] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:09.318937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a683b-c7c3-48e3-9e8d-eae53b7df3b9 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:09.319993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a683b-c7c3-48e3-9e8d-eae53b7df3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:09.320456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a683b-c7c3-48e3-9e8d-eae53b7df3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:09.343929 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8f4a683b-c7c3-48e3-9e8d-eae53b7df3b9 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:09.345355 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8f4a683b-c7c3-48e3-9e8d-eae53b7df3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:09.367049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec07624-120b-4a36-9bef-fa978d583aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:09.368409 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec07624-120b-4a36-9bef-fa978d583aef None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:09.368694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec07624-120b-4a36-9bef-fa978d583aef None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:09.368969 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec07624-120b-4a36-9bef-fa978d583aef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:09.369692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec07624-120b-4a36-9bef-fa978d583aef None admin] RBAC: Adding query filter params (interface=public, service_id=fed37399765e4105a840bce5c43d2790, region_id=RegionOne) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:09.370000 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec07624-120b-4a36-9bef-fa978d583aef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:09.371396 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec07624-120b-4a36-9bef-fa978d583aef None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:09.380450 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 396/782] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Sep 7 16:29:09 2022] GET /identity/v3/endpoints?service_id=fed37399765e4105a840bce5c43d2790&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:09.386746 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec07624-120b-4a36-9bef-fa978d583aef None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:09.396802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:09.429369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 387/783] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:09.430348 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a683b-c7c3-48e3-9e8d-eae53b7df3b9 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:09.503306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:09.538065 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec07624-120b-4a36-9bef-fa978d583aef None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:09.578646 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a683b-c7c3-48e3-9e8d-eae53b7df3b9 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:09.589953 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d1d8c-2955-4bbe-9ef5-9526218b86f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:09.590997 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d1d8c-2955-4bbe-9ef5-9526218b86f2 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:09.591565 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d1d8c-2955-4bbe-9ef5-9526218b86f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:09.592034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d1d8c-2955-4bbe-9ef5-9526218b86f2 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:09.592972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d1d8c-2955-4bbe-9ef5-9526218b86f2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:09.593480 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d1d8c-2955-4bbe-9ef5-9526218b86f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:09.595651 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d1d8c-2955-4bbe-9ef5-9526218b86f2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:09.623530 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 397/784] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Sep 7 16:29:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:09.623530 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d1d8c-2955-4bbe-9ef5-9526218b86f2 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:09.651704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732acbf4-0fc3-4ef5-a6bb-f64b5efb3e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:09.652801 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732acbf4-0fc3-4ef5-a6bb-f64b5efb3e64 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:09.653263 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732acbf4-0fc3-4ef5-a6bb-f64b5efb3e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:09.653827 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732acbf4-0fc3-4ef5-a6bb-f64b5efb3e64 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:09.667886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732acbf4-0fc3-4ef5-a6bb-f64b5efb3e64 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:09.670648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732acbf4-0fc3-4ef5-a6bb-f64b5efb3e64 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:09.696632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-732acbf4-0fc3-4ef5-a6bb-f64b5efb3e64 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:29:09.696632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:09.696632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:09.696632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:09.696632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:09.696632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:09.696632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:09.696632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:09.696632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:09.696632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:09.696632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:09.696632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:09.696632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:29:09.696632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:29:09.696632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:29:09.696632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:09.698666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:09.700527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:09.700527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:09.700527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:29:09.700527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:29:09.700527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:29:09.700527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:29:09.700527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:29:09.700527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:29:09.700527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:29:09.700527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:09.700527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 388/785] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Sep 7 16:29:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:09.700527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732acbf4-0fc3-4ef5-a6bb-f64b5efb3e64 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:09.737847 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:09.790880 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d1d8c-2955-4bbe-9ef5-9526218b86f2 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:09.835339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54bd28-9013-41ff-99b9-64e9b4df672e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:09.835339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54bd28-9013-41ff-99b9-64e9b4df672e None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:09.835339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54bd28-9013-41ff-99b9-64e9b4df672e None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:09.835339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54bd28-9013-41ff-99b9-64e9b4df672e None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:09.836049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54bd28-9013-41ff-99b9-64e9b4df672e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:09.836049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54bd28-9013-41ff-99b9-64e9b4df672e None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:09.840219 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 398/786] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Sep 7 16:29:09 2022] GET /identity/v3/services => generated 772 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:09.841695 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54bd28-9013-41ff-99b9-64e9b4df672e None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:09.857014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732acbf4-0fc3-4ef5-a6bb-f64b5efb3e64 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:09.860046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:09.923123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b9c73-221f-4ff7-8f77-a1ade8e7a82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:09.924365 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b9c73-221f-4ff7-8f77-a1ade8e7a82f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:09.924884 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b9c73-221f-4ff7-8f77-a1ade8e7a82f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:09.925401 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b9c73-221f-4ff7-8f77-a1ade8e7a82f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:09.943160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b9c73-221f-4ff7-8f77-a1ade8e7a82f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:29:09.951695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-f84b9c73-221f-4ff7-8f77-a1ade8e7a82f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:29:09.951695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:09.951695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:09.951695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:09.951695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:09.951695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:09.951695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:09.951695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:09.951695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:09.951695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:09.951695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:09.951695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:09.951695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:29:09.951695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:29:09.951695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:29:09.951695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:29:09.953853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:29:09.953853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:29:09.953853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:29:09.953853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:29:09.953853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:09.953853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:09.953853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:09.953853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:09.953853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:09.953853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:09.953853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:09.953853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:09.953853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:09.953853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:09.953853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:09.953853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:09.956335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:09.956335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:09.956335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:09.956335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:09.956335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:29:09.956335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:29:09.956335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:29:09.956335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:29:09.956335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:29:09.956335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:29:09.956335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:29:09.956335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:09.960308 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 389/787] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:29:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:09.962642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b9c73-221f-4ff7-8f77-a1ade8e7a82f None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:10.020211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54bd28-9013-41ff-99b9-64e9b4df672e None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:10.064807 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:10.077993 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d77634-6618-4778-9737-dfac392a7fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:10.082530 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d77634-6618-4778-9737-dfac392a7fac None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:10.082530 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d77634-6618-4778-9737-dfac392a7fac None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:10.082530 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d77634-6618-4778-9737-dfac392a7fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:10.092235 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d77634-6618-4778-9737-dfac392a7fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:10.093687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d77634-6618-4778-9737-dfac392a7fac None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:10.110505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-a5d77634-6618-4778-9737-dfac392a7fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:10.110505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:10.110505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:10.110505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:10.110505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:10.110505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:10.110505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:10.110505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:10.110505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:10.110505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:10.110505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:10.110505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:10.110505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:10.110505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:10.110505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:10.110505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:10.112263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:10.112263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:10.112263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:10.112263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:10.112263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:10.112263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:10.112263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:10.112263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:10.112263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:10.112263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:10.112263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:10.112263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:10.112263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:10.112263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:10.112263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:10.112263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:10.112263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:10.113998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:10.113998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:10.113998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:10.113998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 399/788] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:10.113998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d77634-6618-4778-9737-dfac392a7fac None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:10.178802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b9c73-221f-4ff7-8f77-a1ade8e7a82f None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:10.229807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89475f8a-507e-4c42-ba2f-441bce8dc7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:10.230797 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89475f8a-507e-4c42-ba2f-441bce8dc7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:10.231229 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89475f8a-507e-4c42-ba2f-441bce8dc7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:10.231772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89475f8a-507e-4c42-ba2f-441bce8dc7e7 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:10.233016 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89475f8a-507e-4c42-ba2f-441bce8dc7e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:10.233576 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89475f8a-507e-4c42-ba2f-441bce8dc7e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:10.236377 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89475f8a-507e-4c42-ba2f-441bce8dc7e7 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:10.250139 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d77634-6618-4778-9737-dfac392a7fac None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:10.282122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 390/789] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Sep 7 16:29:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:10.282122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89475f8a-507e-4c42-ba2f-441bce8dc7e7 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:10.302658 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041df14a-1276-4893-a9c9-e68f32b74123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:10.303320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041df14a-1276-4893-a9c9-e68f32b74123 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:10.304567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041df14a-1276-4893-a9c9-e68f32b74123 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:10.304865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041df14a-1276-4893-a9c9-e68f32b74123 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:10.305446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041df14a-1276-4893-a9c9-e68f32b74123 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:10.306932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041df14a-1276-4893-a9c9-e68f32b74123 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:10.318084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-041df14a-1276-4893-a9c9-e68f32b74123 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 16:29:10.318084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:10.318084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:10.318084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:10.318084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:10.318084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:10.318084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:10.318084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:10.318084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 16:29:10.318084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:10.318084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:10.318084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:10.318084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:10.318084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:10.318084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:10.318084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:10.318084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:10.320462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:10.320462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:10.320462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:10.320462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:10.320462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:10.320462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:10.320462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:10.320462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:10.320462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:10.320462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:10.320462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:10.320462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:10.320462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:10.320462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:10.320462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:10.320462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:10.322800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:10.322800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:10.322800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:10.322800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:10.322800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:10.322800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:10.322800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:10.322800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:10.322800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:10.322800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:10.322800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:10.322800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:10.322800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 16:29:10.322800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:10.324360 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 400/790] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Sep 7 16:29:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:10.325517 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041df14a-1276-4893-a9c9-e68f32b74123 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:10.326356 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:10.407652 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:10.461848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89475f8a-507e-4c42-ba2f-441bce8dc7e7 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:10.504856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041df14a-1276-4893-a9c9-e68f32b74123 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:10.533869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af918dee-727c-4c69-add9-809d20193633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:10.535862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af918dee-727c-4c69-add9-809d20193633 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:10.536575 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af918dee-727c-4c69-add9-809d20193633 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:10.537525 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af918dee-727c-4c69-add9-809d20193633 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:10.540765 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af918dee-727c-4c69-add9-809d20193633 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:10.541815 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af918dee-727c-4c69-add9-809d20193633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:10.545956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af918dee-727c-4c69-add9-809d20193633 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:10.551943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cd7f1-2616-414c-9148-b41c3f07483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:10.552789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cd7f1-2616-414c-9148-b41c3f07483a None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:10.553135 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cd7f1-2616-414c-9148-b41c3f07483a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:10.553514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cd7f1-2616-414c-9148-b41c3f07483a None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:10.554277 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cd7f1-2616-414c-9148-b41c3f07483a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:10.554642 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cd7f1-2616-414c-9148-b41c3f07483a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:10.556206 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cd7f1-2616-414c-9148-b41c3f07483a None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:10.566491 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 391/791] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:29:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:10.568451 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af918dee-727c-4c69-add9-809d20193633 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:10.583743 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 401/792] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:10.586239 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cd7f1-2616-414c-9148-b41c3f07483a None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:10.735524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cd7f1-2616-414c-9148-b41c3f07483a None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:10.735980 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:10.739669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:10.768791 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af918dee-727c-4c69-add9-809d20193633 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:10.793399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb50cf-9cae-4fa2-8349-8b3382eafdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:10.794366 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb50cf-9cae-4fa2-8349-8b3382eafdbf None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:10.795005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb50cf-9cae-4fa2-8349-8b3382eafdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:10.795669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb50cf-9cae-4fa2-8349-8b3382eafdbf None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:10.796886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb50cf-9cae-4fa2-8349-8b3382eafdbf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:10.797698 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb50cf-9cae-4fa2-8349-8b3382eafdbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:10.800496 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb50cf-9cae-4fa2-8349-8b3382eafdbf None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:10.809031 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 402/793] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Sep 7 16:29:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:10.810761 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb50cf-9cae-4fa2-8349-8b3382eafdbf None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:10.842057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b4111-1296-483d-8394-cc80cb57f85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:10.843154 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b4111-1296-483d-8394-cc80cb57f85a None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:10.843749 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b4111-1296-483d-8394-cc80cb57f85a None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:10.844284 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b4111-1296-483d-8394-cc80cb57f85a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:10.863240 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b4111-1296-483d-8394-cc80cb57f85a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:10.866034 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b4111-1296-483d-8394-cc80cb57f85a None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:10.892214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-8e4b4111-1296-483d-8394-cc80cb57f85a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:10.892214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:10.892214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:10.892214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:10.892214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:10.892214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:10.892214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:10.892214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:10.892214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:10.892214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:10.892214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:10.892214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:10.892214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:10.892214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:10.892214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:10.892214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:10.894245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:10.894245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:10.894245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:10.894245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:10.894245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:10.894245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:10.894245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:10.894245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:10.894245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:10.894245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:10.894245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:10.894245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:10.894245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:10.894245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:10.894245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:10.894245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:10.894245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:10.896172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:10.896172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:10.896172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:10.896172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 392/794] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:10.896172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b4111-1296-483d-8394-cc80cb57f85a None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:10.991770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb50cf-9cae-4fa2-8349-8b3382eafdbf None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:11.045874 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b47b1c-47dc-41a4-bb3a-3217fb487e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:11.046979 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b47b1c-47dc-41a4-bb3a-3217fb487e33 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:11.047507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b47b1c-47dc-41a4-bb3a-3217fb487e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:11.047997 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b47b1c-47dc-41a4-bb3a-3217fb487e33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:11.061111 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b4111-1296-483d-8394-cc80cb57f85a None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:11.070435 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b47b1c-47dc-41a4-bb3a-3217fb487e33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:11.073415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b47b1c-47dc-41a4-bb3a-3217fb487e33 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:11.100058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-05b47b1c-47dc-41a4-bb3a-3217fb487e33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:11.100058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:11.100058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:11.100058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:11.100058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:11.100058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:11.100058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:11.100058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:11.100058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:11.100058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:11.100058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:11.100058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:11.100058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:11.100058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:11.100058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:11.100058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:11.103767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:11.103767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:11.103767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:11.103767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:11.103767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:11.103767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:11.103767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:11.103767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:11.103767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:11.103767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:11.103767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:11.103767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:11.103767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:11.103767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:11.103767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:11.103767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:11.103767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:11.105597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:11.105597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:11.105597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:11.105597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 403/795] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:11.105597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b47b1c-47dc-41a4-bb3a-3217fb487e33 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:11.121690 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726516ee-cb2c-47d0-abff-52cf49990350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:11.122858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726516ee-cb2c-47d0-abff-52cf49990350 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:11.123431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726516ee-cb2c-47d0-abff-52cf49990350 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:11.124705 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726516ee-cb2c-47d0-abff-52cf49990350 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:11.128951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:11.140585 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726516ee-cb2c-47d0-abff-52cf49990350 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:11.151220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726516ee-cb2c-47d0-abff-52cf49990350 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:11.151436 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:11.164921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-726516ee-cb2c-47d0-abff-52cf49990350 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:11.164921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:11.164921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:11.164921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:11.164921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:11.164921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:11.164921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:11.164921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:11.164921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:11.164921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:11.164921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:11.164921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:11.164921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:29:11.164921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:29:11.164921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:29:11.166861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:29:11.166861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:11.166861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:11.166861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:11.166861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:11.166861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:11.166861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:11.166861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:11.166861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:11.166861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:11.166861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:11.166861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:11.166861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:11.166861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:11.166861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:11.166861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:11.166861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:11.169600 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:29:11.169600 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:29:11.169600 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:29:11.169600 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:29:11.169600 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:29:11.169600 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:29:11.169600 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:11.169600 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:11.175277 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 393/796] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:11.175582 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726516ee-cb2c-47d0-abff-52cf49990350 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:11.282215 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b47b1c-47dc-41a4-bb3a-3217fb487e33 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:11.341546 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740428fe-7b63-46ef-aac4-8310646a0fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:11.342481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740428fe-7b63-46ef-aac4-8310646a0fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:11.342903 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740428fe-7b63-46ef-aac4-8310646a0fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:11.343366 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740428fe-7b63-46ef-aac4-8310646a0fa9 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:11.344509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740428fe-7b63-46ef-aac4-8310646a0fa9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:11.345030 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740428fe-7b63-46ef-aac4-8310646a0fa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:11.347765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740428fe-7b63-46ef-aac4-8310646a0fa9 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:11.355363 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726516ee-cb2c-47d0-abff-52cf49990350 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:11.355910 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 404/797] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Sep 7 16:29:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:11.356834 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740428fe-7b63-46ef-aac4-8310646a0fa9 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:11.428247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7a1a9-8581-4397-87bb-00ee0a272418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:11.430900 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7a1a9-8581-4397-87bb-00ee0a272418 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:11.431449 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7a1a9-8581-4397-87bb-00ee0a272418 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:11.431895 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7a1a9-8581-4397-87bb-00ee0a272418 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:11.433151 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7a1a9-8581-4397-87bb-00ee0a272418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:11.433721 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7a1a9-8581-4397-87bb-00ee0a272418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:11.436391 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7a1a9-8581-4397-87bb-00ee0a272418 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:11.463921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 394/798] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:11.465377 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7a1a9-8581-4397-87bb-00ee0a272418 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:11.530242 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:11.548459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:11.552271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740428fe-7b63-46ef-aac4-8310646a0fa9 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:11.601614 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34f6f3-db34-4387-833b-7516eefb973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:11.602252 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34f6f3-db34-4387-833b-7516eefb973c None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:11.602518 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34f6f3-db34-4387-833b-7516eefb973c None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:11.602791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34f6f3-db34-4387-833b-7516eefb973c None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:11.603463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34f6f3-db34-4387-833b-7516eefb973c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:11.604481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34f6f3-db34-4387-833b-7516eefb973c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:11.605259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34f6f3-db34-4387-833b-7516eefb973c None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:11.620105 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 405/799] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:11.621152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34f6f3-db34-4387-833b-7516eefb973c None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:11.664709 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7a1a9-8581-4397-87bb-00ee0a272418 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:11.740387 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a822e8-8978-40e8-a396-14010697c530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:11.742204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a822e8-8978-40e8-a396-14010697c530 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:11.742775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a822e8-8978-40e8-a396-14010697c530 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:11.743335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a822e8-8978-40e8-a396-14010697c530 None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:11.744777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a822e8-8978-40e8-a396-14010697c530 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:11.745475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a822e8-8978-40e8-a396-14010697c530 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:11.748370 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a822e8-8978-40e8-a396-14010697c530 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:11.771844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 395/800] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:29:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:11.773261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a822e8-8978-40e8-a396-14010697c530 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:11.914054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34f6f3-db34-4387-833b-7516eefb973c None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:11.920864 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a822e8-8978-40e8-a396-14010697c530 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:11.938005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:11.963451 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd2f8c-40ce-4583-931d-cfbd2f139f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:11.964218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd2f8c-40ce-4583-931d-cfbd2f139f60 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:11.964563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd2f8c-40ce-4583-931d-cfbd2f139f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:11.964903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd2f8c-40ce-4583-931d-cfbd2f139f60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:11.973747 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd2f8c-40ce-4583-931d-cfbd2f139f60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:11.975465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd2f8c-40ce-4583-931d-cfbd2f139f60 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:11.989468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-2ecd2f8c-40ce-4583-931d-cfbd2f139f60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:11.989468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:11.989468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:11.989468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:11.989468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:11.989468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:11.989468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:11.989468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:11.989468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:11.989468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:11.989468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:11.989468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:11.989468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:29:11.989468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:29:11.989468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:29:11.991645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:29:11.991645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:11.991645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:11.991645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:11.991645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:11.991645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:11.991645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:11.991645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:11.991645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:11.991645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:11.991645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:11.991645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:11.991645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:11.991645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:11.991645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:11.991645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:11.991645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:11.993669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:29:11.993669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:29:11.993669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:29:11.993669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:29:11.993669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:29:11.993669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:29:11.993669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:11.993669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:11.993669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 396/801] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:11.993669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd2f8c-40ce-4583-931d-cfbd2f139f60 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:11.997458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315b1cb-9905-4229-9f50-b3e3ba04aa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:11.998082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315b1cb-9905-4229-9f50-b3e3ba04aa56 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:11.998356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315b1cb-9905-4229-9f50-b3e3ba04aa56 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:11.998621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315b1cb-9905-4229-9f50-b3e3ba04aa56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:11.999303 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315b1cb-9905-4229-9f50-b3e3ba04aa56 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:12.001055 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315b1cb-9905-4229-9f50-b3e3ba04aa56 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:12.122889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:12.139869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 406/802] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:29:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:29:12.141153 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315b1cb-9905-4229-9f50-b3e3ba04aa56 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:12.165994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd2f8c-40ce-4583-931d-cfbd2f139f60 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:12.244351 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963be5d-1e50-4fa2-9f05-363656d518d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:12.245830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963be5d-1e50-4fa2-9f05-363656d518d0 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:12.246528 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963be5d-1e50-4fa2-9f05-363656d518d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:12.247229 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963be5d-1e50-4fa2-9f05-363656d518d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:12.261728 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963be5d-1e50-4fa2-9f05-363656d518d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:12.264784 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963be5d-1e50-4fa2-9f05-363656d518d0 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:12.286481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-5963be5d-1e50-4fa2-9f05-363656d518d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 16:29:12.286481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:12.286481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:12.286481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:12.286481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:12.286481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:12.286481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:12.286481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:12.286481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:12.286481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:12.286481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:12.286481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:12.286481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:29:12.286481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:29:12.286481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:29:12.286481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:12.288767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:12.290428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:12.290428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:12.290428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:29:12.290428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:29:12.290428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:29:12.290428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:29:12.290428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:29:12.290428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:29:12.290428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 16:29:12.290428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:12.300138 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 397/803] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:29:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:12.302160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963be5d-1e50-4fa2-9f05-363656d518d0 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:12.361755 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:12.372771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315b1cb-9905-4229-9f50-b3e3ba04aa56 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:12.438502 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62710789-2bfb-467d-be8d-ee728577d4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:12.439658 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62710789-2bfb-467d-be8d-ee728577d4b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:12.440719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62710789-2bfb-467d-be8d-ee728577d4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:12.441292 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62710789-2bfb-467d-be8d-ee728577d4b7 None admin] PATH_INFO: `/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/87ba67fc171b4258b6fda72094ed11c3/roles/9b7a362fef7446e795c33b25a08f20bc` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:12.477982 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62710789-2bfb-467d-be8d-ee728577d4b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1180c1ddef2b493f83c41425fd2e7917, user_id=87ba67fc171b4258b6fda72094ed11c3, role_id=9b7a362fef7446e795c33b25a08f20bc)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:12.482343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62710789-2bfb-467d-be8d-ee728577d4b7 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:12.492592 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963be5d-1e50-4fa2-9f05-363656d518d0 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:12.563846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef93d4-4c98-43e2-9d6f-ef5ff2885cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:12.565341 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 407/804] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:29:12 2022] PUT /identity/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/87ba67fc171b4258b6fda72094ed11c3/roles/9b7a362fef7446e795c33b25a08f20bc => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:29:12.565777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef93d4-4c98-43e2-9d6f-ef5ff2885cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:12.566502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef93d4-4c98-43e2-9d6f-ef5ff2885cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:12.567543 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef93d4-4c98-43e2-9d6f-ef5ff2885cd6 None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:12.569426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef93d4-4c98-43e2-9d6f-ef5ff2885cd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:12.570360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef93d4-4c98-43e2-9d6f-ef5ff2885cd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:12.571996 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62710789-2bfb-467d-be8d-ee728577d4b7 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:12.574924 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef93d4-4c98-43e2-9d6f-ef5ff2885cd6 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:12.604640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 398/805] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:29:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:12.613641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef93d4-4c98-43e2-9d6f-ef5ff2885cd6 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:12.701532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:12.765991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62710789-2bfb-467d-be8d-ee728577d4b7 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:12.768096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:12.795048 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef93d4-4c98-43e2-9d6f-ef5ff2885cd6 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:12.820898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72257b-8d76-43e9-a43f-0409700e1557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:12.821547 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72257b-8d76-43e9-a43f-0409700e1557 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:12.821853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72257b-8d76-43e9-a43f-0409700e1557 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:12.822112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72257b-8d76-43e9-a43f-0409700e1557 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:12.822855 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72257b-8d76-43e9-a43f-0409700e1557 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:12.823163 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72257b-8d76-43e9-a43f-0409700e1557 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:12.824740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72257b-8d76-43e9-a43f-0409700e1557 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:12.847689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 408/806] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Sep 7 16:29:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:12.849918 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a905005-e841-4754-92b4-51a57f468389 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:12.850823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a905005-e841-4754-92b4-51a57f468389 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:12.851185 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a905005-e841-4754-92b4-51a57f468389 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:12.854935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 409/807] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:12.856693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a905005-e841-4754-92b4-51a57f468389 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:12.884098 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56882734-e292-449d-8708-1aea8ca1529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:12.885951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56882734-e292-449d-8708-1aea8ca1529b None admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:12.886735 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56882734-e292-449d-8708-1aea8ca1529b None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:12.887534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56882734-e292-449d-8708-1aea8ca1529b None admin] PATH_INFO: `/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/cf48978c20f04173b114e15e1ce2157c/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:12.891844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56882734-e292-449d-8708-1aea8ca1529b None admin] RBAC: Authorizing `identity:create_grant(project_id=1180c1ddef2b493f83c41425fd2e7917, user_id=cf48978c20f04173b114e15e1ce2157c, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:12.895033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56882734-e292-449d-8708-1aea8ca1529b None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:12.987129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a905005-e841-4754-92b4-51a57f468389 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:12.993115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 399/808] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:29:12 2022] PUT /identity/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/cf48978c20f04173b114e15e1ce2157c/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:29:12.995983 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55ed25-0b77-4e76-89b9-b70d62f07693 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:12.996927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55ed25-0b77-4e76-89b9-b70d62f07693 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:12.998764 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55ed25-0b77-4e76-89b9-b70d62f07693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:13.002152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:13.039901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c082ae-f224-4307-b1c2-1e2bf886b997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:13.040650 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c082ae-f224-4307-b1c2-1e2bf886b997 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:13.040982 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c082ae-f224-4307-b1c2-1e2bf886b997 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:13.041265 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c082ae-f224-4307-b1c2-1e2bf886b997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:13.047945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-9f55ed25-0b77-4e76-89b9-b70d62f07693 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:13.051679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9f55ed25-0b77-4e76-89b9-b70d62f07693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:13.055824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c082ae-f224-4307-b1c2-1e2bf886b997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:13.058118 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c082ae-f224-4307-b1c2-1e2bf886b997 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:13.125075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-71c082ae-f224-4307-b1c2-1e2bf886b997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:13.125075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:13.125075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:13.125075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:13.125075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:13.125075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:13.125075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:13.125075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:13.125075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:13.125075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:13.125075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:13.125075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:13.125075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:13.125075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:13.125075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:13.125075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:13.127741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:13.127741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:13.127741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:13.127741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:13.127741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:13.127741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:13.127741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:13.127741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:13.127741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:13.127741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:13.127741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:13.127741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:13.127741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:13.127741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:13.127741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:13.127741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:13.127741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:13.129554 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:13.129554 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:13.129554 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:13.134238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 410/809] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:13.143776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c082ae-f224-4307-b1c2-1e2bf886b997 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:13.259021 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 400/810] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:13.337108 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c082ae-f224-4307-b1c2-1e2bf886b997 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:13.385528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb9282-25b2-4313-8e3d-9776575163f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:13.386166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb9282-25b2-4313-8e3d-9776575163f6 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:13.386441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb9282-25b2-4313-8e3d-9776575163f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:13.386735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb9282-25b2-4313-8e3d-9776575163f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:13.387371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb9282-25b2-4313-8e3d-9776575163f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:13.387704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb9282-25b2-4313-8e3d-9776575163f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:13.389112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb9282-25b2-4313-8e3d-9776575163f6 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:13.405317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 411/811] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:13.413324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55ed25-0b77-4e76-89b9-b70d62f07693 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:13.560829 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:13.603716 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55ed25-0b77-4e76-89b9-b70d62f07693 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:13.645810 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb9282-25b2-4313-8e3d-9776575163f6 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:13.694231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:13.720617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b012f-d14f-49bf-8c85-76654823c0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:13.721620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b012f-d14f-49bf-8c85-76654823c0cd None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:13.722105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b012f-d14f-49bf-8c85-76654823c0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:13.722804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b012f-d14f-49bf-8c85-76654823c0cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:13.752853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b012f-d14f-49bf-8c85-76654823c0cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:13.762046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b012f-d14f-49bf-8c85-76654823c0cd None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:13.801591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-935b012f-d14f-49bf-8c85-76654823c0cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:13.801591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:13.801591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:13.801591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:13.801591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:13.801591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:13.801591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:13.801591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:13.801591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:13.801591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:13.801591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:13.801591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:13.801591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:29:13.801591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:29:13.801591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:29:13.802558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:29:13.802558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:13.802558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:13.802558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:13.802558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:13.802558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:13.802558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:13.802558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:13.802558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:13.802558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:13.802558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:13.802558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:13.802558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:13.802558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:13.802558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:13.802558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:13.802558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:13.804200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:29:13.804200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:29:13.804200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:29:13.804200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:29:13.804200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:29:13.804200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:29:13.804200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:13.804200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:13.806266 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 401/812] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:13.836802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b012f-d14f-49bf-8c85-76654823c0cd None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:13.937319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb9282-25b2-4313-8e3d-9776575163f6 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:14.012198 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa14e19-148e-4a1a-8843-9037a99f6ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:14.013727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa14e19-148e-4a1a-8843-9037a99f6ffa None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:14.014197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa14e19-148e-4a1a-8843-9037a99f6ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:14.014667 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa14e19-148e-4a1a-8843-9037a99f6ffa None admin] PATH_INFO: `/v3/services/network` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:14.015726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa14e19-148e-4a1a-8843-9037a99f6ffa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:14.019075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa14e19-148e-4a1a-8843-9037a99f6ffa None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:14.039661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-cfa14e19-148e-4a1a-8843-9037a99f6ffa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 16:29:14.039661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:14.039661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:14.039661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:14.039661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:14.039661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:14.039661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:14.039661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:14.039661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 16:29:14.039661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:14.039661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:14.039661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:14.039661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:14.039661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:14.039661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:14.039661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:14.039661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:14.040794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:14.040794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:14.040794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:14.040794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:14.040794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:14.040794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:14.040794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:14.040794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:14.040794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:14.040794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:14.040794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:14.040794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:14.040794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:14.040794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:14.040794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:14.040794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:14.041663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:14.041663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:14.041663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:14.041663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:14.041663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:14.041663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:14.041663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:14.041663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:14.041663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:14.041663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:14.041663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:14.041663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:14.041663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 16:29:14.041663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:14.043020 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 412/813] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:13 2022] GET /identity/v3/services/network => generated 88 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:14.049618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa14e19-148e-4a1a-8843-9037a99f6ffa None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:14.145712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b012f-d14f-49bf-8c85-76654823c0cd None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:14.224448 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f51e4f-0e2f-46f8-a488-6c08dd840a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:14.226001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f51e4f-0e2f-46f8-a488-6c08dd840a35 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:14.226465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f51e4f-0e2f-46f8-a488-6c08dd840a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:14.227177 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f51e4f-0e2f-46f8-a488-6c08dd840a35 None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:14.228371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f51e4f-0e2f-46f8-a488-6c08dd840a35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:14.228910 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f51e4f-0e2f-46f8-a488-6c08dd840a35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:14.231575 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f51e4f-0e2f-46f8-a488-6c08dd840a35 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:14.255935 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:14.260993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 402/814] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:29:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:14.270704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f51e4f-0e2f-46f8-a488-6c08dd840a35 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:14.341555 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:14.381029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa14e19-148e-4a1a-8843-9037a99f6ffa None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:14.423883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43887a5a-7682-4e6a-baa4-f5be306149e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:14.424424 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43887a5a-7682-4e6a-baa4-f5be306149e2 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:14.424702 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43887a5a-7682-4e6a-baa4-f5be306149e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:14.424975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43887a5a-7682-4e6a-baa4-f5be306149e2 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:14.425637 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43887a5a-7682-4e6a-baa4-f5be306149e2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:14.425941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43887a5a-7682-4e6a-baa4-f5be306149e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:14.427384 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43887a5a-7682-4e6a-baa4-f5be306149e2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:14.442560 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 413/815] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Sep 7 16:29:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:14.450416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43887a5a-7682-4e6a-baa4-f5be306149e2 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:14.491608 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f51e4f-0e2f-46f8-a488-6c08dd840a35 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:14.537136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78474640-1ebc-40e5-8b7d-2ce25f5d20a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:14.537922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78474640-1ebc-40e5-8b7d-2ce25f5d20a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:14.538185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78474640-1ebc-40e5-8b7d-2ce25f5d20a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:14.538447 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78474640-1ebc-40e5-8b7d-2ce25f5d20a0 None admin] PATH_INFO: `/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/56cd868e866d436aa1d601f7791e812c/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:14.544002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78474640-1ebc-40e5-8b7d-2ce25f5d20a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1180c1ddef2b493f83c41425fd2e7917, user_id=56cd868e866d436aa1d601f7791e812c, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:14.548638 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78474640-1ebc-40e5-8b7d-2ce25f5d20a0 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:14.626536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43887a5a-7682-4e6a-baa4-f5be306149e2 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:14.644116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 403/816] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:29:14 2022] PUT /identity/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/56cd868e866d436aa1d601f7791e812c/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:29:14.673879 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394181e3-e3f0-4ccb-b082-58826ad084c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:14.674545 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394181e3-e3f0-4ccb-b082-58826ad084c1 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:14.674765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394181e3-e3f0-4ccb-b082-58826ad084c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:14.675035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394181e3-e3f0-4ccb-b082-58826ad084c1 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:14.675704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394181e3-e3f0-4ccb-b082-58826ad084c1 None admin] RBAC: Adding query filter params (type=network) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:14.676066 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394181e3-e3f0-4ccb-b082-58826ad084c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:14.677452 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394181e3-e3f0-4ccb-b082-58826ad084c1 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:14.683988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 414/817] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Sep 7 16:29:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:14.690944 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78474640-1ebc-40e5-8b7d-2ce25f5d20a0 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:14.850614 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:14.939190 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78474640-1ebc-40e5-8b7d-2ce25f5d20a0 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:14.993580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcee6a1-0109-4cf2-99a5-05feb0fb4def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:14.994573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcee6a1-0109-4cf2-99a5-05feb0fb4def None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:14.995035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcee6a1-0109-4cf2-99a5-05feb0fb4def None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:14.995508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcee6a1-0109-4cf2-99a5-05feb0fb4def None admin] PATH_INFO: `/v3/endpoints` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:14.996415 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcee6a1-0109-4cf2-99a5-05feb0fb4def None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:14.998040 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcee6a1-0109-4cf2-99a5-05feb0fb4def None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:15.095607 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 404/818] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:29:14 2022] POST /identity/v3/endpoints => generated 337 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:29:15.596534 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af37c7c-2ba6-4800-a94f-c3096a3cf3a3 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:15.597391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af37c7c-2ba6-4800-a94f-c3096a3cf3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:15.597391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af37c7c-2ba6-4800-a94f-c3096a3cf3a3 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:15.599149 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 415/819] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:15.602642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8335e-3f11-4f2f-acd1-022bddfda1cd None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:15.602943 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8335e-3f11-4f2f-acd1-022bddfda1cd None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:15.603253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8335e-3f11-4f2f-acd1-022bddfda1cd None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:15.604847 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 405/820] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:15.610683 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d952-b2f8-4db9-90c7-5b921395f3ea None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:15.610949 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d952-b2f8-4db9-90c7-5b921395f3ea None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:15.611205 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d952-b2f8-4db9-90c7-5b921395f3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:15.617350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c0baf-caef-45b1-b7b9-d2d6e423b768 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:15.617626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c0baf-caef-45b1-b7b9-d2d6e423b768 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:15.617898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c0baf-caef-45b1-b7b9-d2d6e423b768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:15.639098 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-65a4d952-b2f8-4db9-90c7-5b921395f3ea None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:15.640071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-65a4d952-b2f8-4db9-90c7-5b921395f3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:15.650137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-a71c0baf-caef-45b1-b7b9-d2d6e423b768 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:15.651346 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a71c0baf-caef-45b1-b7b9-d2d6e423b768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:15.696664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:15.767885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 406/821] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:15.779681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 416/822] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:16.044484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c0baf-caef-45b1-b7b9-d2d6e423b768 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:16.111370 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baabf5-c4f3-4771-b405-b791dfa746fb None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:16.111864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baabf5-c4f3-4771-b405-b791dfa746fb None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:16.112241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baabf5-c4f3-4771-b405-b791dfa746fb None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:16.116012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 417/823] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:16.121051 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01121112-0482-45dc-bbd2-26a4858a3d36 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:16.121455 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01121112-0482-45dc-bbd2-26a4858a3d36 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:16.121838 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01121112-0482-45dc-bbd2-26a4858a3d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:16.128981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:16.143937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-01121112-0482-45dc-bbd2-26a4858a3d36 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:16.153877 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-01121112-0482-45dc-bbd2-26a4858a3d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:16.201073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c0baf-caef-45b1-b7b9-d2d6e423b768 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:16.239511 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 418/824] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 16:29:16.239511 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01121112-0482-45dc-bbd2-26a4858a3d36 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:16.247005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4f000-90cf-4f93-975a-7ebd086b9792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:16.247005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4f000-90cf-4f93-975a-7ebd086b9792 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:16.251550 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4f000-90cf-4f93-975a-7ebd086b9792 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:16.251550 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4f000-90cf-4f93-975a-7ebd086b9792 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:16.251550 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4f000-90cf-4f93-975a-7ebd086b9792 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:16.251550 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4f000-90cf-4f93-975a-7ebd086b9792 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:16.259428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-6ec4f000-90cf-4f93-975a-7ebd086b9792 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 16:29:16.259428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:16.259428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:16.259428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:16.259428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:16.259428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:16.259428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:16.259428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:16.259428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 16:29:16.259428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:16.259428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:16.259428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:16.259428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:16.259428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:16.259428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:16.259428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:16.259428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:16.262187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:16.262187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:16.262187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:16.262187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:16.262187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:16.262187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:16.262187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:16.262187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:16.262187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:16.262187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:16.262187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:16.262187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:16.262187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:16.262187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:16.262187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:16.262187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:16.265324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:16.265324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:16.265324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:16.265324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:16.265324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:16.265324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:16.265324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:16.265324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:16.265324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:16.265324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:16.265324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:16.265324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:16.265324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 16:29:16.265324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:16.265324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 407/825] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:29:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:16.268398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4f000-90cf-4f93-975a-7ebd086b9792 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:16.349220 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:16.409053 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01121112-0482-45dc-bbd2-26a4858a3d36 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:16.434120 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4f000-90cf-4f93-975a-7ebd086b9792 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:16.442282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:16.470729 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1688c79-a54a-4d63-922c-8d077e1f29db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:16.471339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1688c79-a54a-4d63-922c-8d077e1f29db None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:16.471659 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1688c79-a54a-4d63-922c-8d077e1f29db None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:16.471917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1688c79-a54a-4d63-922c-8d077e1f29db None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:16.472775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1688c79-a54a-4d63-922c-8d077e1f29db None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:16.473069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1688c79-a54a-4d63-922c-8d077e1f29db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:16.474448 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1688c79-a54a-4d63-922c-8d077e1f29db None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:16.484600 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 408/826] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:29:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:16.485568 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1688c79-a54a-4d63-922c-8d077e1f29db None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:16.487766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39d227-365a-445f-a0c9-af240f855ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:16.489601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39d227-365a-445f-a0c9-af240f855ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:16.490453 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39d227-365a-445f-a0c9-af240f855ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:16.491801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39d227-365a-445f-a0c9-af240f855ce7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:16.514371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39d227-365a-445f-a0c9-af240f855ce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:29:16.527061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-af39d227-365a-445f-a0c9-af240f855ce7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:29:16.527061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:16.527061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:16.527061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:16.527061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:16.527061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:16.527061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:16.527061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:16.527061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:16.527061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:16.527061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:16.527061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:16.527061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:29:16.527061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:29:16.527061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:29:16.527061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:29:16.528161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:29:16.528161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:29:16.528161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:29:16.528161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:29:16.528161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:16.528161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:16.528161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:16.528161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:16.528161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:16.528161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:16.528161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:16.528161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:16.528161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:16.528161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:16.528161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:16.528161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:16.529023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:16.529023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:16.529023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:16.529023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:16.529023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:29:16.529023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:29:16.529023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:29:16.529023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:29:16.529023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:29:16.529023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:29:16.529023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:29:16.529023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:16.529688 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 419/827] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:29:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:16.531885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39d227-365a-445f-a0c9-af240f855ce7 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:16.605890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1688c79-a54a-4d63-922c-8d077e1f29db None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:16.666668 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cbfde-b346-4aa6-9b25-06c68e6d5477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:16.667698 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cbfde-b346-4aa6-9b25-06c68e6d5477 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:16.668171 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cbfde-b346-4aa6-9b25-06c68e6d5477 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:16.668663 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cbfde-b346-4aa6-9b25-06c68e6d5477 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:16.669828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cbfde-b346-4aa6-9b25-06c68e6d5477 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:16.670425 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cbfde-b346-4aa6-9b25-06c68e6d5477 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:16.672978 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cbfde-b346-4aa6-9b25-06c68e6d5477 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:16.677269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39d227-365a-445f-a0c9-af240f855ce7 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:16.690578 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 409/828] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:29:16 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:16.690578 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cbfde-b346-4aa6-9b25-06c68e6d5477 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:16.748013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:16.759927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83282a25-c089-44d3-bec5-b4395e6916c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:16.761449 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:16.762954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83282a25-c089-44d3-bec5-b4395e6916c9 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:16.763454 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83282a25-c089-44d3-bec5-b4395e6916c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:16.765491 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83282a25-c089-44d3-bec5-b4395e6916c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:16.790454 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83282a25-c089-44d3-bec5-b4395e6916c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:29:16.805824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-83282a25-c089-44d3-bec5-b4395e6916c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:29:16.805824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:16.805824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:16.805824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:16.805824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:16.805824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:16.805824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:16.805824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:16.805824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:16.805824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:16.805824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:16.805824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:16.805824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:29:16.805824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:29:16.805824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:29:16.805824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:29:16.806846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:29:16.806846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:29:16.806846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:29:16.806846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:29:16.806846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:16.806846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:16.806846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:16.806846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:16.806846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:16.806846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:16.806846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:16.806846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:16.806846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:16.806846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:16.806846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:16.806846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:16.807720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:16.807720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:16.807720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:16.807720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:16.807720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:29:16.807720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:29:16.807720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:29:16.807720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:29:16.807720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:29:16.807720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:29:16.807720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:29:16.807720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:16.816046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 420/829] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:29:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:16.818898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83282a25-c089-44d3-bec5-b4395e6916c9 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:16.904069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cbfde-b346-4aa6-9b25-06c68e6d5477 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:16.992724 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477bdb1-2dcd-40e1-93bc-91e74498f3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:16.993859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477bdb1-2dcd-40e1-93bc-91e74498f3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:16.994597 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477bdb1-2dcd-40e1-93bc-91e74498f3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:16.995261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477bdb1-2dcd-40e1-93bc-91e74498f3c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:16.996728 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477bdb1-2dcd-40e1-93bc-91e74498f3c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:16.997682 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477bdb1-2dcd-40e1-93bc-91e74498f3c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:17.001579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477bdb1-2dcd-40e1-93bc-91e74498f3c4 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:17.009891 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83282a25-c089-44d3-bec5-b4395e6916c9 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:17.020665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 410/830] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:29:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:17.035457 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477bdb1-2dcd-40e1-93bc-91e74498f3c4 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:17.089101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac2557-2de6-4ae1-8fe8-05664e510189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:17.090264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac2557-2de6-4ae1-8fe8-05664e510189 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:17.091191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac2557-2de6-4ae1-8fe8-05664e510189 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:17.091800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac2557-2de6-4ae1-8fe8-05664e510189 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:17.093175 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac2557-2de6-4ae1-8fe8-05664e510189 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:17.093762 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac2557-2de6-4ae1-8fe8-05664e510189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:17.096507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac2557-2de6-4ae1-8fe8-05664e510189 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:17.114542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 421/831] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:29:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:17.124918 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac2557-2de6-4ae1-8fe8-05664e510189 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:17.221652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:17.233189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477bdb1-2dcd-40e1-93bc-91e74498f3c4 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:17.243291 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:17.300998 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3445335-6a94-4c28-97b8-4892267d525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:17.302276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3445335-6a94-4c28-97b8-4892267d525b None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:17.302869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3445335-6a94-4c28-97b8-4892267d525b None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:17.303616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3445335-6a94-4c28-97b8-4892267d525b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:17.322187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3445335-6a94-4c28-97b8-4892267d525b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:17.323995 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3445335-6a94-4c28-97b8-4892267d525b None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:17.337474 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac2557-2de6-4ae1-8fe8-05664e510189 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:17.351996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-e3445335-6a94-4c28-97b8-4892267d525b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:17.351996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:17.351996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:17.351996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:17.351996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:17.351996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:17.351996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:17.351996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:17.351996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:17.351996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:17.351996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:17.351996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:17.351996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:17.351996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:17.351996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:17.351996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:17.353914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:17.353914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:17.353914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:17.353914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:17.353914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:17.353914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:17.353914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:17.353914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:17.353914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:17.353914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:17.353914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:17.353914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:17.353914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:17.353914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:17.353914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:17.353914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:17.353914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:17.355644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:17.355644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:17.355644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:17.359295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 411/832] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:17.366113 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3445335-6a94-4c28-97b8-4892267d525b None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:17.409181 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9db7b9-28a5-4113-8707-1e3d64dfae39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:17.410870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9db7b9-28a5-4113-8707-1e3d64dfae39 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:17.411658 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9db7b9-28a5-4113-8707-1e3d64dfae39 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:17.413420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9db7b9-28a5-4113-8707-1e3d64dfae39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:17.434522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9db7b9-28a5-4113-8707-1e3d64dfae39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:17.437520 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9db7b9-28a5-4113-8707-1e3d64dfae39 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:17.464304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-9c9db7b9-28a5-4113-8707-1e3d64dfae39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:17.464304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:17.464304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:17.464304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:17.464304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:17.464304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:17.464304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:17.464304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:17.464304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:17.464304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:17.464304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:17.464304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:17.464304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:17.464304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:17.464304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:17.464304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:17.466115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:17.466115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:17.466115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:17.466115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:17.466115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:17.466115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:17.466115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:17.466115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:17.466115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:17.466115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:17.466115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:17.466115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:17.466115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:17.466115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:17.466115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:17.466115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:17.466115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:17.467890 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:17.467890 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:17.467890 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:17.471333 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 422/833] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:17.481409 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9db7b9-28a5-4113-8707-1e3d64dfae39 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:17.547318 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3445335-6a94-4c28-97b8-4892267d525b None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:17.613776 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73f9fe-c451-4dd3-8da8-69c6a8c52bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:17.614917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73f9fe-c451-4dd3-8da8-69c6a8c52bca None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:17.616265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73f9fe-c451-4dd3-8da8-69c6a8c52bca None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:17.617085 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73f9fe-c451-4dd3-8da8-69c6a8c52bca None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:17.618451 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73f9fe-c451-4dd3-8da8-69c6a8c52bca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:17.619269 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73f9fe-c451-4dd3-8da8-69c6a8c52bca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:17.622074 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73f9fe-c451-4dd3-8da8-69c6a8c52bca None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:17.651834 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 412/834] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:17.669010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73f9fe-c451-4dd3-8da8-69c6a8c52bca None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:17.692245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:17.692953 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9db7b9-28a5-4113-8707-1e3d64dfae39 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:17.707175 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:17.776790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919200e4-7c87-4f52-9663-52db4d9db0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:17.779816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919200e4-7c87-4f52-9663-52db4d9db0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:17.780651 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919200e4-7c87-4f52-9663-52db4d9db0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:17.781383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919200e4-7c87-4f52-9663-52db4d9db0e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:17.784316 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919200e4-7c87-4f52-9663-52db4d9db0e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:17.788748 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919200e4-7c87-4f52-9663-52db4d9db0e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:17.790029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919200e4-7c87-4f52-9663-52db4d9db0e3 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:17.825890 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 423/835] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:17.837445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919200e4-7c87-4f52-9663-52db4d9db0e3 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:17.898332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73f9fe-c451-4dd3-8da8-69c6a8c52bca None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:17.947188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d46cac-7127-4449-82a4-ad2cf0f45269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:17.948527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d46cac-7127-4449-82a4-ad2cf0f45269 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:17.949064 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d46cac-7127-4449-82a4-ad2cf0f45269 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:17.949551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d46cac-7127-4449-82a4-ad2cf0f45269 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:17.959381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d46cac-7127-4449-82a4-ad2cf0f45269 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:17.961708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d46cac-7127-4449-82a4-ad2cf0f45269 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:17.977642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-40d46cac-7127-4449-82a4-ad2cf0f45269 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 16:29:17.977642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:17.977642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:17.977642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:17.977642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:17.977642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:17.977642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:17.977642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:17.977642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:17.977642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:17.977642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:17.977642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:17.977642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:29:17.977642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:29:17.977642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:29:17.977642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:17.979529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:17.982198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:17.982198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:17.982198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:29:17.982198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:29:17.982198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:29:17.982198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:29:17.982198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:29:17.982198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:29:17.982198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 16:29:17.982198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:17.982198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 413/836] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Sep 7 16:29:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:17.982198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96d072-d9af-4f67-93f1-9c415d9286ab None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:17.982198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96d072-d9af-4f67-93f1-9c415d9286ab None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:17.984534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96d072-d9af-4f67-93f1-9c415d9286ab None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:17.987457 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 414/837] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:17.987457 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562fdb7-29a6-4a3c-8b3c-51d167e109ac None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:17.988015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562fdb7-29a6-4a3c-8b3c-51d167e109ac None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:17.988015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562fdb7-29a6-4a3c-8b3c-51d167e109ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:18.009111 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-7562fdb7-29a6-4a3c-8b3c-51d167e109ac None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:18.010341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7562fdb7-29a6-4a3c-8b3c-51d167e109ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:18.023517 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919200e4-7c87-4f52-9663-52db4d9db0e3 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:18.083936 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a40d5-fc75-4800-93b9-9b51e77386c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:18.085461 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a40d5-fc75-4800-93b9-9b51e77386c1 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:18.086137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a40d5-fc75-4800-93b9-9b51e77386c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:18.086623 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a40d5-fc75-4800-93b9-9b51e77386c1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:18.096268 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a40d5-fc75-4800-93b9-9b51e77386c1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:18.098368 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a40d5-fc75-4800-93b9-9b51e77386c1 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:18.105936 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:18.114577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-651a40d5-fc75-4800-93b9-9b51e77386c1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:29:18.114577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:18.114577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:18.114577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:18.114577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:18.114577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:18.114577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:18.114577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:18.114577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:18.114577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:18.114577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:18.114577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:18.114577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:29:18.114577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:29:18.114577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:29:18.114577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:18.116543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:18.118494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:18.118494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:18.118494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:29:18.118494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:29:18.118494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:29:18.118494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:29:18.118494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:29:18.118494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:29:18.118494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:29:18.118494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:18.121320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 424/838] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Sep 7 16:29:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:18.122954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a40d5-fc75-4800-93b9-9b51e77386c1 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:18.127971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 415/839] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:18.129621 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562fdb7-29a6-4a3c-8b3c-51d167e109ac None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:18.182160 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:18.300548 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a40d5-fc75-4800-93b9-9b51e77386c1 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:18.322282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562fdb7-29a6-4a3c-8b3c-51d167e109ac None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:18.368560 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9f832-7045-472e-8e6c-9f133282c891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:18.369426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9f832-7045-472e-8e6c-9f133282c891 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:18.369847 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9f832-7045-472e-8e6c-9f133282c891 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:18.370280 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9f832-7045-472e-8e6c-9f133282c891 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:18.371172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9f832-7045-472e-8e6c-9f133282c891 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:18.371664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9f832-7045-472e-8e6c-9f133282c891 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:18.372712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fa657-6329-43ee-a729-8318d88094ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:18.373548 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9f832-7045-472e-8e6c-9f133282c891 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:18.374027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fa657-6329-43ee-a729-8318d88094ce None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:18.374642 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fa657-6329-43ee-a729-8318d88094ce None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:18.375245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fa657-6329-43ee-a729-8318d88094ce None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:18.376814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fa657-6329-43ee-a729-8318d88094ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:18.378375 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fa657-6329-43ee-a729-8318d88094ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:18.380397 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fa657-6329-43ee-a729-8318d88094ce None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:18.398094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 416/840] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Sep 7 16:29:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:18.407635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9f832-7045-472e-8e6c-9f133282c891 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:18.424887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 425/841] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Sep 7 16:29:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:18.434176 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fa657-6329-43ee-a729-8318d88094ce None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:18.536772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:18.605628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:18.623697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fa657-6329-43ee-a729-8318d88094ce None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:18.625381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9f832-7045-472e-8e6c-9f133282c891 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:18.680757 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704123cd-d3e5-4bf7-b6d6-670bff2f6691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:18.681800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266a35f-ad9a-4af0-acca-c71610e5658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:18.681952 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704123cd-d3e5-4bf7-b6d6-670bff2f6691 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:18.681952 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704123cd-d3e5-4bf7-b6d6-670bff2f6691 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:18.682171 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266a35f-ad9a-4af0-acca-c71610e5658d None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:18.682298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704123cd-d3e5-4bf7-b6d6-670bff2f6691 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:18.682435 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266a35f-ad9a-4af0-acca-c71610e5658d None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:18.682840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266a35f-ad9a-4af0-acca-c71610e5658d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:18.789023 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704123cd-d3e5-4bf7-b6d6-670bff2f6691 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:18.791826 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704123cd-d3e5-4bf7-b6d6-670bff2f6691 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:18.801162 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266a35f-ad9a-4af0-acca-c71610e5658d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:18.802674 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266a35f-ad9a-4af0-acca-c71610e5658d None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:18.898536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:18.921117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:18.947992 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 426/842] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:29:18 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:29:18.949159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266a35f-ad9a-4af0-acca-c71610e5658d None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:18.985110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 417/843] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:29:18 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:29:18.986232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704123cd-d3e5-4bf7-b6d6-670bff2f6691 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:19.108989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266a35f-ad9a-4af0-acca-c71610e5658d None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:19.153208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704123cd-d3e5-4bf7-b6d6-670bff2f6691 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:19.158798 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e983f2-aa24-48ac-9804-49bd77f38ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:19.159455 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e983f2-aa24-48ac-9804-49bd77f38ace None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:19.159761 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e983f2-aa24-48ac-9804-49bd77f38ace None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:19.160028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e983f2-aa24-48ac-9804-49bd77f38ace None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:19.173953 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e983f2-aa24-48ac-9804-49bd77f38ace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:29:19.180380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-a3e983f2-aa24-48ac-9804-49bd77f38ace None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:29:19.180380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:19.180380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:19.180380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:19.180380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:19.180380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:19.180380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:19.180380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:19.180380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:19.180380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:19.180380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:19.180380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:19.180380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:29:19.180380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:29:19.180380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:29:19.180380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:29:19.188184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:29:19.188184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:29:19.188184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:29:19.188184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:29:19.188184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:19.188184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:19.188184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:19.188184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:19.188184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:19.188184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:19.188184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:19.188184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:19.188184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:19.188184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:19.188184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:19.188184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:19.189859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:19.189859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:19.189859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:19.189859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:19.189859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:29:19.189859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:29:19.189859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:29:19.189859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:29:19.189859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:29:19.189859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:29:19.189859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:29:19.189859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:19.189859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 427/844] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:29:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:19.189859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e983f2-aa24-48ac-9804-49bd77f38ace None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:19.224262 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c0494-37c4-4da1-865c-0f8aa3fa0af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:19.226350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c0494-37c4-4da1-865c-0f8aa3fa0af9 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:19.226869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c0494-37c4-4da1-865c-0f8aa3fa0af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:19.227386 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c0494-37c4-4da1-865c-0f8aa3fa0af9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:19.238917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c0494-37c4-4da1-865c-0f8aa3fa0af9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:19.240971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c0494-37c4-4da1-865c-0f8aa3fa0af9 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:19.258232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-ea6c0494-37c4-4da1-865c-0f8aa3fa0af9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:19.258232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:19.258232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:19.258232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:19.258232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:19.258232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:19.258232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:19.258232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:19.258232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:19.258232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:19.258232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:19.258232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:19.258232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:19.258232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:19.258232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:19.258232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:19.259315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:19.259315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:19.259315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:19.259315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:19.259315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:19.259315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:19.259315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:19.259315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:19.259315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:19.259315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:19.259315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:19.259315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:19.259315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:19.259315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:19.259315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:19.259315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:19.259315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:19.260265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:19.260265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:19.260265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:19.264053 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 418/845] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:19.264996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c0494-37c4-4da1-865c-0f8aa3fa0af9 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:19.273218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:19.277991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:19.376762 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e983f2-aa24-48ac-9804-49bd77f38ace None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:19.424491 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c0494-37c4-4da1-865c-0f8aa3fa0af9 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:19.436723 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccaa6b-bca8-4020-a25b-4f19a5806fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:19.437675 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccaa6b-bca8-4020-a25b-4f19a5806fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:19.438092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccaa6b-bca8-4020-a25b-4f19a5806fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:19.438511 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccaa6b-bca8-4020-a25b-4f19a5806fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:19.456281 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccaa6b-bca8-4020-a25b-4f19a5806fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:19.457884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccaa6b-bca8-4020-a25b-4f19a5806fc9 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:19.476237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-c2ccaa6b-bca8-4020-a25b-4f19a5806fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:19.476237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:19.476237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:19.476237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:19.476237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:19.476237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:19.476237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:19.476237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:19.476237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:19.476237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:19.476237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:19.476237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:19.476237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:19.476237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:19.476237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:19.476237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:19.478324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:19.478324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:19.478324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:19.478324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:19.478324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:19.478324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:19.478324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:19.478324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:19.478324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:19.478324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:19.478324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:19.478324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:19.478324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:19.478324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:19.478324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:19.478324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:19.478324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:19.480377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:19.480377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:19.480377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:19.480377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 428/846] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:19.480377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccaa6b-bca8-4020-a25b-4f19a5806fc9 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:19.482849 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89062d2c-cdd7-445b-80bb-3b03a643dafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:19.483534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89062d2c-cdd7-445b-80bb-3b03a643dafd None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:19.483781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89062d2c-cdd7-445b-80bb-3b03a643dafd None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:19.484031 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89062d2c-cdd7-445b-80bb-3b03a643dafd None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:19.484711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89062d2c-cdd7-445b-80bb-3b03a643dafd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:19.486207 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89062d2c-cdd7-445b-80bb-3b03a643dafd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:19.486455 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89062d2c-cdd7-445b-80bb-3b03a643dafd None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:19.496920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 419/847] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:29:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:19.498414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de2ae2-9302-4dd9-a9c7-da457f706640 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:19.498672 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de2ae2-9302-4dd9-a9c7-da457f706640 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:19.498912 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de2ae2-9302-4dd9-a9c7-da457f706640 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:19.500092 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 420/848] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:19.500877 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de2ae2-9302-4dd9-a9c7-da457f706640 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:19.596181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:19.623113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:19.630021 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccaa6b-bca8-4020-a25b-4f19a5806fc9 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:19.648844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de2ae2-9302-4dd9-a9c7-da457f706640 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:19.672035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf483e-1495-4231-ad9d-24e55d6811e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:19.672707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf483e-1495-4231-ad9d-24e55d6811e5 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:19.673036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf483e-1495-4231-ad9d-24e55d6811e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:19.673441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf483e-1495-4231-ad9d-24e55d6811e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:19.674206 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf483e-1495-4231-ad9d-24e55d6811e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:19.674702 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf483e-1495-4231-ad9d-24e55d6811e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:19.676228 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf483e-1495-4231-ad9d-24e55d6811e5 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:19.691037 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 429/849] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:19.693093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1d4b8-2bec-429f-b879-a64408c5d593 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:19.693605 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1d4b8-2bec-429f-b879-a64408c5d593 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:19.694054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1d4b8-2bec-429f-b879-a64408c5d593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:19.703078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f8bc4-196f-4b8a-97e0-03e77559cac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:19.704279 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f8bc4-196f-4b8a-97e0-03e77559cac0 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:19.704725 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f8bc4-196f-4b8a-97e0-03e77559cac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:19.705066 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f8bc4-196f-4b8a-97e0-03e77559cac0 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:19.705720 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f8bc4-196f-4b8a-97e0-03e77559cac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:19.706139 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f8bc4-196f-4b8a-97e0-03e77559cac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:19.708630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f8bc4-196f-4b8a-97e0-03e77559cac0 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:19.722255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-4db1d4b8-2bec-429f-b879-a64408c5d593 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:19.724082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4db1d4b8-2bec-429f-b879-a64408c5d593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:19.729117 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 421/850] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:19.730270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f8bc4-196f-4b8a-97e0-03e77559cac0 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:19.826299 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 430/851] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:19.827882 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1d4b8-2bec-429f-b879-a64408c5d593 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:19.867233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f8bc4-196f-4b8a-97e0-03e77559cac0 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:19.906301 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:19.914996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f814ba-83d1-4963-a816-d5caee272721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:19.927345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f814ba-83d1-4963-a816-d5caee272721 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:19.927345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f814ba-83d1-4963-a816-d5caee272721 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:19.927345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f814ba-83d1-4963-a816-d5caee272721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:19.930493 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f814ba-83d1-4963-a816-d5caee272721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:19.932243 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f814ba-83d1-4963-a816-d5caee272721 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:19.953888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-08f814ba-83d1-4963-a816-d5caee272721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:19.953888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:19.953888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:19.953888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:19.953888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:19.953888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:19.953888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:19.953888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:19.953888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:19.953888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:19.953888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:19.953888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:19.953888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:19.953888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:19.953888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:19.953888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:19.956033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:19.956033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:19.956033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:19.956033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:19.956033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:19.956033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:19.956033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:19.956033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:19.956033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:19.956033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:19.956033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:19.956033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:19.956033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:19.956033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:19.956033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:19.956033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:19.956033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:19.958036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:19.958036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:19.958036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:19.967522 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 422/852] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:19.967522 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f814ba-83d1-4963-a816-d5caee272721 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:19.997923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:20.025940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1d4b8-2bec-429f-b879-a64408c5d593 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:20.095927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3987a1-18da-473c-9f39-22f9e03f0c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:20.097346 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3987a1-18da-473c-9f39-22f9e03f0c6c None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:20.097825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3987a1-18da-473c-9f39-22f9e03f0c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:20.098306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3987a1-18da-473c-9f39-22f9e03f0c6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:20.111027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3987a1-18da-473c-9f39-22f9e03f0c6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:20.113721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3987a1-18da-473c-9f39-22f9e03f0c6c None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:20.127945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f814ba-83d1-4963-a816-d5caee272721 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:20.135935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-ec3987a1-18da-473c-9f39-22f9e03f0c6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:20.135935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:20.135935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:20.135935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:20.135935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:20.135935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:20.135935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:20.135935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:20.135935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:20.135935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:20.135935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:20.135935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:20.135935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:29:20.135935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:29:20.135935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:29:20.136901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:29:20.136901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:20.136901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:20.136901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:20.136901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:20.136901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:20.136901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:20.136901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:20.136901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:20.136901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:20.136901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:20.136901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:20.136901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:20.136901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:20.136901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:20.136901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:20.136901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:20.137809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:29:20.137809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:29:20.137809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:29:20.137809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:29:20.137809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:29:20.137809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:29:20.137809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:20.137809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:20.139801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 431/853] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:20.140930 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3987a1-18da-473c-9f39-22f9e03f0c6c None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:20.179806 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd95e98-2d04-4cab-8d88-304ed38d47a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:20.180716 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd95e98-2d04-4cab-8d88-304ed38d47a9 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:20.181120 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd95e98-2d04-4cab-8d88-304ed38d47a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:20.181517 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd95e98-2d04-4cab-8d88-304ed38d47a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:20.192954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd95e98-2d04-4cab-8d88-304ed38d47a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:20.195340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd95e98-2d04-4cab-8d88-304ed38d47a9 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:20.208137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-ddd95e98-2d04-4cab-8d88-304ed38d47a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:20.208137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:20.208137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:20.208137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:20.208137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:20.208137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:20.208137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:20.208137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:20.208137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:20.208137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:20.208137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:20.208137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:20.208137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:29:20.208137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:29:20.208137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:29:20.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:29:20.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:20.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:20.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:20.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:20.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:20.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:20.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:20.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:20.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:20.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:20.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:20.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:20.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:20.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:20.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:20.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:20.211789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:29:20.211789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:29:20.211789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:29:20.211789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:29:20.211789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:29:20.211789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:29:20.211789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:20.211789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:20.211789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 423/854] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:20.211789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd95e98-2d04-4cab-8d88-304ed38d47a9 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:20.285469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:20.301074 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3987a1-18da-473c-9f39-22f9e03f0c6c None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:20.357098 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff6bfb-6082-46ec-97ec-70b347236966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:20.357726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff6bfb-6082-46ec-97ec-70b347236966 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:20.358007 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff6bfb-6082-46ec-97ec-70b347236966 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:20.358280 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff6bfb-6082-46ec-97ec-70b347236966 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:20.358581 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd95e98-2d04-4cab-8d88-304ed38d47a9 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:20.358936 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff6bfb-6082-46ec-97ec-70b347236966 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:20.359238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff6bfb-6082-46ec-97ec-70b347236966 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:20.360683 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff6bfb-6082-46ec-97ec-70b347236966 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:20.381452 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 432/855] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:20.381452 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff6bfb-6082-46ec-97ec-70b347236966 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:20.392292 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:20.417817 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc103337-af21-4ba8-8724-f9d79d328583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:20.418712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103337-af21-4ba8-8724-f9d79d328583 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:20.419079 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103337-af21-4ba8-8724-f9d79d328583 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:20.419556 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103337-af21-4ba8-8724-f9d79d328583 None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:20.420539 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc103337-af21-4ba8-8724-f9d79d328583 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:20.420849 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc103337-af21-4ba8-8724-f9d79d328583 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:20.422300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc103337-af21-4ba8-8724-f9d79d328583 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:20.437175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 424/856] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:29:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:20.437917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc103337-af21-4ba8-8724-f9d79d328583 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:20.528955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff6bfb-6082-46ec-97ec-70b347236966 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:20.555752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc103337-af21-4ba8-8724-f9d79d328583 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:20.557759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:20.572402 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4853ce-f027-4609-9b5c-9d46ccddf8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:20.573191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4853ce-f027-4609-9b5c-9d46ccddf8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:20.573568 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4853ce-f027-4609-9b5c-9d46ccddf8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:20.573852 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4853ce-f027-4609-9b5c-9d46ccddf8c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:20.574556 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4853ce-f027-4609-9b5c-9d46ccddf8c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:20.574864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4853ce-f027-4609-9b5c-9d46ccddf8c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:20.576339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4853ce-f027-4609-9b5c-9d46ccddf8c6 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:20.589970 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 433/857] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:29:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:20.590912 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4853ce-f027-4609-9b5c-9d46ccddf8c6 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:20.613538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbf7d0-1d32-4702-bc24-69eb0bf3f5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:20.614555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbf7d0-1d32-4702-bc24-69eb0bf3f5e1 None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:20.615042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbf7d0-1d32-4702-bc24-69eb0bf3f5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:20.616058 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbf7d0-1d32-4702-bc24-69eb0bf3f5e1 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:20.617258 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbf7d0-1d32-4702-bc24-69eb0bf3f5e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:20.619602 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbf7d0-1d32-4702-bc24-69eb0bf3f5e1 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:20.667905 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:20.705063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4853ce-f027-4609-9b5c-9d46ccddf8c6 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:20.725127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 425/858] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Sep 7 16:29:20 2022] POST /identity/v3/services => generated 251 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:29:20.727592 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbf7d0-1d32-4702-bc24-69eb0bf3f5e1 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:20.777992 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db0f94-934b-4cb7-9348-bd8562cbe257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:20.778710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db0f94-934b-4cb7-9348-bd8562cbe257 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:20.779001 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db0f94-934b-4cb7-9348-bd8562cbe257 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:20.779437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db0f94-934b-4cb7-9348-bd8562cbe257 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:20.794923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db0f94-934b-4cb7-9348-bd8562cbe257 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:20.797577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db0f94-934b-4cb7-9348-bd8562cbe257 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:20.820081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-52db0f94-934b-4cb7-9348-bd8562cbe257 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 16:29:20.820081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:20.820081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:20.820081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:20.820081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:20.820081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:20.820081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:20.820081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:20.820081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:20.820081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:20.820081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:20.820081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:20.820081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:29:20.820081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:29:20.820081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:29:20.820081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:20.821844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:20.824393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:20.824393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:20.824393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:29:20.824393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:29:20.824393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:29:20.824393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:29:20.824393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:29:20.824393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:29:20.824393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 16:29:20.824393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:20.824393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 434/859] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:29:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:20.824393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db0f94-934b-4cb7-9348-bd8562cbe257 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:20.954727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbf7d0-1d32-4702-bc24-69eb0bf3f5e1 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:20.975959 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db0f94-934b-4cb7-9348-bd8562cbe257 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:21.008539 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec959c57-2177-4e95-97b0-d97f1a9d21a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:21.009827 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec959c57-2177-4e95-97b0-d97f1a9d21a1 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:21.010109 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec959c57-2177-4e95-97b0-d97f1a9d21a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:21.010382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec959c57-2177-4e95-97b0-d97f1a9d21a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:21.011181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec959c57-2177-4e95-97b0-d97f1a9d21a1 None admin] RBAC: Adding query filter params (role.id=9b7a362fef7446e795c33b25a08f20bc, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=87ba67fc171b4258b6fda72094ed11c3) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:21.011524 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec959c57-2177-4e95-97b0-d97f1a9d21a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:21.012975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec959c57-2177-4e95-97b0-d97f1a9d21a1 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:21.014527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:21.020006 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 426/860] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:29:20 2022] GET /identity/v3/role_assignments?user.id=87ba67fc171b4258b6fda72094ed11c3&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9b7a362fef7446e795c33b25a08f20bc => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:21.029622 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec959c57-2177-4e95-97b0-d97f1a9d21a1 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:21.040157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02d2c7-1e0a-4bb2-87d5-5b0e1795fd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:21.040157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02d2c7-1e0a-4bb2-87d5-5b0e1795fd3e None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:21.040729 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02d2c7-1e0a-4bb2-87d5-5b0e1795fd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:21.040729 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02d2c7-1e0a-4bb2-87d5-5b0e1795fd3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:21.042157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02d2c7-1e0a-4bb2-87d5-5b0e1795fd3e None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=cf48978c20f04173b114e15e1ce2157c) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:21.042717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02d2c7-1e0a-4bb2-87d5-5b0e1795fd3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:21.045602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02d2c7-1e0a-4bb2-87d5-5b0e1795fd3e None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:21.067536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 435/861] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:29:20 2022] GET /identity/v3/role_assignments?user.id=cf48978c20f04173b114e15e1ce2157c&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:21.105392 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:21.257898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec959c57-2177-4e95-97b0-d97f1a9d21a1 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:21.302681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc4f68-b2fe-46d3-9a43-93d398431cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:21.303678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc4f68-b2fe-46d3-9a43-93d398431cde None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:21.303678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc4f68-b2fe-46d3-9a43-93d398431cde None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:21.303993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc4f68-b2fe-46d3-9a43-93d398431cde None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:21.304760 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc4f68-b2fe-46d3-9a43-93d398431cde None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:21.305065 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc4f68-b2fe-46d3-9a43-93d398431cde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:21.306548 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc4f68-b2fe-46d3-9a43-93d398431cde None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:21.328682 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 427/862] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Sep 7 16:29:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:21.336783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02d2c7-1e0a-4bb2-87d5-5b0e1795fd3e None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:21.498992 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02d2c7-1e0a-4bb2-87d5-5b0e1795fd3e None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:21.564668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e59f68-80c5-47f7-8cb1-ba9441ff6059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:21.565640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e59f68-80c5-47f7-8cb1-ba9441ff6059 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:21.566136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e59f68-80c5-47f7-8cb1-ba9441ff6059 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:21.566635 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e59f68-80c5-47f7-8cb1-ba9441ff6059 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:21.680837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:21.706296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e59f68-80c5-47f7-8cb1-ba9441ff6059 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:21.715062 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e59f68-80c5-47f7-8cb1-ba9441ff6059 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:21.854715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 436/863] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:29:21 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:29:21.863008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc4f68-b2fe-46d3-9a43-93d398431cde None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:22.016514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:22.034270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc4f68-b2fe-46d3-9a43-93d398431cde None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:22.073832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75efbb4-6b07-425c-99fd-40961b1fa22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:22.074478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75efbb4-6b07-425c-99fd-40961b1fa22d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:22.074753 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75efbb4-6b07-425c-99fd-40961b1fa22d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:22.075023 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75efbb4-6b07-425c-99fd-40961b1fa22d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:22.086788 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75efbb4-6b07-425c-99fd-40961b1fa22d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:22.088266 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75efbb4-6b07-425c-99fd-40961b1fa22d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:22.104444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-a75efbb4-6b07-425c-99fd-40961b1fa22d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:22.104444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:22.104444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:22.104444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:22.104444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:22.104444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:22.104444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:22.104444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:22.104444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:22.104444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:22.104444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:22.104444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:22.104444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:22.104444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:22.104444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:22.104444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:22.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:22.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:22.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:22.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:22.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:22.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:22.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:22.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:22.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:22.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:22.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:22.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:22.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:22.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:22.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:22.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:22.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:22.107757 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:22.107757 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:22.107757 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:22.107757 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 428/864] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:22.111838 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e59f68-80c5-47f7-8cb1-ba9441ff6059 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:22.217806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:22.235902 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e59f68-80c5-47f7-8cb1-ba9441ff6059 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:22.278651 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763f91d-c540-4bb4-a319-29c35a86d5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:22.279283 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763f91d-c540-4bb4-a319-29c35a86d5fc None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:22.279592 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763f91d-c540-4bb4-a319-29c35a86d5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:22.279862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763f91d-c540-4bb4-a319-29c35a86d5fc None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:22.280525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763f91d-c540-4bb4-a319-29c35a86d5fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:22.280825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763f91d-c540-4bb4-a319-29c35a86d5fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:22.282241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763f91d-c540-4bb4-a319-29c35a86d5fc None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:22.296846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 437/865] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:22.306008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75efbb4-6b07-425c-99fd-40961b1fa22d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:22.501008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75efbb4-6b07-425c-99fd-40961b1fa22d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:22.573459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9dadac-49cf-438e-ad6e-e7826db0b6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:22.574822 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dadac-49cf-438e-ad6e-e7826db0b6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:22.575624 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dadac-49cf-438e-ad6e-e7826db0b6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:22.576344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dadac-49cf-438e-ad6e-e7826db0b6e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:22.588056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9dadac-49cf-438e-ad6e-e7826db0b6e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:22.589053 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:22.592434 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9dadac-49cf-438e-ad6e-e7826db0b6e5 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:22.610886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-7d9dadac-49cf-438e-ad6e-e7826db0b6e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:22.610886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:22.610886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:22.610886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:22.610886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:22.610886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:22.610886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:22.610886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:22.610886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:22.610886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:22.610886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:22.610886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:22.610886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:29:22.610886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:29:22.610886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:29:22.611921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:29:22.611921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:22.611921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:22.611921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:22.611921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:22.611921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:22.611921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:22.611921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:22.611921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:22.611921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:22.611921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:22.611921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:22.611921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:22.611921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:22.611921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:22.611921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:22.611921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:22.613397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:29:22.613397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:29:22.613397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:29:22.613397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:29:22.613397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:29:22.613397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:29:22.613397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:22.613397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:22.613397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 429/866] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:22.622235 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763f91d-c540-4bb4-a319-29c35a86d5fc None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:22.821137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763f91d-c540-4bb4-a319-29c35a86d5fc None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:22.875716 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168d367-ac18-490a-9688-20d9f4a83de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:22.876794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168d367-ac18-490a-9688-20d9f4a83de2 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:22.877297 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168d367-ac18-490a-9688-20d9f4a83de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:22.877763 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168d367-ac18-490a-9688-20d9f4a83de2 None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:22.878659 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168d367-ac18-490a-9688-20d9f4a83de2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:22.879164 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168d367-ac18-490a-9688-20d9f4a83de2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:22.881710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168d367-ac18-490a-9688-20d9f4a83de2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:22.895692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 438/867] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:29:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:22.906031 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9dadac-49cf-438e-ad6e-e7826db0b6e5 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:23.059364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9dadac-49cf-438e-ad6e-e7826db0b6e5 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:23.122779 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4cec1-6943-4b44-b482-9859a74c677f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:23.123730 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4cec1-6943-4b44-b482-9859a74c677f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:23.124210 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4cec1-6943-4b44-b482-9859a74c677f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:23.124702 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4cec1-6943-4b44-b482-9859a74c677f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:23.125865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4cec1-6943-4b44-b482-9859a74c677f None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=56cd868e866d436aa1d601f7791e812c) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:23.126381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4cec1-6943-4b44-b482-9859a74c677f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:23.129016 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4cec1-6943-4b44-b482-9859a74c677f None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:23.140662 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 430/868] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:29:22 2022] GET /identity/v3/role_assignments?user.id=56cd868e866d436aa1d601f7791e812c&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:23.341631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17b1fb-9003-4dcd-9320-896b5834adc8 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:23.342403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17b1fb-9003-4dcd-9320-896b5834adc8 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:23.342533 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17b1fb-9003-4dcd-9320-896b5834adc8 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:23.345302 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 439/869] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:23.355195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72860b1b-0963-47cf-b322-dce591293c87 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:23.355684 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72860b1b-0963-47cf-b322-dce591293c87 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:23.356161 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72860b1b-0963-47cf-b322-dce591293c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:23.387002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-72860b1b-0963-47cf-b322-dce591293c87 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:23.388888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-72860b1b-0963-47cf-b322-dce591293c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:23.485755 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:23.508109 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 431/870] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:23.876619 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b273cf9-a385-4dc9-80d7-c79dba10c376 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:23.876873 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b273cf9-a385-4dc9-80d7-c79dba10c376 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:23.877203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b273cf9-a385-4dc9-80d7-c79dba10c376 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:23.878488 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 440/871] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:29:23.885309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88e49b-db86-40a9-9fbb-4928c15b6afe None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:23.885901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88e49b-db86-40a9-9fbb-4928c15b6afe None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:23.886376 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88e49b-db86-40a9-9fbb-4928c15b6afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:23.890564 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b273cf9-a385-4dc9-80d7-c79dba10c376 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:23.907238 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-3e88e49b-db86-40a9-9fbb-4928c15b6afe None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:23.908680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:23.910622 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3e88e49b-db86-40a9-9fbb-4928c15b6afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:24.023185 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b273cf9-a385-4dc9-80d7-c79dba10c376 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:24.044855 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 432/872] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 16:29:24.062253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faf906-b975-4886-b304-cf509057859a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:24.063188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faf906-b975-4886-b304-cf509057859a None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:24.063654 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faf906-b975-4886-b304-cf509057859a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:24.064069 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faf906-b975-4886-b304-cf509057859a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:24.064887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12faf906-b975-4886-b304-cf509057859a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:24.066409 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12faf906-b975-4886-b304-cf509057859a None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:24.076693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-12faf906-b975-4886-b304-cf509057859a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 16:29:24.076693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:24.076693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:24.076693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:24.076693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:24.076693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:24.076693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:24.076693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:24.076693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 16:29:24.076693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:24.076693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:24.076693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:24.076693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:24.076693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:24.076693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:24.076693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:24.076693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:24.077735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:24.077735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:24.077735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:24.077735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:24.077735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:24.077735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:24.077735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:24.077735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:24.077735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:24.077735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:24.077735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:24.077735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:24.077735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:24.077735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:24.077735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:24.077735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:24.078647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:24.078647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:24.078647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:24.078647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:24.078647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:24.078647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:24.078647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:24.078647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:24.078647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:24.078647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:24.078647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:24.078647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:24.078647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 16:29:24.078647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:24.081475 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 441/873] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:29:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:24.088429 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88e49b-db86-40a9-9fbb-4928c15b6afe None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:24.205900 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88e49b-db86-40a9-9fbb-4928c15b6afe None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:24.231126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:24.246403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e163bd-a640-43b3-8555-c7906cf40a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:24.247015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e163bd-a640-43b3-8555-c7906cf40a77 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:24.247316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e163bd-a640-43b3-8555-c7906cf40a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:24.247604 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e163bd-a640-43b3-8555-c7906cf40a77 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:24.248277 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e163bd-a640-43b3-8555-c7906cf40a77 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:24.248580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e163bd-a640-43b3-8555-c7906cf40a77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:24.250115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e163bd-a640-43b3-8555-c7906cf40a77 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:24.255791 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 433/874] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:29:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:24.262595 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faf906-b975-4886-b304-cf509057859a None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:24.315046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e163bd-a640-43b3-8555-c7906cf40a77 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:24.358897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:24.412841 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faf906-b975-4886-b304-cf509057859a None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:24.456618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e163bd-a640-43b3-8555-c7906cf40a77 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:24.460604 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c81b1-fca2-4a09-8db5-448f205aa1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:24.462348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c81b1-fca2-4a09-8db5-448f205aa1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:24.462348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c81b1-fca2-4a09-8db5-448f205aa1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:24.462348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c81b1-fca2-4a09-8db5-448f205aa1c6 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:24.463038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c81b1-fca2-4a09-8db5-448f205aa1c6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:24.463564 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c81b1-fca2-4a09-8db5-448f205aa1c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:24.465955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c81b1-fca2-4a09-8db5-448f205aa1c6 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:24.480258 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 442/875] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:29:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:24.480258 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455abd38-c099-4a20-8706-ec5cd417874f None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:24.480258 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455abd38-c099-4a20-8706-ec5cd417874f None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:24.480258 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455abd38-c099-4a20-8706-ec5cd417874f None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:24.480258 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 443/876] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:24.484643 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455abd38-c099-4a20-8706-ec5cd417874f None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:24.515799 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9727fb-ef70-4325-8016-3067399cfa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:24.516634 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9727fb-ef70-4325-8016-3067399cfa35 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:24.517104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9727fb-ef70-4325-8016-3067399cfa35 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:24.517514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9727fb-ef70-4325-8016-3067399cfa35 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:24.533511 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9727fb-ef70-4325-8016-3067399cfa35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:29:24.539339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-ff9727fb-ef70-4325-8016-3067399cfa35 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 16:29:24.539339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:24.539339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:24.539339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:24.539339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:24.539339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:24.539339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:24.539339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:24.539339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:24.539339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:24.539339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:24.539339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:24.539339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:29:24.539339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:29:24.539339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:29:24.539339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:29:24.541189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:29:24.541189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:29:24.541189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:29:24.541189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:29:24.541189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:24.541189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:24.541189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:24.541189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:24.541189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:24.541189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:24.541189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:24.541189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:24.541189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:24.541189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:24.541189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:24.541189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:24.542819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:24.542819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:24.542819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:24.542819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:24.542819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:29:24.542819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:29:24.542819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:29:24.542819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:29:24.542819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:29:24.542819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:29:24.542819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 16:29:24.542819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:24.542819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 434/877] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Sep 7 16:29:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:24.546448 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223ac8f-fe92-4ed6-b788-adf1262f616f None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:24.546448 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223ac8f-fe92-4ed6-b788-adf1262f616f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:24.546448 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223ac8f-fe92-4ed6-b788-adf1262f616f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:24.567514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-4223ac8f-fe92-4ed6-b788-adf1262f616f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:24.570109 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-4223ac8f-fe92-4ed6-b788-adf1262f616f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:24.644037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:24.663253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455abd38-c099-4a20-8706-ec5cd417874f None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:24.687526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 435/878] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:24 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:24.687526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223ac8f-fe92-4ed6-b788-adf1262f616f None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:24.725849 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb342f99-aeae-4fea-b4b9-48974d5c9685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:24.726789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb342f99-aeae-4fea-b4b9-48974d5c9685 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:24.727270 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb342f99-aeae-4fea-b4b9-48974d5c9685 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:24.727806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb342f99-aeae-4fea-b4b9-48974d5c9685 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:24.729046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb342f99-aeae-4fea-b4b9-48974d5c9685 None admin] RBAC: Adding query filter params (interface=public, service_id=0ee5150ffe5b4b1d904dfca29608f677, region_id=RegionOne) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:24.729592 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb342f99-aeae-4fea-b4b9-48974d5c9685 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:24.732059 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb342f99-aeae-4fea-b4b9-48974d5c9685 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:24.734980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:24.748245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 444/879] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Sep 7 16:29:24 2022] GET /identity/v3/endpoints?service_id=0ee5150ffe5b4b1d904dfca29608f677&interface=public®ion_id=RegionOne => generated 194 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:24.752793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb342f99-aeae-4fea-b4b9-48974d5c9685 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:24.884062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223ac8f-fe92-4ed6-b788-adf1262f616f None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:24.942181 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb342f99-aeae-4fea-b4b9-48974d5c9685 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:24.954469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fe99b-fc9f-43a7-872c-d42e45a58b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:24.955677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fe99b-fc9f-43a7-872c-d42e45a58b0e None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:24.956298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fe99b-fc9f-43a7-872c-d42e45a58b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:24.956977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fe99b-fc9f-43a7-872c-d42e45a58b0e None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:24.958292 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fe99b-fc9f-43a7-872c-d42e45a58b0e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:24.959400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fe99b-fc9f-43a7-872c-d42e45a58b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:24.962363 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fe99b-fc9f-43a7-872c-d42e45a58b0e None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:24.980392 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 436/880] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Sep 7 16:29:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:24.991900 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fe99b-fc9f-43a7-872c-d42e45a58b0e None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:25.015034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb5764-78a1-4db9-806e-6fa9838ae73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:25.016131 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb5764-78a1-4db9-806e-6fa9838ae73e None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:25.016599 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb5764-78a1-4db9-806e-6fa9838ae73e None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:25.017064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb5764-78a1-4db9-806e-6fa9838ae73e None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:25.018129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb5764-78a1-4db9-806e-6fa9838ae73e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:25.020698 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb5764-78a1-4db9-806e-6fa9838ae73e None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:25.039928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 445/881] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Sep 7 16:29:24 2022] GET /identity/v3/services => generated 1011 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:29:25.068788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb5764-78a1-4db9-806e-6fa9838ae73e None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:25.069649 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:25.172385 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fe99b-fc9f-43a7-872c-d42e45a58b0e None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:25.200328 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:25.217473 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882c15a-40de-4c2d-86b5-b9a3bec53ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:25.217473 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882c15a-40de-4c2d-86b5-b9a3bec53ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:25.217882 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882c15a-40de-4c2d-86b5-b9a3bec53ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:25.218420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882c15a-40de-4c2d-86b5-b9a3bec53ae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:25.239143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882c15a-40de-4c2d-86b5-b9a3bec53ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:25.243893 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882c15a-40de-4c2d-86b5-b9a3bec53ae3 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:25.276170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-3882c15a-40de-4c2d-86b5-b9a3bec53ae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:25.276170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:25.276170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:25.276170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:25.276170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:25.276170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:25.276170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:25.276170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:25.276170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:25.276170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:25.276170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:25.276170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:25.276170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:25.276170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:25.276170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:25.276170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:25.277957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:25.277957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:25.277957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:25.277957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:25.277957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:25.277957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:25.277957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:25.277957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:25.277957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:25.277957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:25.277957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:25.277957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:25.277957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:25.277957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:25.277957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:25.277957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:25.277957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:25.279678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:25.279678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:25.279678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:25.279678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 437/882] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:25.285273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb5764-78a1-4db9-806e-6fa9838ae73e None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:25.288723 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882c15a-40de-4c2d-86b5-b9a3bec53ae3 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:25.335676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d532cfe-326f-44db-8ca5-9b8e7b03afa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:25.336379 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d532cfe-326f-44db-8ca5-9b8e7b03afa8 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:25.336665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d532cfe-326f-44db-8ca5-9b8e7b03afa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:25.336943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d532cfe-326f-44db-8ca5-9b8e7b03afa8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:25.337614 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d532cfe-326f-44db-8ca5-9b8e7b03afa8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:25.339221 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d532cfe-326f-44db-8ca5-9b8e7b03afa8 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:25.351976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-5d532cfe-326f-44db-8ca5-9b8e7b03afa8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 16:29:25.351976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:25.351976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:25.351976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:25.351976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:25.351976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:25.351976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:25.351976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:25.351976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 16:29:25.351976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:25.351976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:25.351976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:25.351976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:25.351976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:25.351976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:25.351976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:25.353825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:25.353825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:25.353825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:25.353825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:25.353825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:25.353825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:25.353825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:25.353825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:25.353825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:25.353825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:25.353825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:25.353825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:25.353825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:25.353825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:25.353825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:25.353825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:25.353825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:25.356359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:25.356359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:25.356359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:25.356359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:25.356359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:25.356359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:25.356359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:25.356359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:25.356359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:25.356359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:25.356359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:25.356359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:25.356359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 16:29:25.356359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:25.356359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 446/883] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Sep 7 16:29:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:25.363515 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d532cfe-326f-44db-8ca5-9b8e7b03afa8 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:25.427769 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:25.447699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882c15a-40de-4c2d-86b5-b9a3bec53ae3 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:25.493992 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e58a7-ac2b-4086-90d5-2c95c23191a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:25.494483 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d532cfe-326f-44db-8ca5-9b8e7b03afa8 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:25.495130 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e58a7-ac2b-4086-90d5-2c95c23191a6 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:25.495637 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e58a7-ac2b-4086-90d5-2c95c23191a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:25.496088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e58a7-ac2b-4086-90d5-2c95c23191a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:25.496930 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e58a7-ac2b-4086-90d5-2c95c23191a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:25.497420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e58a7-ac2b-4086-90d5-2c95c23191a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:25.499011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e58a7-ac2b-4086-90d5-2c95c23191a6 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:25.513470 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 438/884] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:25.523286 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e58a7-ac2b-4086-90d5-2c95c23191a6 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:25.540042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:25.547885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2430bcd-e4c0-4f2f-b88a-b03a285c1ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:25.548514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2430bcd-e4c0-4f2f-b88a-b03a285c1ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:25.548794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2430bcd-e4c0-4f2f-b88a-b03a285c1ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:25.549068 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2430bcd-e4c0-4f2f-b88a-b03a285c1ee2 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:25.549713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2430bcd-e4c0-4f2f-b88a-b03a285c1ee2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:25.550021 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2430bcd-e4c0-4f2f-b88a-b03a285c1ee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:25.552984 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2430bcd-e4c0-4f2f-b88a-b03a285c1ee2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:25.561419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 447/885] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Sep 7 16:29:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:25.567941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2430bcd-e4c0-4f2f-b88a-b03a285c1ee2 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:25.688900 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e58a7-ac2b-4086-90d5-2c95c23191a6 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:25.721187 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2430bcd-e4c0-4f2f-b88a-b03a285c1ee2 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:25.738429 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af7b18-07ca-4223-baca-b9de89fd64fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:25.739088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7b18-07ca-4223-baca-b9de89fd64fd None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:25.739370 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7b18-07ca-4223-baca-b9de89fd64fd None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:25.740223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7b18-07ca-4223-baca-b9de89fd64fd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:25.751536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af7b18-07ca-4223-baca-b9de89fd64fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:25.753610 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af7b18-07ca-4223-baca-b9de89fd64fd None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:25.766207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842aa218-34b6-4e10-ad7e-7ebb32789251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:25.767251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842aa218-34b6-4e10-ad7e-7ebb32789251 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:25.767820 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842aa218-34b6-4e10-ad7e-7ebb32789251 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:25.768368 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842aa218-34b6-4e10-ad7e-7ebb32789251 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:25.769265 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842aa218-34b6-4e10-ad7e-7ebb32789251 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:25.769502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-c9af7b18-07ca-4223-baca-b9de89fd64fd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 16:29:25.769502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:25.769502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:25.769502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:25.769502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:25.769502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:25.769502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:25.769502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:25.769502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:25.769502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:25.769502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:25.769502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:25.769502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:29:25.769502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:29:25.769502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:29:25.769502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:25.770399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:25.771557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:25.771557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:25.771557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:29:25.771557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:29:25.771557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:29:25.771557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:29:25.771557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:29:25.771557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:29:25.771557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 16:29:25.771557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:25.771557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 439/886] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Sep 7 16:29:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:25.773078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842aa218-34b6-4e10-ad7e-7ebb32789251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:25.774576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842aa218-34b6-4e10-ad7e-7ebb32789251 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:25.783537 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af7b18-07ca-4223-baca-b9de89fd64fd None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:25.784254 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 448/887] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Sep 7 16:29:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:25.798849 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:25.939796 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af7b18-07ca-4223-baca-b9de89fd64fd None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:26.007814 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2f2e3-0546-4505-b827-81f4d0a42da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:26.009380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2f2e3-0546-4505-b827-81f4d0a42da8 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:26.009897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2f2e3-0546-4505-b827-81f4d0a42da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:26.010391 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2f2e3-0546-4505-b827-81f4d0a42da8 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:26.011416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2f2e3-0546-4505-b827-81f4d0a42da8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:26.011998 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2f2e3-0546-4505-b827-81f4d0a42da8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:26.013782 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2f2e3-0546-4505-b827-81f4d0a42da8 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:26.038306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 440/888] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Sep 7 16:29:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:26.047384 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842aa218-34b6-4e10-ad7e-7ebb32789251 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:26.164112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:26.256817 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842aa218-34b6-4e10-ad7e-7ebb32789251 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:26.322928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed4ffa-cc0f-4d06-93b2-ea7345c5a866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:26.323856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed4ffa-cc0f-4d06-93b2-ea7345c5a866 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:26.324336 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed4ffa-cc0f-4d06-93b2-ea7345c5a866 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:26.324824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed4ffa-cc0f-4d06-93b2-ea7345c5a866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:26.342985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea17f4-1b0e-4bb5-b30e-447c5178b7f2 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:26.343300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea17f4-1b0e-4bb5-b30e-447c5178b7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:26.343566 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea17f4-1b0e-4bb5-b30e-447c5178b7f2 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:26.345256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 441/889] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:26.351798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce69fa-1ee9-44ab-a2bb-0e9bd3086e69 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:26.352091 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce69fa-1ee9-44ab-a2bb-0e9bd3086e69 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:26.352352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce69fa-1ee9-44ab-a2bb-0e9bd3086e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:26.372642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-35ce69fa-1ee9-44ab-a2bb-0e9bd3086e69 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:26.373930 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-35ce69fa-1ee9-44ab-a2bb-0e9bd3086e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:26.461710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:26.462068 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed4ffa-cc0f-4d06-93b2-ea7345c5a866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:26.464861 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed4ffa-cc0f-4d06-93b2-ea7345c5a866 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:26.479942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 442/890] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:26 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 16:29:26.554812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:26.605656 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 449/891] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:29:26 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:29:26.612689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce69fa-1ee9-44ab-a2bb-0e9bd3086e69 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:26.770862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce69fa-1ee9-44ab-a2bb-0e9bd3086e69 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:26.824034 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6987c4f-a18f-4186-908e-d6270b1945d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:26.824692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6987c4f-a18f-4186-908e-d6270b1945d1 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:26.824972 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6987c4f-a18f-4186-908e-d6270b1945d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:26.825247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6987c4f-a18f-4186-908e-d6270b1945d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:26.829002 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed4ffa-cc0f-4d06-93b2-ea7345c5a866 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:26.839392 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6987c4f-a18f-4186-908e-d6270b1945d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:26.841046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6987c4f-a18f-4186-908e-d6270b1945d1 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:26.866317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-e6987c4f-a18f-4186-908e-d6270b1945d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:26.866317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:26.866317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:26.866317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:26.866317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:26.866317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:26.866317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:26.866317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:26.866317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:26.866317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:26.866317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:26.866317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:26.866317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:26.866317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:26.866317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:26.866317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:26.867344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:26.867344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:26.867344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:26.867344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:26.867344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:26.867344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:26.867344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:26.867344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:26.867344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:26.867344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:26.867344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:26.867344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:26.867344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:26.867344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:26.867344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:26.867344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:26.867344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:26.868322 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:26.868322 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:26.868322 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:26.868322 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 443/892] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:26.879528 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6987c4f-a18f-4186-908e-d6270b1945d1 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:26.971113 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:26.978472 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed4ffa-cc0f-4d06-93b2-ea7345c5a866 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:27.022492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f69549-13fd-4e05-ba03-e627f343b1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:27.023134 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f69549-13fd-4e05-ba03-e627f343b1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:27.023420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f69549-13fd-4e05-ba03-e627f343b1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:27.023726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f69549-13fd-4e05-ba03-e627f343b1a1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:27.024315 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f69549-13fd-4e05-ba03-e627f343b1a1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:27.026268 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f69549-13fd-4e05-ba03-e627f343b1a1 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:27.036921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-e5f69549-13fd-4e05-ba03-e627f343b1a1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 16:29:27.036921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:27.036921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:27.036921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:27.036921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:27.036921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:27.036921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:27.036921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:27.036921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 16:29:27.036921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:27.036921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:27.036921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:27.036921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:27.036921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:27.036921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:27.036921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:27.036921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:27.039128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:27.039128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:27.039128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:27.039128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:27.039128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:27.039128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:27.039128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:27.039128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:27.039128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:27.039128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:27.039128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:27.039128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:27.039128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:27.039128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:27.039128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:27.039128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:27.040886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:27.040886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:27.040886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:27.040886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:27.040886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:27.040886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:27.040886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:27.040886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:27.040886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:27.040886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:27.040886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:27.040886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:27.040886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 16:29:27.040886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:27.040886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 450/893] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Sep 7 16:29:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:27.053652 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f69549-13fd-4e05-ba03-e627f343b1a1 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:27.063279 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6987c4f-a18f-4186-908e-d6270b1945d1 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:27.095086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:27.109655 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed6777-9508-42ea-a152-62484c2d1bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:27.110286 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed6777-9508-42ea-a152-62484c2d1bde None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:27.110567 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed6777-9508-42ea-a152-62484c2d1bde None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:27.110845 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed6777-9508-42ea-a152-62484c2d1bde None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:27.111520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed6777-9508-42ea-a152-62484c2d1bde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:27.111850 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed6777-9508-42ea-a152-62484c2d1bde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:27.113417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed6777-9508-42ea-a152-62484c2d1bde None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:27.139952 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 444/894] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:27.144485 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed6777-9508-42ea-a152-62484c2d1bde None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:27.211821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f69549-13fd-4e05-ba03-e627f343b1a1 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:27.255564 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b06e0-a6f6-46c0-b2ae-9f8acb57d7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:27.256207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b06e0-a6f6-46c0-b2ae-9f8acb57d7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:27.256493 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b06e0-a6f6-46c0-b2ae-9f8acb57d7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:27.256944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b06e0-a6f6-46c0-b2ae-9f8acb57d7b9 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:27.257615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b06e0-a6f6-46c0-b2ae-9f8acb57d7b9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:27.257922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b06e0-a6f6-46c0-b2ae-9f8acb57d7b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:27.259766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b06e0-a6f6-46c0-b2ae-9f8acb57d7b9 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:27.267528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 451/895] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Sep 7 16:29:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:27.277877 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b06e0-a6f6-46c0-b2ae-9f8acb57d7b9 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:27.318196 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed6777-9508-42ea-a152-62484c2d1bde None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:27.331757 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:27.367213 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc7649-0021-428a-bf3a-7e2ba3b65efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:27.368422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc7649-0021-428a-bf3a-7e2ba3b65efe None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:27.368907 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc7649-0021-428a-bf3a-7e2ba3b65efe None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:27.369779 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc7649-0021-428a-bf3a-7e2ba3b65efe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:27.385605 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc7649-0021-428a-bf3a-7e2ba3b65efe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:27.388565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc7649-0021-428a-bf3a-7e2ba3b65efe None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:27.409294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-b8dc7649-0021-428a-bf3a-7e2ba3b65efe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:27.409294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:27.409294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:27.409294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:27.409294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:27.409294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:27.409294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:27.409294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:27.409294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:27.409294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:27.409294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:27.409294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:27.409294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:29:27.409294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:29:27.409294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:29:27.410241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:29:27.410241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:27.410241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:27.410241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:27.410241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:27.410241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:27.410241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:27.410241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:27.410241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:27.410241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:27.410241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:27.410241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:27.410241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:27.410241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:27.410241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:27.410241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:27.410241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:27.411135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:29:27.411135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:29:27.411135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:29:27.411135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:29:27.411135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:29:27.411135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:29:27.411135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:27.411135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:27.411135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 445/896] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:27.424558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc7649-0021-428a-bf3a-7e2ba3b65efe None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:27.434201 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:27.471896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b06e0-a6f6-46c0-b2ae-9f8acb57d7b9 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:27.540717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee019b-e88c-4032-baca-8a1832b814e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:27.542375 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee019b-e88c-4032-baca-8a1832b814e2 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:27.542933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc7649-0021-428a-bf3a-7e2ba3b65efe None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:27.543462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee019b-e88c-4032-baca-8a1832b814e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:27.544241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee019b-e88c-4032-baca-8a1832b814e2 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:27.545673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee019b-e88c-4032-baca-8a1832b814e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:27.546498 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee019b-e88c-4032-baca-8a1832b814e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:27.549287 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee019b-e88c-4032-baca-8a1832b814e2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:27.568855 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 452/897] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Sep 7 16:29:27 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:27.587100 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4802d-5eed-4823-b457-501400ad3274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:27.587826 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4802d-5eed-4823-b457-501400ad3274 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:27.588107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4802d-5eed-4823-b457-501400ad3274 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:27.588422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4802d-5eed-4823-b457-501400ad3274 None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:27.589143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4802d-5eed-4823-b457-501400ad3274 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:27.589455 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4802d-5eed-4823-b457-501400ad3274 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:27.591013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4802d-5eed-4823-b457-501400ad3274 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:27.608247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 446/898] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:27.618504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee019b-e88c-4032-baca-8a1832b814e2 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:27.814170 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee019b-e88c-4032-baca-8a1832b814e2 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:27.853648 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53c3e8-5450-4787-b8c7-f707e901acd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:27.854268 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53c3e8-5450-4787-b8c7-f707e901acd0 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:27.854549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53c3e8-5450-4787-b8c7-f707e901acd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:27.854820 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53c3e8-5450-4787-b8c7-f707e901acd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:27.855644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53c3e8-5450-4787-b8c7-f707e901acd0 None admin] RBAC: Adding query filter params (role.id=9fea51971cb64ba480f210a7c4679c9c, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=87ba67fc171b4258b6fda72094ed11c3) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:27.855951 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53c3e8-5450-4787-b8c7-f707e901acd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:27.857392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53c3e8-5450-4787-b8c7-f707e901acd0 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:27.863947 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 453/899] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:29:27 2022] GET /identity/v3/role_assignments?user.id=87ba67fc171b4258b6fda72094ed11c3&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9fea51971cb64ba480f210a7c4679c9c => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:27.965549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18716386-8dd5-440e-b4d9-b680f354a515 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:27.966501 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18716386-8dd5-440e-b4d9-b680f354a515 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:27.967258 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18716386-8dd5-440e-b4d9-b680f354a515 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:27.970570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 447/900] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:27.980118 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a7850-1d01-4ebe-a4c8-d5f4fa178907 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:27.980417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a7850-1d01-4ebe-a4c8-d5f4fa178907 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:27.980731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a7850-1d01-4ebe-a4c8-d5f4fa178907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:28.000904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-684a7850-1d01-4ebe-a4c8-d5f4fa178907 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:28.002181 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-684a7850-1d01-4ebe-a4c8-d5f4fa178907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:28.007034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:28.133684 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 454/901] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:27 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 16:29:28.451263 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18716386-8dd5-440e-b4d9-b680f354a515 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:28.503942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:28.681003 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18716386-8dd5-440e-b4d9-b680f354a515 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:28.738960 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dbebf-189e-4c00-ba21-55213f5fbe67 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:28.742041 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dbebf-189e-4c00-ba21-55213f5fbe67 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:28.742041 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dbebf-189e-4c00-ba21-55213f5fbe67 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:28.742650 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 455/902] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:29:28.759122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ca47c-d6d0-4ead-9304-7f03f33ced66 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:28.759122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ca47c-d6d0-4ead-9304-7f03f33ced66 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:28.759122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ca47c-d6d0-4ead-9304-7f03f33ced66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:28.774863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86937643-2aad-4477-b0b0-ba9ff10a9773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:28.775546 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86937643-2aad-4477-b0b0-ba9ff10a9773 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:28.775831 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86937643-2aad-4477-b0b0-ba9ff10a9773 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:28.776134 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86937643-2aad-4477-b0b0-ba9ff10a9773 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:28.776735 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86937643-2aad-4477-b0b0-ba9ff10a9773 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:28.778184 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86937643-2aad-4477-b0b0-ba9ff10a9773 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:28.788968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-86937643-2aad-4477-b0b0-ba9ff10a9773 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 16:29:28.788968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:28.788968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:28.788968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:28.788968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:28.788968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:28.788968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:28.788968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:28.788968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 16:29:28.788968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:28.788968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:28.788968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:28.788968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:28.788968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:28.788968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:28.788968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:28.788968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:28.790928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:28.790928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:28.790928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:28.790928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:28.790928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:28.790928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:28.790928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:28.790928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:28.790928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:28.790928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:28.790928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:28.790928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:28.790928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:28.790928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:28.790928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:28.790928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:28.792671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:28.792671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:28.792671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:28.792671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:28.792671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:28.792671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:28.792671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:28.792671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:28.792671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:28.792671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:28.792671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:28.792671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:28.792671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 16:29:28.792671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:28.792671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 448/903] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:29:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:28.803829 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86937643-2aad-4477-b0b0-ba9ff10a9773 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:28.805967 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-6f3ca47c-d6d0-4ead-9304-7f03f33ced66 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:28.808782 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-6f3ca47c-d6d0-4ead-9304-7f03f33ced66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:28.946652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:28.952393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 456/904] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:28 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:28.967043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86937643-2aad-4477-b0b0-ba9ff10a9773 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:29.024991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af070084-6184-4aff-856e-e1f764763101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:29.026172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af070084-6184-4aff-856e-e1f764763101 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:29.026859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af070084-6184-4aff-856e-e1f764763101 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:29.027311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af070084-6184-4aff-856e-e1f764763101 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:29.028460 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af070084-6184-4aff-856e-e1f764763101 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:29.028975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af070084-6184-4aff-856e-e1f764763101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:29.031283 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af070084-6184-4aff-856e-e1f764763101 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:29.038333 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 449/905] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:29:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:29.045269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ca47c-d6d0-4ead-9304-7f03f33ced66 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:29.153926 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:29.209822 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ca47c-d6d0-4ead-9304-7f03f33ced66 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:29.234844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af070084-6184-4aff-856e-e1f764763101 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:29.284931 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffce39-1d30-40fd-9faf-e23347551324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:29.286526 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffce39-1d30-40fd-9faf-e23347551324 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:29.287281 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffce39-1d30-40fd-9faf-e23347551324 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:29.288126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffce39-1d30-40fd-9faf-e23347551324 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:29.289634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffce39-1d30-40fd-9faf-e23347551324 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:29.290523 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffce39-1d30-40fd-9faf-e23347551324 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:29.293497 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffce39-1d30-40fd-9faf-e23347551324 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:29.304184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 457/906] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Sep 7 16:29:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:29.315526 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffce39-1d30-40fd-9faf-e23347551324 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:29.426082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af070084-6184-4aff-856e-e1f764763101 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:29.471954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab840d14-5207-442e-8988-53c4f5dea47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:29.473051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab840d14-5207-442e-8988-53c4f5dea47c None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:29.473315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab840d14-5207-442e-8988-53c4f5dea47c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:29.473599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab840d14-5207-442e-8988-53c4f5dea47c None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:29.474865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab840d14-5207-442e-8988-53c4f5dea47c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:29.476285 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab840d14-5207-442e-8988-53c4f5dea47c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:29.511877 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffce39-1d30-40fd-9faf-e23347551324 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:29.554351 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 450/907] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Sep 7 16:29:29 2022] POST /identity/v3/services => generated 269 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:29:29.581766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:29.589013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d47760-35ef-425f-b9e3-66bdd229acef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:29.590099 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d47760-35ef-425f-b9e3-66bdd229acef None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:29.590540 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d47760-35ef-425f-b9e3-66bdd229acef None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:29.591446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d47760-35ef-425f-b9e3-66bdd229acef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:29.592430 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d47760-35ef-425f-b9e3-66bdd229acef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:29.594205 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d47760-35ef-425f-b9e3-66bdd229acef None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:29.710967 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 458/908] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:29:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:29:30.023431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac0fca-cbfe-4cf6-ab55-1584cb41b0ee None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:30.023750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac0fca-cbfe-4cf6-ab55-1584cb41b0ee None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:30.024017 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac0fca-cbfe-4cf6-ab55-1584cb41b0ee None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:30.025772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 451/909] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:30.031713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c40d6-e1b2-4893-bee6-44d57ce6ba9f None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:30.032489 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c40d6-e1b2-4893-bee6-44d57ce6ba9f None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:30.032489 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c40d6-e1b2-4893-bee6-44d57ce6ba9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:30.053331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-249c40d6-e1b2-4893-bee6-44d57ce6ba9f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:30.054557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-249c40d6-e1b2-4893-bee6-44d57ce6ba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:30.145194 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 459/910] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:30.428174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac0fca-cbfe-4cf6-ab55-1584cb41b0ee None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:30.450482 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:30.590870 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac0fca-cbfe-4cf6-ab55-1584cb41b0ee None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:30.631764 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7801a8-5beb-4beb-a383-bad9a76b2b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:30.632390 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7801a8-5beb-4beb-a383-bad9a76b2b71 None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:30.632668 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7801a8-5beb-4beb-a383-bad9a76b2b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:30.632958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7801a8-5beb-4beb-a383-bad9a76b2b71 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:30.633922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7801a8-5beb-4beb-a383-bad9a76b2b71 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:30.635825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7801a8-5beb-4beb-a383-bad9a76b2b71 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:30.778610 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 452/911] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Sep 7 16:29:30 2022] POST /identity/v3/services => generated 241 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:29:31.227778 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd17ca-504b-4d71-ab57-cdb5f0584cd0 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:31.228814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd17ca-504b-4d71-ab57-cdb5f0584cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:31.229417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd17ca-504b-4d71-ab57-cdb5f0584cd0 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:31.231946 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 460/912] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:29:31.238166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4477476-6f51-494f-a416-38745d01a10a None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:31.238758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4477476-6f51-494f-a416-38745d01a10a None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:31.239319 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4477476-6f51-494f-a416-38745d01a10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:31.259969 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-c4477476-6f51-494f-a416-38745d01a10a None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:31.261597 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c4477476-6f51-494f-a416-38745d01a10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:31.347250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 453/913] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 16:29:31.626630 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd17ca-504b-4d71-ab57-cdb5f0584cd0 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:31.759778 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd17ca-504b-4d71-ab57-cdb5f0584cd0 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:31.775893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:31.801013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff4995-11fb-4c26-b190-3bb4a358dc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:31.802173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff4995-11fb-4c26-b190-3bb4a358dc92 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:31.802468 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff4995-11fb-4c26-b190-3bb4a358dc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:31.802819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff4995-11fb-4c26-b190-3bb4a358dc92 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:31.817384 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff4995-11fb-4c26-b190-3bb4a358dc92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:29:31.822694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-4fff4995-11fb-4c26-b190-3bb4a358dc92 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 16:29:31.822694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:31.822694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:31.822694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:31.822694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:31.822694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:31.822694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:31.822694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:31.822694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:31.822694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:31.822694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:31.822694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:31.822694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:29:31.822694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:29:31.822694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:29:31.822694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:29:31.827550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:29:31.827550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:29:31.827550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:29:31.827550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:29:31.827550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:31.827550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:31.827550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:31.827550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:31.827550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:31.827550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:31.827550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:31.827550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:31.827550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:31.827550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:31.827550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:31.827550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:31.828403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:31.828403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:31.828403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:31.828403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:31.828403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:29:31.828403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:29:31.828403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:29:31.828403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:29:31.828403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:29:31.828403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:29:31.828403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 16:29:31.828403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:31.828403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 461/914] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Sep 7 16:29:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:31.830889 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4477476-6f51-494f-a416-38745d01a10a None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:31.835895 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:31.960208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4477476-6f51-494f-a416-38745d01a10a None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:32.001165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c12540-9ea5-4569-8eda-03584baa8a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:32.001874 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c12540-9ea5-4569-8eda-03584baa8a74 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:32.002155 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c12540-9ea5-4569-8eda-03584baa8a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:32.002432 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c12540-9ea5-4569-8eda-03584baa8a74 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:32.003176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c12540-9ea5-4569-8eda-03584baa8a74 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:32.003503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c12540-9ea5-4569-8eda-03584baa8a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:32.005481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c12540-9ea5-4569-8eda-03584baa8a74 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:32.021920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 454/915] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Sep 7 16:29:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:32.024625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff4995-11fb-4c26-b190-3bb4a358dc92 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:32.152042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff4995-11fb-4c26-b190-3bb4a358dc92 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:32.195795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7bb3a-ffe0-4921-a913-65a19466a850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:32.196621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7bb3a-ffe0-4921-a913-65a19466a850 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:32.198312 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7bb3a-ffe0-4921-a913-65a19466a850 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:32.198312 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7bb3a-ffe0-4921-a913-65a19466a850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:32.209757 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7bb3a-ffe0-4921-a913-65a19466a850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:32.211301 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7bb3a-ffe0-4921-a913-65a19466a850 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:32.228981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-40f7bb3a-ffe0-4921-a913-65a19466a850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:32.228981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:32.228981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:32.228981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:32.228981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:32.228981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:32.228981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:32.228981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:32.228981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:32.228981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:32.228981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:32.228981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:32.228981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:32.228981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:32.228981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:32.228981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:32.237156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:32.237156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:32.237156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:32.237156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:32.237156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:32.237156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:32.237156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:32.237156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:32.237156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:32.237156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:32.237156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:32.237156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:32.237156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:32.237156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:32.237156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:32.237156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:32.237156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:32.238524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:32.238524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:32.238524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:32.238524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 462/916] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:32.238753 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c12540-9ea5-4569-8eda-03584baa8a74 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:32.311922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:32.358153 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c12540-9ea5-4569-8eda-03584baa8a74 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:32.397010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ed64e-e55a-42d8-98b6-927d67c1aeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:32.398009 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed64e-e55a-42d8-98b6-927d67c1aeca None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:32.398498 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed64e-e55a-42d8-98b6-927d67c1aeca None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:32.398994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed64e-e55a-42d8-98b6-927d67c1aeca None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:32.399940 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ed64e-e55a-42d8-98b6-927d67c1aeca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:32.400459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ed64e-e55a-42d8-98b6-927d67c1aeca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:32.402088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ed64e-e55a-42d8-98b6-927d67c1aeca None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:32.416191 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 455/917] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:32.427536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7bb3a-ffe0-4921-a913-65a19466a850 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:32.433319 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2ece1-5891-4c20-b16d-d4f920cc96e9 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:32.433644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2ece1-5891-4c20-b16d-d4f920cc96e9 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:32.433868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2ece1-5891-4c20-b16d-d4f920cc96e9 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:32.435375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 456/918] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:29:32.441080 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cecf9-54bb-4cb2-917f-13681be02a6d None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:32.441369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cecf9-54bb-4cb2-917f-13681be02a6d None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:32.441622 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cecf9-54bb-4cb2-917f-13681be02a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:32.453934 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:32.461810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-966cecf9-54bb-4cb2-917f-13681be02a6d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:32.462961 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-966cecf9-54bb-4cb2-917f-13681be02a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:32.538023 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 457/919] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 16:29:32.550622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7bb3a-ffe0-4921-a913-65a19466a850 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:32.588588 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce0a68-19d9-4f7f-ac4a-9d3ef5b73ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:32.589475 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce0a68-19d9-4f7f-ac4a-9d3ef5b73ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:32.589901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce0a68-19d9-4f7f-ac4a-9d3ef5b73ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:32.590315 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce0a68-19d9-4f7f-ac4a-9d3ef5b73ff4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:32.600010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce0a68-19d9-4f7f-ac4a-9d3ef5b73ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:32.601753 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce0a68-19d9-4f7f-ac4a-9d3ef5b73ff4 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:32.614478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-d1ce0a68-19d9-4f7f-ac4a-9d3ef5b73ff4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 16:29:32.614478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:32.614478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:32.614478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:32.614478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:32.614478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:32.614478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:32.614478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:32.614478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:32.614478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:32.614478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:32.614478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:32.614478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:29:32.614478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:29:32.614478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:29:32.614478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:32.615676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:32.616884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:32.616884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:32.616884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:29:32.616884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:29:32.616884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:29:32.616884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:29:32.616884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:29:32.616884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:29:32.616884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 16:29:32.616884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:32.623112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 463/920] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Sep 7 16:29:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:32.625480 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cecf9-54bb-4cb2-917f-13681be02a6d None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:32.687729 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:32.741359 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cecf9-54bb-4cb2-917f-13681be02a6d None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:32.787314 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe22e2-ff29-4965-bc54-6f2206ea0054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:32.787970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe22e2-ff29-4965-bc54-6f2206ea0054 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:32.788241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe22e2-ff29-4965-bc54-6f2206ea0054 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:32.788506 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe22e2-ff29-4965-bc54-6f2206ea0054 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:32.789240 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe22e2-ff29-4965-bc54-6f2206ea0054 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:32.789540 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe22e2-ff29-4965-bc54-6f2206ea0054 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:32.790972 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe22e2-ff29-4965-bc54-6f2206ea0054 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:32.811212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 458/921] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Sep 7 16:29:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:32.816816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce0a68-19d9-4f7f-ac4a-9d3ef5b73ff4 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:32.867208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec37f9a-0716-4a85-9614-1223ed2bce0c None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:32.868218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec37f9a-0716-4a85-9614-1223ed2bce0c None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:32.868218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec37f9a-0716-4a85-9614-1223ed2bce0c None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:32.869528 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 459/922] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:29:32.875456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47488d19-a662-4b4f-a94e-bb9ff56e4d2c None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:32.875865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47488d19-a662-4b4f-a94e-bb9ff56e4d2c None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:32.876078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47488d19-a662-4b4f-a94e-bb9ff56e4d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:32.895860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-47488d19-a662-4b4f-a94e-bb9ff56e4d2c None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:32.897061 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-47488d19-a662-4b4f-a94e-bb9ff56e4d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:32.919610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:32.937792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce0a68-19d9-4f7f-ac4a-9d3ef5b73ff4 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:32.977976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce33a64-ad71-442d-a92a-30fc6ecae259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:32.978691 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce33a64-ad71-442d-a92a-30fc6ecae259 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:32.978976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce33a64-ad71-442d-a92a-30fc6ecae259 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:32.979253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce33a64-ad71-442d-a92a-30fc6ecae259 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:32.992169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce33a64-ad71-442d-a92a-30fc6ecae259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:32.993537 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce33a64-ad71-442d-a92a-30fc6ecae259 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:33.017306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-9ce33a64-ad71-442d-a92a-30fc6ecae259 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:33.017306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:33.017306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:33.017306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:33.017306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:33.017306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:33.017306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:33.017306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:33.017306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:33.017306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:33.017306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:33.017306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:33.017306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:33.017306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:33.017306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:33.017306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:33.018357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:33.018357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:33.018357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:33.018357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:33.018357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:33.018357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:33.018357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:33.018357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:33.018357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:33.018357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:33.018357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:33.018357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:33.018357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:33.018357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:33.018357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:33.018357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:33.018357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:33.019318 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:33.019318 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:33.019318 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:33.020053 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 464/923] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:33.021488 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce33a64-ad71-442d-a92a-30fc6ecae259 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:33.029406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 460/924] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 16:29:33.030920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47488d19-a662-4b4f-a94e-bb9ff56e4d2c None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:33.090951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:33.169544 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47488d19-a662-4b4f-a94e-bb9ff56e4d2c None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:33.219980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce33a64-ad71-442d-a92a-30fc6ecae259 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:33.221371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17af7f6-ef82-4a68-9bbc-005ec27fa4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:33.222267 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17af7f6-ef82-4a68-9bbc-005ec27fa4eb None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:33.222859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17af7f6-ef82-4a68-9bbc-005ec27fa4eb None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:33.226260 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17af7f6-ef82-4a68-9bbc-005ec27fa4eb None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:33.226788 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17af7f6-ef82-4a68-9bbc-005ec27fa4eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:33.227333 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17af7f6-ef82-4a68-9bbc-005ec27fa4eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:33.230074 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17af7f6-ef82-4a68-9bbc-005ec27fa4eb None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:33.249439 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 461/925] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:33.255352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17af7f6-ef82-4a68-9bbc-005ec27fa4eb None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:33.295113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9875e15-4123-4e35-a544-54a87fdeb5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:33.296182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9875e15-4123-4e35-a544-54a87fdeb5cb None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:33.296683 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9875e15-4123-4e35-a544-54a87fdeb5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:33.297173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9875e15-4123-4e35-a544-54a87fdeb5cb None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:33.298382 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9875e15-4123-4e35-a544-54a87fdeb5cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:33.301239 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9875e15-4123-4e35-a544-54a87fdeb5cb None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:33.306035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: WARNING keystone.server.flask.common [None req-b9875e15-4123-4e35-a544-54a87fdeb5cb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 07 16:29:33.313744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:33.376229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.sql.core [None req-b9875e15-4123-4e35-a544-54a87fdeb5cb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 16:29:33.376229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 07 16:29:33.376229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [parameters: {'id': 'd122d1e1cf854ab89eb7c3a6a259edc0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 07 16:29:33.376229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81877) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 16:29:33.392481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-b9875e15-4123-4e35-a544-54a87fdeb5cb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d122d1e1cf854ab89eb7c3a6a259edc0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d122d1e1cf854ab89eb7c3a6a259edc0. Sep 07 16:29:33.392481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:33.392481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 16:29:33.392481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 16:29:33.392481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 16:29:33.392481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 16:29:33.392481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 16:29:33.392481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 16:29:33.392481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 16:29:33.392481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application conn.query(q) Sep 07 16:29:33.392481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 16:29:33.392481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 16:29:33.392481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application result.read() Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 07 16:29:33.394300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 07 16:29:33.396783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 16:29:33.396783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application next(self.gen) Sep 07 16:29:33.396783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 16:29:33.396783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application yield resource Sep 07 16:29:33.396783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 16:29:33.396783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application next(self.gen) Sep 07 16:29:33.396783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 16:29:33.396783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 16:29:33.396783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 16:29:33.396783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 16:29:33.396783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 16:29:33.396783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise self.value Sep 07 16:29:33.396783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 16:29:33.396783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 16:29:33.396783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 16:29:33.396783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application session.commit() Sep 07 16:29:33.396783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 16:29:33.400286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 16:29:33.400286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 16:29:33.400286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 16:29:33.400286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 16:29:33.400286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self.session.flush() Sep 07 16:29:33.400286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 16:29:33.400286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 16:29:33.400286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 16:29:33.400286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 16:29:33.400286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 16:29:33.400286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application compat.raise_( Sep 07 16:29:33.400286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 16:29:33.400286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception Sep 07 16:29:33.400286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 16:29:33.400286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 16:29:33.400286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 16:29:33.400286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 16:29:33.402431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 16:29:33.402431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 16:29:33.402431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 16:29:33.402431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 16:29:33.402431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 07 16:29:33.402431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 07 16:29:33.402431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 16:29:33.402431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 16:29:33.402431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 16:29:33.402431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 16:29:33.402431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 16:29:33.402431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 16:29:33.402431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 16:29:33.402431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 16:29:33.402431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 16:29:33.404522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 16:29:33.404522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 16:29:33.404522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception Sep 07 16:29:33.404522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 16:29:33.404522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 16:29:33.404522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 16:29:33.404522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 16:29:33.404522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 16:29:33.404522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 16:29:33.404522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 16:29:33.404522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application conn.query(q) Sep 07 16:29:33.404522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 16:29:33.404522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 16:29:33.404522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 16:29:33.404522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application result.read() Sep 07 16:29:33.404522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 16:29:33.404522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 16:29:33.407326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 16:29:33.407326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 16:29:33.407326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 16:29:33.407326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 16:29:33.407326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 16:29:33.407326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 16:29:33.407326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 16:29:33.407326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 07 16:29:33.407326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [parameters: {'id': 'd122d1e1cf854ab89eb7c3a6a259edc0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 07 16:29:33.407326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 16:29:33.407326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:33.407326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:33.407326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:33.407326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:33.407326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 07 16:29:33.409092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 07 16:29:33.409092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 16:29:33.409092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 16:29:33.409092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 07 16:29:33.409092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:33.409092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:33.409092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:33.409092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:33.409092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:33.409092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:33.409092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:33.409092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:33.409092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:33.409092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:33.409092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:33.409092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:33.409092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:33.411759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:33.411759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 07 16:29:33.411759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 07 16:29:33.411759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:33.411759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:33.411759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 07 16:29:33.411759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 07 16:29:33.411759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d122d1e1cf854ab89eb7c3a6a259edc0. Sep 07 16:29:33.411759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:33.411759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 465/926] 10.222.0.25 () {60 vars in 1140 bytes} [Wed Sep 7 16:29:33 2022] POST /identity/v3/projects => generated 262 bytes in 374 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:33.411759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9875e15-4123-4e35-a544-54a87fdeb5cb None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:33.435058 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17af7f6-ef82-4a68-9bbc-005ec27fa4eb None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:33.436846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:33.476745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c1c20-5195-4d8e-b456-7ad6b2c11524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:33.477812 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c1c20-5195-4d8e-b456-7ad6b2c11524 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:33.478310 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c1c20-5195-4d8e-b456-7ad6b2c11524 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:33.478795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c1c20-5195-4d8e-b456-7ad6b2c11524 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:33.490469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c1c20-5195-4d8e-b456-7ad6b2c11524 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:33.492022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c1c20-5195-4d8e-b456-7ad6b2c11524 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:33.504123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-234c1c20-5195-4d8e-b456-7ad6b2c11524 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:33.504123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:33.504123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:33.504123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:33.504123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:33.504123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:33.504123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:33.504123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:33.504123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:33.504123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:33.504123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:33.504123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:33.504123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:29:33.504123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:29:33.504123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:29:33.507012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:29:33.507012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:33.507012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:33.507012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:33.507012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:33.507012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:33.507012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:33.507012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:33.507012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:33.507012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:33.507012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:33.507012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:33.507012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:33.507012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:33.507012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:33.507012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:33.507012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:33.508828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:29:33.508828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:29:33.508828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:29:33.508828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:29:33.508828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:29:33.508828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:29:33.508828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:33.508828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:33.508828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 462/927] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:33.508828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca6bc9-005f-4ab5-958c-d74d8c5f3fd0 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:33.508828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca6bc9-005f-4ab5-958c-d74d8c5f3fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:33.510024 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca6bc9-005f-4ab5-958c-d74d8c5f3fd0 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:33.510024 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 463/928] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:33.510024 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca6bc9-005f-4ab5-958c-d74d8c5f3fd0 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:33.539682 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9875e15-4123-4e35-a544-54a87fdeb5cb None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:33.593807 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc00f1c-99e5-41c3-8872-6de3f2945cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:33.594631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc00f1c-99e5-41c3-8872-6de3f2945cab None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:33.595090 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc00f1c-99e5-41c3-8872-6de3f2945cab None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:33.595438 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc00f1c-99e5-41c3-8872-6de3f2945cab None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:33.596415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc00f1c-99e5-41c3-8872-6de3f2945cab None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:33.598285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc00f1c-99e5-41c3-8872-6de3f2945cab None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:33.609241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-afc00f1c-99e5-41c3-8872-6de3f2945cab None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 16:29:33.609241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:33.609241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:33.609241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:33.609241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:33.609241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:33.609241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:33.609241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:33.609241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 16:29:33.609241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:33.609241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:33.609241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:33.609241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:33.609241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:33.609241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:33.609241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:33.610413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:33.610413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:33.610413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:33.610413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:33.610413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:33.610413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:33.610413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:33.610413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:33.610413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:33.610413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:33.610413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:33.610413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:33.610413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:33.610413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:33.610413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:33.610413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:33.610413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:33.611332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:33.611332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:33.611332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:33.611332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:33.611332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:33.611332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:33.611332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:33.611332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:33.611332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:33.611332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:33.611332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:33.611332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:33.611332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 16:29:33.611332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:33.611332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 466/929] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Sep 7 16:29:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:33.612589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc00f1c-99e5-41c3-8872-6de3f2945cab None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:33.679658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca6bc9-005f-4ab5-958c-d74d8c5f3fd0 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:33.695182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:33.723375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7327c-fb96-40e1-b89d-452c715c3e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:33.724614 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7327c-fb96-40e1-b89d-452c715c3e73 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:33.724614 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7327c-fb96-40e1-b89d-452c715c3e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:33.724937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7327c-fb96-40e1-b89d-452c715c3e73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:33.734389 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7327c-fb96-40e1-b89d-452c715c3e73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:33.736840 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7327c-fb96-40e1-b89d-452c715c3e73 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:33.758410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-97b7327c-fb96-40e1-b89d-452c715c3e73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:33.758410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:33.758410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:33.758410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:33.758410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:33.758410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:33.758410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:33.758410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:33.758410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:33.758410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:33.758410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:33.758410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:33.758410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:29:33.758410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:29:33.758410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:29:33.760204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:29:33.760204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:33.760204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:33.760204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:33.760204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:33.760204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:33.760204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:33.760204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:33.760204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:33.760204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:33.760204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:33.760204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:33.760204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:33.760204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:33.760204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:33.760204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:33.760204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:33.767149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:29:33.767149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:29:33.767149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:29:33.767149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:29:33.767149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:29:33.767149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:29:33.767149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:33.767149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:33.767963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc00f1c-99e5-41c3-8872-6de3f2945cab None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:33.768107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 464/930] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:33.768107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dc954-9497-4d2e-9acd-077a59fec0bc None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:33.768107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dc954-9497-4d2e-9acd-077a59fec0bc None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:33.768107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dc954-9497-4d2e-9acd-077a59fec0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:33.787766 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-9e3dc954-9497-4d2e-9acd-077a59fec0bc None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:33.789234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9e3dc954-9497-4d2e-9acd-077a59fec0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:33.812455 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:33.816065 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c6ca8-c32c-43a6-a541-094d2e57783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:33.816930 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c6ca8-c32c-43a6-a541-094d2e57783a None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:33.823397 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c6ca8-c32c-43a6-a541-094d2e57783a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:33.823397 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c6ca8-c32c-43a6-a541-094d2e57783a None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:33.823397 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c6ca8-c32c-43a6-a541-094d2e57783a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:33.823397 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c6ca8-c32c-43a6-a541-094d2e57783a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:33.823397 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c6ca8-c32c-43a6-a541-094d2e57783a None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:33.843857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 467/931] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:29:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:33.844959 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c6ca8-c32c-43a6-a541-094d2e57783a None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:33.890038 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 465/932] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:33.891508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dc954-9497-4d2e-9acd-077a59fec0bc None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:34.009789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c6ca8-c32c-43a6-a541-094d2e57783a None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:34.037680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:34.068000 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d052e-f5c9-4e3b-9431-45644bab4f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:34.069042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d052e-f5c9-4e3b-9431-45644bab4f21 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:34.069900 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d052e-f5c9-4e3b-9431-45644bab4f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:34.070704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d052e-f5c9-4e3b-9431-45644bab4f21 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:34.072354 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d052e-f5c9-4e3b-9431-45644bab4f21 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:34.073087 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d052e-f5c9-4e3b-9431-45644bab4f21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:34.076259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d052e-f5c9-4e3b-9431-45644bab4f21 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:34.091541 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 468/933] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Sep 7 16:29:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:34.091541 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d052e-f5c9-4e3b-9431-45644bab4f21 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:34.091977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dc954-9497-4d2e-9acd-077a59fec0bc None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:34.152428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb5e36-d11e-4ee8-9562-19a761ac8599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:34.153414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb5e36-d11e-4ee8-9562-19a761ac8599 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:34.153880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb5e36-d11e-4ee8-9562-19a761ac8599 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:34.154370 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb5e36-d11e-4ee8-9562-19a761ac8599 None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:34.155618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb5e36-d11e-4ee8-9562-19a761ac8599 None admin] RBAC: Adding query filter params (name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:34.156183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb5e36-d11e-4ee8-9562-19a761ac8599 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:34.158837 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb5e36-d11e-4ee8-9562-19a761ac8599 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:34.194577 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 466/934] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Sep 7 16:29:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:34.196103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb5e36-d11e-4ee8-9562-19a761ac8599 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:34.224193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:34.253923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d052e-f5c9-4e3b-9431-45644bab4f21 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:34.321258 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa3a63-7987-40db-b3ab-79ae79039634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:34.322270 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa3a63-7987-40db-b3ab-79ae79039634 None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:34.322694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa3a63-7987-40db-b3ab-79ae79039634 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:34.323193 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa3a63-7987-40db-b3ab-79ae79039634 None admin] PATH_INFO: `/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/87ba67fc171b4258b6fda72094ed11c3/roles/9fea51971cb64ba480f210a7c4679c9c` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:34.327195 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa3a63-7987-40db-b3ab-79ae79039634 None admin] RBAC: Authorizing `identity:create_grant(project_id=1180c1ddef2b493f83c41425fd2e7917, user_id=87ba67fc171b4258b6fda72094ed11c3, role_id=9fea51971cb64ba480f210a7c4679c9c)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:34.329736 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa3a63-7987-40db-b3ab-79ae79039634 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:34.357454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb5e36-d11e-4ee8-9562-19a761ac8599 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:34.403681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f3c94-48b7-4ae7-8969-cdc70d96f8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:34.404310 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f3c94-48b7-4ae7-8969-cdc70d96f8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:34.404589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f3c94-48b7-4ae7-8969-cdc70d96f8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:34.404858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f3c94-48b7-4ae7-8969-cdc70d96f8c2 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:34.405494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f3c94-48b7-4ae7-8969-cdc70d96f8c2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:34.405794 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f3c94-48b7-4ae7-8969-cdc70d96f8c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:34.407176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f3c94-48b7-4ae7-8969-cdc70d96f8c2 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:34.416254 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 467/935] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Sep 7 16:29:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:34.417726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f3c94-48b7-4ae7-8969-cdc70d96f8c2 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:34.467935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 469/936] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:29:34 2022] PUT /identity/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/87ba67fc171b4258b6fda72094ed11c3/roles/9fea51971cb64ba480f210a7c4679c9c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:29:34.469793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa3a63-7987-40db-b3ab-79ae79039634 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:34.537046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:34.569570 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:34.590869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f3c94-48b7-4ae7-8969-cdc70d96f8c2 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:34.659312 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e5687-e5f0-4b97-a148-3d50ce6bbfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:34.660576 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e5687-e5f0-4b97-a148-3d50ce6bbfa0 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:34.661092 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e5687-e5f0-4b97-a148-3d50ce6bbfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:34.662395 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e5687-e5f0-4b97-a148-3d50ce6bbfa0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:34.663407 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e5687-e5f0-4b97-a148-3d50ce6bbfa0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:34.665891 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e5687-e5f0-4b97-a148-3d50ce6bbfa0 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:34.686179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-f35e5687-e5f0-4b97-a148-3d50ce6bbfa0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 16:29:34.686179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:34.686179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:34.686179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:34.686179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:34.686179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:34.686179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:34.686179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:34.686179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 16:29:34.686179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:34.686179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:34.686179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:34.686179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:34.686179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:34.686179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:34.686179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:34.686179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:34.688368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:34.688368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:34.688368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:34.688368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:34.688368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:34.688368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:34.688368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:34.688368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:34.688368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:34.688368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:34.688368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:34.688368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:34.688368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:34.688368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:34.688368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:34.688368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:34.689981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:34.689981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:34.689981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:34.689981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:34.689981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:34.689981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:34.689981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:34.689981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:34.689981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:34.689981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:34.689981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:34.689981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:34.689981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 16:29:34.689981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:34.689981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 468/937] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Sep 7 16:29:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:34.699892 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e5687-e5f0-4b97-a148-3d50ce6bbfa0 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:34.705386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa3a63-7987-40db-b3ab-79ae79039634 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:34.755631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc762532-7182-4ef8-8dea-e4e38cae1a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:34.756604 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc762532-7182-4ef8-8dea-e4e38cae1a46 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:34.756882 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc762532-7182-4ef8-8dea-e4e38cae1a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:34.757292 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc762532-7182-4ef8-8dea-e4e38cae1a46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:34.758673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc762532-7182-4ef8-8dea-e4e38cae1a46 None admin] RBAC: Adding query filter params (interface=public, service_id=800c5ac37b5c4ae38ccc746a079bb87c, region_id=RegionOne) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:34.759004 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc762532-7182-4ef8-8dea-e4e38cae1a46 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:34.760789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc762532-7182-4ef8-8dea-e4e38cae1a46 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:34.768703 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 470/938] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Sep 7 16:29:34 2022] GET /identity/v3/endpoints?service_id=800c5ac37b5c4ae38ccc746a079bb87c&interface=public®ion_id=RegionOne => generated 194 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:34.776311 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc762532-7182-4ef8-8dea-e4e38cae1a46 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:34.862784 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e5687-e5f0-4b97-a148-3d50ce6bbfa0 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:34.907118 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83becd-df8f-4d5c-85fe-b7b7d70ff893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:34.908173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83becd-df8f-4d5c-85fe-b7b7d70ff893 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:34.908173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83becd-df8f-4d5c-85fe-b7b7d70ff893 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:34.908447 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83becd-df8f-4d5c-85fe-b7b7d70ff893 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:34.908910 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83becd-df8f-4d5c-85fe-b7b7d70ff893 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:34.909211 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83becd-df8f-4d5c-85fe-b7b7d70ff893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:34.910633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83becd-df8f-4d5c-85fe-b7b7d70ff893 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:34.918080 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 469/939] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Sep 7 16:29:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:34.929233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83becd-df8f-4d5c-85fe-b7b7d70ff893 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:34.936053 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:34.963850 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc762532-7182-4ef8-8dea-e4e38cae1a46 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:34.967452 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:35.016034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b7a0b-ae52-4365-b09e-c500e9a7216b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:35.016663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b7a0b-ae52-4365-b09e-c500e9a7216b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:35.016941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b7a0b-ae52-4365-b09e-c500e9a7216b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:35.017218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b7a0b-ae52-4365-b09e-c500e9a7216b None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:35.018312 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b7a0b-ae52-4365-b09e-c500e9a7216b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:35.022711 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b7a0b-ae52-4365-b09e-c500e9a7216b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:35.030025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 471/940] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Sep 7 16:29:34 2022] GET /identity/v3/services => generated 1497 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:29:35.169841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83becd-df8f-4d5c-85fe-b7b7d70ff893 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:35.237934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5df2a9-0508-4e6c-b611-2361faaee12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:35.238701 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5df2a9-0508-4e6c-b611-2361faaee12a None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:35.241998 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5df2a9-0508-4e6c-b611-2361faaee12a None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:35.241998 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5df2a9-0508-4e6c-b611-2361faaee12a None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:35.241998 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5df2a9-0508-4e6c-b611-2361faaee12a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:35.241998 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5df2a9-0508-4e6c-b611-2361faaee12a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:35.242599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5df2a9-0508-4e6c-b611-2361faaee12a None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:35.250558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 470/941] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Sep 7 16:29:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:35.257510 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b7a0b-ae52-4365-b09e-c500e9a7216b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:35.428973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b7a0b-ae52-4365-b09e-c500e9a7216b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:35.496013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13428a3c-3a01-409c-8400-f1ca5716f32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:35.497181 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13428a3c-3a01-409c-8400-f1ca5716f32a None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:35.497680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13428a3c-3a01-409c-8400-f1ca5716f32a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:35.498170 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13428a3c-3a01-409c-8400-f1ca5716f32a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:35.499558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13428a3c-3a01-409c-8400-f1ca5716f32a None admin] RBAC: Adding query filter params (interface=public, service_id=89386dc7710849318fd6de0635f5cd8b, region_id=RegionOne) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:35.500114 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13428a3c-3a01-409c-8400-f1ca5716f32a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:35.502783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13428a3c-3a01-409c-8400-f1ca5716f32a None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:35.512789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 472/942] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Sep 7 16:29:35 2022] GET /identity/v3/endpoints?service_id=89386dc7710849318fd6de0635f5cd8b&interface=public®ion_id=RegionOne => generated 194 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:35.522534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5df2a9-0508-4e6c-b611-2361faaee12a None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:35.655738 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:35.721334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5df2a9-0508-4e6c-b611-2361faaee12a None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:35.760551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c315ad-465a-4af3-b7cf-b554f64de4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:35.761189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c315ad-465a-4af3-b7cf-b554f64de4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:35.761471 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c315ad-465a-4af3-b7cf-b554f64de4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:35.761748 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c315ad-465a-4af3-b7cf-b554f64de4e9 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:35.762360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c315ad-465a-4af3-b7cf-b554f64de4e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:35.763817 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c315ad-465a-4af3-b7cf-b554f64de4e9 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:35.772351 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 471/943] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Sep 7 16:29:35 2022] GET /identity/v3/services => generated 1497 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:29:36.914759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8625c1-67c1-4101-be22-67e6c9f50349 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:36.915563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8625c1-67c1-4101-be22-67e6c9f50349 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:36.915563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8625c1-67c1-4101-be22-67e6c9f50349 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:36.917203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 473/944] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:29:36.922949 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec256a-3a11-4f87-baca-d549f1521640 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:36.923710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec256a-3a11-4f87-baca-d549f1521640 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:36.923710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec256a-3a11-4f87-baca-d549f1521640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:36.943525 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-fcec256a-3a11-4f87-baca-d549f1521640 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:36.944741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-fcec256a-3a11-4f87-baca-d549f1521640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:37.027330 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 472/945] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:37.195744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff24c4c-9923-4285-b246-e784a648ac53 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:37.195988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff24c4c-9923-4285-b246-e784a648ac53 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:37.196337 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff24c4c-9923-4285-b246-e784a648ac53 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:37.197989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 474/946] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:37.204003 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30b421-ad6e-422c-b9de-eac9ec017c71 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:37.204335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30b421-ad6e-422c-b9de-eac9ec017c71 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:37.204617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30b421-ad6e-422c-b9de-eac9ec017c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:37.226733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8c30b421-ad6e-422c-b9de-eac9ec017c71 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:37.228018 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8c30b421-ad6e-422c-b9de-eac9ec017c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:37.297344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:37.309359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff24c4c-9923-4285-b246-e784a648ac53 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:37.315595 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 473/947] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:37.360038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:37.496758 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff24c4c-9923-4285-b246-e784a648ac53 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:37.560474 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab320b77-9558-46fb-8498-32c3976c94e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:37.561662 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab320b77-9558-46fb-8498-32c3976c94e5 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:37.562177 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab320b77-9558-46fb-8498-32c3976c94e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:37.562677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab320b77-9558-46fb-8498-32c3976c94e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:37.588893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab320b77-9558-46fb-8498-32c3976c94e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:29:37.599173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-ab320b77-9558-46fb-8498-32c3976c94e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 16:29:37.599173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:37.599173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:37.599173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:37.599173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:37.599173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:37.599173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:37.599173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:37.599173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:37.599173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:37.599173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:37.599173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:37.599173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:29:37.599173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:29:37.599173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:29:37.599173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:29:37.600988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:29:37.600988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:29:37.600988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:29:37.600988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:29:37.600988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:37.600988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:37.600988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:37.600988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:37.600988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:37.600988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:37.600988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:37.600988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:37.600988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:37.600988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:37.600988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:37.600988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:37.602638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:37.602638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:37.602638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:37.602638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:37.602638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:29:37.602638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:29:37.602638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:29:37.602638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:29:37.602638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:29:37.602638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:29:37.602638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 16:29:37.602638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:37.602638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 475/948] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Sep 7 16:29:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:37.611361 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30b421-ad6e-422c-b9de-eac9ec017c71 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:37.647747 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab320b77-9558-46fb-8498-32c3976c94e5 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:37.763080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:37.773916 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab320b77-9558-46fb-8498-32c3976c94e5 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:37.815920 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcac4d6-fe56-4a82-ad21-a3458c6a53d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:37.816942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcac4d6-fe56-4a82-ad21-a3458c6a53d5 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:37.818168 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcac4d6-fe56-4a82-ad21-a3458c6a53d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:37.818497 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30b421-ad6e-422c-b9de-eac9ec017c71 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:37.818936 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcac4d6-fe56-4a82-ad21-a3458c6a53d5 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:37.819777 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcac4d6-fe56-4a82-ad21-a3458c6a53d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:37.821419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcac4d6-fe56-4a82-ad21-a3458c6a53d5 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:37.873569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.sql.core [None req-ddcac4d6-fe56-4a82-ad21-a3458c6a53d5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 16:29:37.873569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 07 16:29:37.873569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [parameters: {'user_id': '3978cce8b2564547b4f00ea0a0282aee', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 07 16:29:37.873569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81877) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 16:29:37.880288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5d69c-f01a-40fd-89ba-7f596bc203dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:37.881357 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5d69c-f01a-40fd-89ba-7f596bc203dd None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:37.881830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5d69c-f01a-40fd-89ba-7f596bc203dd None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:37.882290 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5d69c-f01a-40fd-89ba-7f596bc203dd None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:37.883579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5d69c-f01a-40fd-89ba-7f596bc203dd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:37.884089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5d69c-f01a-40fd-89ba-7f596bc203dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:37.885957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-ddcac4d6-fe56-4a82-ad21-a3458c6a53d5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 07 16:29:37.885957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:37.885957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 16:29:37.885957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 16:29:37.885957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 16:29:37.885957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 16:29:37.885957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 16:29:37.885957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 16:29:37.885957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 16:29:37.885957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application conn.query(q) Sep 07 16:29:37.885957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 16:29:37.885957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 16:29:37.885957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 16:29:37.885957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application result.read() Sep 07 16:29:37.885957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 16:29:37.886867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application next(self.gen) Sep 07 16:29:37.887908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 16:29:37.887908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application yield resource Sep 07 16:29:37.887908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 16:29:37.887908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application next(self.gen) Sep 07 16:29:37.887908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 16:29:37.887908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 16:29:37.887908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 16:29:37.887908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 16:29:37.887908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 16:29:37.887908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise self.value Sep 07 16:29:37.887908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 16:29:37.887908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 16:29:37.887908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 16:29:37.887908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application session.commit() Sep 07 16:29:37.887908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 16:29:37.887908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 16:29:37.887908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 16:29:37.888972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 16:29:37.888972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 16:29:37.888972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self.session.flush() Sep 07 16:29:37.888972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 16:29:37.888972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 16:29:37.888972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 16:29:37.888972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 16:29:37.888972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 16:29:37.888972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application compat.raise_( Sep 07 16:29:37.888972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 16:29:37.888972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception Sep 07 16:29:37.888972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 16:29:37.888972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 16:29:37.888972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 16:29:37.888972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 16:29:37.888972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 16:29:37.888972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 16:29:37.889869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 16:29:37.889869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 16:29:37.889869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 07 16:29:37.889869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 07 16:29:37.889869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 16:29:37.889869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 16:29:37.889869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 16:29:37.889869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 16:29:37.889869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 16:29:37.889869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 16:29:37.889869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 16:29:37.889869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 16:29:37.889869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 16:29:37.889869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 16:29:37.889869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 16:29:37.889869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception Sep 07 16:29:37.890739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 16:29:37.890739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 16:29:37.890739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 16:29:37.890739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 16:29:37.890739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 16:29:37.890739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 16:29:37.890739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 16:29:37.890739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application conn.query(q) Sep 07 16:29:37.890739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 16:29:37.890739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 16:29:37.890739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 16:29:37.890739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application result.read() Sep 07 16:29:37.890739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 16:29:37.890739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 16:29:37.890739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 16:29:37.890739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 16:29:37.894309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 16:29:37.894309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 16:29:37.894309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 16:29:37.894309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 16:29:37.894309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 16:29:37.894309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 07 16:29:37.894309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [parameters: {'user_id': '3978cce8b2564547b4f00ea0a0282aee', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 07 16:29:37.894309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 16:29:37.894309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:37.894309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:37.894309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:37.894309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:37.894309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:37.894309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:37.894309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:37.898112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:37.898112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:37.898112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:37.898112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:37.898112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:37.898112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:37.898112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:37.898112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 07 16:29:37.898112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 07 16:29:37.898112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:37.898112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:37.898112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:29:37.898112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:37.898112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:29:37.898112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:37.898112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 07 16:29:37.898112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 07 16:29:37.901356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 07 16:29:37.901356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 07 16:29:37.901356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 16:29:37.901356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 16:29:37.901356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 07 16:29:37.901356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:37.903276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5d69c-f01a-40fd-89ba-7f596bc203dd None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:37.903276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 474/949] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Sep 7 16:29:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:37.903530 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 476/950] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Sep 7 16:29:37 2022] POST /identity/v3/users => generated 160 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:37.908676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5d69c-f01a-40fd-89ba-7f596bc203dd None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:37.912036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcac4d6-fe56-4a82-ad21-a3458c6a53d5 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:38.028316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:38.143287 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5d69c-f01a-40fd-89ba-7f596bc203dd None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:38.186964 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcac4d6-fe56-4a82-ad21-a3458c6a53d5 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:38.217920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e6d6e-7d28-4231-ba36-b55f87fb23c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:38.219989 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e6d6e-7d28-4231-ba36-b55f87fb23c4 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:38.220924 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e6d6e-7d28-4231-ba36-b55f87fb23c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:38.222139 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e6d6e-7d28-4231-ba36-b55f87fb23c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:38.241228 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e6d6e-7d28-4231-ba36-b55f87fb23c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:38.245953 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e6d6e-7d28-4231-ba36-b55f87fb23c4 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:38.246755 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7303d53-9ee1-42c1-ad2e-bb12c0707944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:38.247643 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7303d53-9ee1-42c1-ad2e-bb12c0707944 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:38.248125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7303d53-9ee1-42c1-ad2e-bb12c0707944 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:38.248593 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7303d53-9ee1-42c1-ad2e-bb12c0707944 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:38.257868 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7303d53-9ee1-42c1-ad2e-bb12c0707944 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:38.259577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7303d53-9ee1-42c1-ad2e-bb12c0707944 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:38.272883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-d7303d53-9ee1-42c1-ad2e-bb12c0707944 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 16:29:38.272883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:38.272883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:38.272883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:38.272883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:38.272883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:38.272883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:38.272883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:38.272883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:38.272883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:38.272883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:38.272883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:38.272883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:29:38.272883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:29:38.272883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:29:38.272883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:38.274793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:38.285735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:38.285735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:38.285735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:29:38.285735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:29:38.285735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:29:38.285735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:29:38.285735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:29:38.285735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:29:38.285735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 16:29:38.285735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:38.288099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-4e9e6d6e-7d28-4231-ba36-b55f87fb23c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:38.288099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:38.288099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:38.288099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:38.288099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:38.288099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:38.288099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:38.288099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:38.288099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:38.288099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:38.288099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:38.288099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:38.288099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:38.288099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:38.288099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:38.288099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:38.290644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:38.290644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:38.290644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:38.290644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:38.290644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:38.290644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:38.290644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:38.290644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:38.290644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:38.290644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:38.290644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:38.290644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:38.290644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:38.290644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:38.290644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:38.290644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:38.290644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:38.293219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:38.293219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:38.293219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:38.294722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 477/951] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:29:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:38.294722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab3a54-f5bb-4d26-8fb4-56824424e867 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:38.294722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab3a54-f5bb-4d26-8fb4-56824424e867 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:38.294722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab3a54-f5bb-4d26-8fb4-56824424e867 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:38.295291 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 475/952] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:38.295291 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e6d6e-7d28-4231-ba36-b55f87fb23c4 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:38.295634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 478/953] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:38.295634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab3a54-f5bb-4d26-8fb4-56824424e867 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:38.309329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:38.459961 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab3a54-f5bb-4d26-8fb4-56824424e867 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:38.470960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e6d6e-7d28-4231-ba36-b55f87fb23c4 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:38.481367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:38.523774 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa96d09-8017-4c0f-a837-25c231923eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:38.524528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1bc29-8584-4544-ab33-d16c764310e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:38.524805 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa96d09-8017-4c0f-a837-25c231923eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:38.525296 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa96d09-8017-4c0f-a837-25c231923eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:38.525572 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1bc29-8584-4544-ab33-d16c764310e5 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:38.525770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa96d09-8017-4c0f-a837-25c231923eb0 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:38.526029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1bc29-8584-4544-ab33-d16c764310e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:38.526475 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1bc29-8584-4544-ab33-d16c764310e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:38.527000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa96d09-8017-4c0f-a837-25c231923eb0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:38.527460 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa96d09-8017-4c0f-a837-25c231923eb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:38.527602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1bc29-8584-4544-ab33-d16c764310e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:38.528055 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1bc29-8584-4544-ab33-d16c764310e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:38.530097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa96d09-8017-4c0f-a837-25c231923eb0 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:38.530607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1bc29-8584-4544-ab33-d16c764310e5 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:38.558358 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 479/954] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:38.558358 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cd996-c6c1-4b66-a50a-bbd475ecf621 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:38.558358 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cd996-c6c1-4b66-a50a-bbd475ecf621 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:38.558358 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cd996-c6c1-4b66-a50a-bbd475ecf621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:38.589909 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-277cd996-c6c1-4b66-a50a-bbd475ecf621 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:38.592729 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-277cd996-c6c1-4b66-a50a-bbd475ecf621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:38.608461 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 476/955] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Sep 7 16:29:38 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:38.608461 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa96d09-8017-4c0f-a837-25c231923eb0 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:38.744522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 480/956] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:38.837375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa96d09-8017-4c0f-a837-25c231923eb0 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:38.889029 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c3cda-e058-47d4-a4a0-2c7734bda7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:38.889690 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c3cda-e058-47d4-a4a0-2c7734bda7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:38.889979 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c3cda-e058-47d4-a4a0-2c7734bda7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:38.890251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c3cda-e058-47d4-a4a0-2c7734bda7c8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:38.899581 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c3cda-e058-47d4-a4a0-2c7734bda7c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:38.901061 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c3cda-e058-47d4-a4a0-2c7734bda7c8 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:38.915708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-e79c3cda-e058-47d4-a4a0-2c7734bda7c8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 16:29:38.915708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:38.915708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:38.915708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:38.915708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:38.915708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:38.915708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:38.915708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:38.915708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:38.915708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:38.915708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:38.915708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:38.915708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:29:38.915708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:29:38.915708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:29:38.915708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:38.916713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:38.917671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:38.917671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:38.917671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:29:38.917671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:29:38.917671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:29:38.917671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:29:38.917671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:29:38.917671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:29:38.917671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 16:29:38.917671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:38.917671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 477/957] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Sep 7 16:29:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:38.924296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cd996-c6c1-4b66-a50a-bbd475ecf621 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:38.929573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:38.964703 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ca0b0-ceb9-4a38-acd0-356094c894e2 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:38.965037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ca0b0-ceb9-4a38-acd0-356094c894e2 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:38.965252 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ca0b0-ceb9-4a38-acd0-356094c894e2 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:38.966792 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 478/958] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:38.972500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ed1af-e131-49fb-a0f0-1ef954e0e2dc None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:38.972776 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ed1af-e131-49fb-a0f0-1ef954e0e2dc None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:38.973815 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ed1af-e131-49fb-a0f0-1ef954e0e2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:38.993916 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-d93ed1af-e131-49fb-a0f0-1ef954e0e2dc None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:38.995113 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-d93ed1af-e131-49fb-a0f0-1ef954e0e2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:39.014660 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:39.066203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cd996-c6c1-4b66-a50a-bbd475ecf621 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:39.091837 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 479/959] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 16:29:39.093673 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ed1af-e131-49fb-a0f0-1ef954e0e2dc None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:39.115723 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1729d-b849-425f-9691-9f37f2b7fc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:39.116770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1729d-b849-425f-9691-9f37f2b7fc8a None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:39.117080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1729d-b849-425f-9691-9f37f2b7fc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:39.117362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1729d-b849-425f-9691-9f37f2b7fc8a None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:39.118574 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1729d-b849-425f-9691-9f37f2b7fc8a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:39.118990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1729d-b849-425f-9691-9f37f2b7fc8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:39.120638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1729d-b849-425f-9691-9f37f2b7fc8a None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:39.153314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 481/960] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Sep 7 16:29:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:39.162886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1729d-b849-425f-9691-9f37f2b7fc8a None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:39.241405 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:39.256551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ed1af-e131-49fb-a0f0-1ef954e0e2dc None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:39.302076 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1729d-b849-425f-9691-9f37f2b7fc8a None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:39.313372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5cbeb-d086-4619-ad78-3bd9daa1cd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:39.314360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5cbeb-d086-4619-ad78-3bd9daa1cd5c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:39.314826 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5cbeb-d086-4619-ad78-3bd9daa1cd5c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:39.315276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5cbeb-d086-4619-ad78-3bd9daa1cd5c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:39.316336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5cbeb-d086-4619-ad78-3bd9daa1cd5c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:39.319402 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5cbeb-d086-4619-ad78-3bd9daa1cd5c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:39.336145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-13a5cbeb-d086-4619-ad78-3bd9daa1cd5c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 16:29:39.336145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:39.336145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:39.336145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:39.336145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:39.336145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:39.336145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:39.336145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:39.336145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 16:29:39.336145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:39.336145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:39.336145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:39.336145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:39.336145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:39.336145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:39.336145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:39.337250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:39.337250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:39.337250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:39.337250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:39.337250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:39.337250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:39.337250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:39.337250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:39.337250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:39.337250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:39.337250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:39.337250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:39.337250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:39.337250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:39.337250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:39.337250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:39.337250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:39.338193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:39.338193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:39.338193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:39.338193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:39.338193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:39.338193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:39.338193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:39.338193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:39.338193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:39.338193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:39.338193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:39.338193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:39.338193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 16:29:39.338193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:39.338193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 480/961] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Sep 7 16:29:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:39.344948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5cbeb-d086-4619-ad78-3bd9daa1cd5c None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:39.352519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69f729-91ed-424d-ac30-dc12e11ba317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:39.353711 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69f729-91ed-424d-ac30-dc12e11ba317 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:39.354184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69f729-91ed-424d-ac30-dc12e11ba317 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:39.354645 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69f729-91ed-424d-ac30-dc12e11ba317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:39.370775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:39.437851 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69f729-91ed-424d-ac30-dc12e11ba317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:39.439285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69f729-91ed-424d-ac30-dc12e11ba317 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:39.481019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5cbeb-d086-4619-ad78-3bd9daa1cd5c None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:39.512689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:39.518065 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af99cb-2a9e-4117-99d0-3b7bbc0a4ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:39.518692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af99cb-2a9e-4117-99d0-3b7bbc0a4ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:39.518958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af99cb-2a9e-4117-99d0-3b7bbc0a4ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:39.519264 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af99cb-2a9e-4117-99d0-3b7bbc0a4ea6 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:39.520538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af99cb-2a9e-4117-99d0-3b7bbc0a4ea6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:39.526229 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af99cb-2a9e-4117-99d0-3b7bbc0a4ea6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:39.526229 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af99cb-2a9e-4117-99d0-3b7bbc0a4ea6 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:39.527401 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 481/962] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Sep 7 16:29:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:39.528265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af99cb-2a9e-4117-99d0-3b7bbc0a4ea6 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:39.561874 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 482/963] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:29:39 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 16:29:39.563149 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69f729-91ed-424d-ac30-dc12e11ba317 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:39.626738 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:39.647046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af99cb-2a9e-4117-99d0-3b7bbc0a4ea6 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:39.688632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6eb829-3fd0-4fb4-9491-871210826c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:39.689281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6eb829-3fd0-4fb4-9491-871210826c8b None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:39.689548 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6eb829-3fd0-4fb4-9491-871210826c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:39.689819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6eb829-3fd0-4fb4-9491-871210826c8b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:39.690395 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6eb829-3fd0-4fb4-9491-871210826c8b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:39.692785 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6eb829-3fd0-4fb4-9491-871210826c8b None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:39.698287 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69f729-91ed-424d-ac30-dc12e11ba317 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:39.702934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-6b6eb829-3fd0-4fb4-9491-871210826c8b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 16:29:39.702934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:39.702934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:39.702934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:39.702934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:39.702934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:39.702934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:39.702934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:39.702934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 16:29:39.702934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:39.702934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:39.702934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:39.702934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:39.702934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:39.702934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:39.702934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:39.702934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:39.704050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:39.704050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:39.704050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:39.704050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:39.704050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:39.704050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:39.704050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:39.704050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:39.704050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:39.704050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:39.704050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:39.704050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:39.704050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:39.704050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:39.704050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:39.704050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:39.704890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:39.704890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:39.704890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:39.704890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:39.704890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:39.704890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:39.704890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:39.704890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:39.704890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:39.704890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:39.704890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:39.704890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:39.704890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 16:29:39.704890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:39.704890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 482/964] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Sep 7 16:29:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:39.706387 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6eb829-3fd0-4fb4-9491-871210826c8b None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:39.737590 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8fe43-33ca-4a36-90c7-14ba4262c8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:39.738317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8fe43-33ca-4a36-90c7-14ba4262c8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:39.738632 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8fe43-33ca-4a36-90c7-14ba4262c8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:39.738908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8fe43-33ca-4a36-90c7-14ba4262c8d2 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:39.739575 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8fe43-33ca-4a36-90c7-14ba4262c8d2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:39.739880 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8fe43-33ca-4a36-90c7-14ba4262c8d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:39.741259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8fe43-33ca-4a36-90c7-14ba4262c8d2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:39.746523 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 483/965] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Sep 7 16:29:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:39.747335 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8fe43-33ca-4a36-90c7-14ba4262c8d2 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:39.779837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:39.841782 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6eb829-3fd0-4fb4-9491-871210826c8b None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:39.883468 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8fe43-33ca-4a36-90c7-14ba4262c8d2 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:39.884818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac85fd5-89d2-4874-97d1-dac76f8a9d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:39.885484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac85fd5-89d2-4874-97d1-dac76f8a9d69 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:39.885759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac85fd5-89d2-4874-97d1-dac76f8a9d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:39.886037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac85fd5-89d2-4874-97d1-dac76f8a9d69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:39.899324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac85fd5-89d2-4874-97d1-dac76f8a9d69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:39.900847 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac85fd5-89d2-4874-97d1-dac76f8a9d69 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:39.908417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:39.917887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-aac85fd5-89d2-4874-97d1-dac76f8a9d69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:39.917887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:39.917887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:39.917887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:39.917887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:39.917887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:39.917887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:39.917887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:39.917887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:39.917887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:39.917887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:39.917887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:39.917887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:39.917887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:39.917887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:39.917887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:39.929150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:39.929150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:39.929150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:39.929150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:39.929150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:39.929150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:39.929150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:39.929150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:39.929150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:39.929150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:39.929150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:39.929150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:39.929150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:39.929150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:39.929150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:39.929150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:39.929150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:39.930878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:39.930878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:39.930878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:39.930878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 483/966] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:39.930878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac85fd5-89d2-4874-97d1-dac76f8a9d69 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:39.931183 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25050f33-1718-4623-b37b-8257620a9069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:39.931183 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25050f33-1718-4623-b37b-8257620a9069 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:39.931183 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25050f33-1718-4623-b37b-8257620a9069 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:39.931183 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25050f33-1718-4623-b37b-8257620a9069 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:39.931548 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25050f33-1718-4623-b37b-8257620a9069 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:39.931548 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25050f33-1718-4623-b37b-8257620a9069 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:39.931954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25050f33-1718-4623-b37b-8257620a9069 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:39.937744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 484/967] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Sep 7 16:29:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:39.938408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25050f33-1718-4623-b37b-8257620a9069 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:40.053681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:40.055952 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac85fd5-89d2-4874-97d1-dac76f8a9d69 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:40.070275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25050f33-1718-4623-b37b-8257620a9069 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:40.092821 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d245ea-9fe9-4b07-b6f1-874b1cf7db82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:40.093655 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d245ea-9fe9-4b07-b6f1-874b1cf7db82 None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:40.093798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d245ea-9fe9-4b07-b6f1-874b1cf7db82 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:40.093982 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d245ea-9fe9-4b07-b6f1-874b1cf7db82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:40.094620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d245ea-9fe9-4b07-b6f1-874b1cf7db82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:40.096268 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d245ea-9fe9-4b07-b6f1-874b1cf7db82 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:40.113401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7105ee-da18-475e-a513-2e6f71401021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:40.114614 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7105ee-da18-475e-a513-2e6f71401021 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:40.114896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7105ee-da18-475e-a513-2e6f71401021 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:40.115156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7105ee-da18-475e-a513-2e6f71401021 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:40.115866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7105ee-da18-475e-a513-2e6f71401021 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:40.116123 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7105ee-da18-475e-a513-2e6f71401021 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:40.117480 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7105ee-da18-475e-a513-2e6f71401021 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:40.129900 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 485/968] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:40.130797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7105ee-da18-475e-a513-2e6f71401021 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:40.184385 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 484/969] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:29:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:29:40.185633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d245ea-9fe9-4b07-b6f1-874b1cf7db82 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:40.260667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:40.270548 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7105ee-da18-475e-a513-2e6f71401021 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:40.337526 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4132cf-79d7-48be-a751-74a85ca2ec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:40.338494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4132cf-79d7-48be-a751-74a85ca2ec7f None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:40.338948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4132cf-79d7-48be-a751-74a85ca2ec7f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:40.339398 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4132cf-79d7-48be-a751-74a85ca2ec7f None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:40.340489 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4132cf-79d7-48be-a751-74a85ca2ec7f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:40.340895 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4132cf-79d7-48be-a751-74a85ca2ec7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:40.342438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d245ea-9fe9-4b07-b6f1-874b1cf7db82 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:40.343333 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4132cf-79d7-48be-a751-74a85ca2ec7f None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:40.356392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 486/970] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Sep 7 16:29:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:40.362702 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4132cf-79d7-48be-a751-74a85ca2ec7f None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:40.385002 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:40.385557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0fad2-0b77-4be7-a7cc-f0475f9a265f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:40.386919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0fad2-0b77-4be7-a7cc-f0475f9a265f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:40.387193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0fad2-0b77-4be7-a7cc-f0475f9a265f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:40.387536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0fad2-0b77-4be7-a7cc-f0475f9a265f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:40.396373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0fad2-0b77-4be7-a7cc-f0475f9a265f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:40.397780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0fad2-0b77-4be7-a7cc-f0475f9a265f None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:40.419555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-2dd0fad2-0b77-4be7-a7cc-f0475f9a265f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:40.419555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:40.419555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:40.419555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:40.419555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:40.419555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:40.419555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:40.419555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:40.419555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:40.419555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:40.419555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:40.419555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:40.419555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:29:40.419555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:29:40.419555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:29:40.428133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:29:40.428133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:40.428133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:40.428133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:40.428133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:40.428133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:40.428133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:40.428133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:40.428133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:40.428133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:40.428133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:40.428133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:40.428133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:40.428133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:40.428133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:40.428133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:40.428133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:40.429868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:29:40.429868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:29:40.429868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:29:40.429868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:29:40.429868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:29:40.429868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:29:40.429868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:40.429868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:40.429868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 485/971] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:40.432332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0fad2-0b77-4be7-a7cc-f0475f9a265f None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:40.538169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4132cf-79d7-48be-a751-74a85ca2ec7f None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:40.586055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0fad2-0b77-4be7-a7cc-f0475f9a265f None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:40.592502 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a5a0b-1f2b-4d8f-93c8-c67b8c377dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:40.593147 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a5a0b-1f2b-4d8f-93c8-c67b8c377dc6 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:40.593472 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a5a0b-1f2b-4d8f-93c8-c67b8c377dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:40.593745 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a5a0b-1f2b-4d8f-93c8-c67b8c377dc6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:40.594440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a5a0b-1f2b-4d8f-93c8-c67b8c377dc6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:40.596134 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a5a0b-1f2b-4d8f-93c8-c67b8c377dc6 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:40.608541 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:40.649811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ba8ce-b363-47c3-ac23-f42f921dc0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:40.650818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ba8ce-b363-47c3-ac23-f42f921dc0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:40.651306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ba8ce-b363-47c3-ac23-f42f921dc0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:40.651827 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ba8ce-b363-47c3-ac23-f42f921dc0a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:40.653082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ba8ce-b363-47c3-ac23-f42f921dc0a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:40.653623 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ba8ce-b363-47c3-ac23-f42f921dc0a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:40.656333 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ba8ce-b363-47c3-ac23-f42f921dc0a9 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:40.678665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 486/972] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:29:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:40.686208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ba8ce-b363-47c3-ac23-f42f921dc0a9 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:40.719039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 487/973] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:29:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:29:40.821270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ba8ce-b363-47c3-ac23-f42f921dc0a9 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:40.871972 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee836f6-c55e-47d3-935f-6e80cd6833a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:40.872774 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee836f6-c55e-47d3-935f-6e80cd6833a4 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:40.873186 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee836f6-c55e-47d3-935f-6e80cd6833a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:40.873593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee836f6-c55e-47d3-935f-6e80cd6833a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:40.874456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee836f6-c55e-47d3-935f-6e80cd6833a4 None admin] RBAC: Adding query filter params (role.id=9fea51971cb64ba480f210a7c4679c9c, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=87ba67fc171b4258b6fda72094ed11c3) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:40.874919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee836f6-c55e-47d3-935f-6e80cd6833a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:40.876671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee836f6-c55e-47d3-935f-6e80cd6833a4 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:40.884570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 487/974] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:29:40 2022] GET /identity/v3/role_assignments?user.id=87ba67fc171b4258b6fda72094ed11c3&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9fea51971cb64ba480f210a7c4679c9c => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:42.544317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc0a19-f9c9-4961-a3ce-d0962dfd3ee3 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:42.544881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc0a19-f9c9-4961-a3ce-d0962dfd3ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:42.544963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc0a19-f9c9-4961-a3ce-d0962dfd3ee3 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:42.547107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 488/975] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:42.553042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde30df3-cb89-48ae-9ff7-b9958c6764ea None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:42.553651 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde30df3-cb89-48ae-9ff7-b9958c6764ea None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:42.553651 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde30df3-cb89-48ae-9ff7-b9958c6764ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:42.576268 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-fde30df3-cb89-48ae-9ff7-b9958c6764ea None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:42.577458 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-fde30df3-cb89-48ae-9ff7-b9958c6764ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:42.605434 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:42.691851 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 488/976] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 16:29:42.963038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc0a19-f9c9-4961-a3ce-d0962dfd3ee3 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:43.059248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:43.072421 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d3a8-5790-42f2-9384-3140c99d1b04 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:43.074930 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d3a8-5790-42f2-9384-3140c99d1b04 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:43.074930 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d3a8-5790-42f2-9384-3140c99d1b04 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:43.074930 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 489/977] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:29:43.079790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bed9f-7952-4500-ad0a-1cd0b1aeff29 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:43.080071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bed9f-7952-4500-ad0a-1cd0b1aeff29 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:43.080372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bed9f-7952-4500-ad0a-1cd0b1aeff29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:43.100735 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-3b9bed9f-7952-4500-ad0a-1cd0b1aeff29 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:43.102642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3b9bed9f-7952-4500-ad0a-1cd0b1aeff29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:43.104926 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc0a19-f9c9-4961-a3ce-d0962dfd3ee3 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:43.148042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ae3df-f63d-426a-ab6a-ae5ac80a8488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:43.148042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ae3df-f63d-426a-ab6a-ae5ac80a8488 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:43.150687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ae3df-f63d-426a-ab6a-ae5ac80a8488 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:43.150687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ae3df-f63d-426a-ab6a-ae5ac80a8488 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:43.150687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ae3df-f63d-426a-ab6a-ae5ac80a8488 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:43.150687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ae3df-f63d-426a-ab6a-ae5ac80a8488 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:43.160678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-f68ae3df-f63d-426a-ab6a-ae5ac80a8488 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 16:29:43.160678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:43.160678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:43.160678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:43.160678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:43.160678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:43.160678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:43.160678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:43.160678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 16:29:43.160678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:43.160678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:43.160678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:43.160678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:43.160678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:43.160678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:43.160678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:43.160678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:43.162865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:43.162865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:43.162865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:43.162865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:43.162865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:43.162865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:43.162865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:43.162865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:43.162865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:43.162865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:43.162865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:43.162865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:43.162865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:43.162865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:43.162865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:43.162865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:43.164759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:43.164759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:43.164759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:43.164759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:43.164759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:43.164759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:43.164759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:43.164759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:43.164759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:43.164759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:43.164759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:43.164759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:43.164759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 16:29:43.164759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:43.167806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 489/978] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:43.168370 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ae3df-f63d-426a-ab6a-ae5ac80a8488 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:43.219922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 490/979] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 16:29:43.281033 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ae3df-f63d-426a-ab6a-ae5ac80a8488 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:43.313724 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:43.320471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0b996-7b1b-42cf-b0c0-8bec1582ad74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:43.321082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0b996-7b1b-42cf-b0c0-8bec1582ad74 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:43.321421 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0b996-7b1b-42cf-b0c0-8bec1582ad74 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:43.321696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0b996-7b1b-42cf-b0c0-8bec1582ad74 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:43.322320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0b996-7b1b-42cf-b0c0-8bec1582ad74 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:43.322615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0b996-7b1b-42cf-b0c0-8bec1582ad74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:43.324025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0b996-7b1b-42cf-b0c0-8bec1582ad74 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:43.329256 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 490/980] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Sep 7 16:29:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:43.335212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bed9f-7952-4500-ad0a-1cd0b1aeff29 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:43.461804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:43.477662 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bed9f-7952-4500-ad0a-1cd0b1aeff29 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:43.517050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6979a-a81e-4112-873f-51be7ec305eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:43.517690 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6979a-a81e-4112-873f-51be7ec305eb None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:43.517978 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6979a-a81e-4112-873f-51be7ec305eb None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:43.518249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6979a-a81e-4112-873f-51be7ec305eb None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:43.518910 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6979a-a81e-4112-873f-51be7ec305eb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:43.519213 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6979a-a81e-4112-873f-51be7ec305eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:43.521671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6979a-a81e-4112-873f-51be7ec305eb None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:43.527966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 491/981] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Sep 7 16:29:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:43.577314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0b996-7b1b-42cf-b0c0-8bec1582ad74 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:43.654843 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c39f3-32a7-4e80-a019-9e50d3365bc2 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:43.654843 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c39f3-32a7-4e80-a019-9e50d3365bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:43.654843 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c39f3-32a7-4e80-a019-9e50d3365bc2 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:43.655590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 492/982] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:43.660786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f29a3d-a72f-4f91-baa4-a8f51521ac56 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:43.668628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f29a3d-a72f-4f91-baa4-a8f51521ac56 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:43.668628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f29a3d-a72f-4f91-baa4-a8f51521ac56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:43.685133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-b8f29a3d-a72f-4f91-baa4-a8f51521ac56 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:43.686383 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b8f29a3d-a72f-4f91-baa4-a8f51521ac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:43.745975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0b996-7b1b-42cf-b0c0-8bec1582ad74 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:43.786802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97b499-22d7-4d53-b2bc-8adc7b4fe0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:43.787459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97b499-22d7-4d53-b2bc-8adc7b4fe0a6 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:43.787768 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97b499-22d7-4d53-b2bc-8adc7b4fe0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:43.788041 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97b499-22d7-4d53-b2bc-8adc7b4fe0a6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:43.788638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97b499-22d7-4d53-b2bc-8adc7b4fe0a6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:43.790046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97b499-22d7-4d53-b2bc-8adc7b4fe0a6 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:43.798481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 493/983] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 16:29:43.800036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-0e97b499-22d7-4d53-b2bc-8adc7b4fe0a6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 16:29:43.800036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:43.800036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:43.800036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:43.800036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:43.800036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:43.800036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:43.800036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:43.800036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 16:29:43.800036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:43.800036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:43.800036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:43.800036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:43.800036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:43.800036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:43.800036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:43.800036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:43.802342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:43.802342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:43.802342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:43.802342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:43.802342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:43.802342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:43.802342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:43.802342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:43.802342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:43.802342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:43.802342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:43.802342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:43.802342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:43.802342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:43.802342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:43.802342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:43.803844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:43.803844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:43.803844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:43.803844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:43.803844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:43.803844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:43.803844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:43.803844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:43.803844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:43.803844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:43.803844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:43.803844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:43.803844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 16:29:43.803844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:43.803844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 491/984] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Sep 7 16:29:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:43.809382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f29a3d-a72f-4f91-baa4-a8f51521ac56 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:43.920341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:43.938797 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f29a3d-a72f-4f91-baa4-a8f51521ac56 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:43.984637 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7a101-2ef3-4a8f-a50d-b4496fada2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:43.985213 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7a101-2ef3-4a8f-a50d-b4496fada2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:43.985499 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7a101-2ef3-4a8f-a50d-b4496fada2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:43.985773 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7a101-2ef3-4a8f-a50d-b4496fada2a2 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:43.986414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7a101-2ef3-4a8f-a50d-b4496fada2a2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:43.986712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7a101-2ef3-4a8f-a50d-b4496fada2a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:43.988197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7a101-2ef3-4a8f-a50d-b4496fada2a2 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:44.001160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 494/985] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Sep 7 16:29:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:44.001379 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97b499-22d7-4d53-b2bc-8adc7b4fe0a6 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:44.089659 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7a101-2ef3-4a8f-a50d-b4496fada2a2 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:44.090411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:44.148064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97b499-22d7-4d53-b2bc-8adc7b4fe0a6 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:44.191917 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90256be5-15b7-4637-8b2d-9986c66cee3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:44.192898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90256be5-15b7-4637-8b2d-9986c66cee3b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:44.193192 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90256be5-15b7-4637-8b2d-9986c66cee3b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:44.193460 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90256be5-15b7-4637-8b2d-9986c66cee3b None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:44.194118 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90256be5-15b7-4637-8b2d-9986c66cee3b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:44.194419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90256be5-15b7-4637-8b2d-9986c66cee3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:44.195861 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90256be5-15b7-4637-8b2d-9986c66cee3b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:44.201806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 492/986] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Sep 7 16:29:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:44.208462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90256be5-15b7-4637-8b2d-9986c66cee3b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:44.246079 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7a101-2ef3-4a8f-a50d-b4496fada2a2 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:44.294784 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebae1f5-b1ce-4c56-83af-eed39d9aec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:44.295845 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae1f5-b1ce-4c56-83af-eed39d9aec4f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:44.296424 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae1f5-b1ce-4c56-83af-eed39d9aec4f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:44.296904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae1f5-b1ce-4c56-83af-eed39d9aec4f None admin] PATH_INFO: `/v3/services/image` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:44.297937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebae1f5-b1ce-4c56-83af-eed39d9aec4f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:44.300566 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebae1f5-b1ce-4c56-83af-eed39d9aec4f None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:44.317542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-3ebae1f5-b1ce-4c56-83af-eed39d9aec4f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 16:29:44.317542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:44.317542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:44.317542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:44.317542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:44.317542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:44.317542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:44.317542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:44.317542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 16:29:44.317542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:44.317542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:44.317542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:44.317542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:44.317542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:44.317542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:44.317542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:44.317542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:44.318828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:44.318828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:44.318828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:44.318828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:44.318828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:44.318828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:44.318828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:44.318828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:44.318828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:44.318828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:44.318828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:44.318828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:44.318828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:44.318828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:44.318828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:44.318828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:44.319887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:44.319887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:44.319887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:44.319887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:44.319887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:44.319887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:44.319887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:44.319887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:44.319887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:44.319887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:44.319887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:44.319887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:44.319887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 16:29:44.319887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:44.320706 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 495/987] 10.222.0.25 () {56 vars in 1105 bytes} [Wed Sep 7 16:29:44 2022] GET /identity/v3/services/image => generated 86 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:44.326681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebae1f5-b1ce-4c56-83af-eed39d9aec4f None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:44.345695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:44.365220 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90256be5-15b7-4637-8b2d-9986c66cee3b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:44.401799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:44.417994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8ddbd-8589-4f45-b315-4abe82ce0511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:44.418795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8ddbd-8589-4f45-b315-4abe82ce0511 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:44.419213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8ddbd-8589-4f45-b315-4abe82ce0511 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:44.419700 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8ddbd-8589-4f45-b315-4abe82ce0511 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:44.420558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8ddbd-8589-4f45-b315-4abe82ce0511 None admin] RBAC: Adding query filter params (interface=admin, service_id=89386dc7710849318fd6de0635f5cd8b, region_id=RegionOne) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:44.421011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8ddbd-8589-4f45-b315-4abe82ce0511 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:44.422744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8ddbd-8589-4f45-b315-4abe82ce0511 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:44.436036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 493/988] 10.222.0.25 () {56 vars in 1249 bytes} [Wed Sep 7 16:29:44 2022] GET /identity/v3/endpoints?service_id=89386dc7710849318fd6de0635f5cd8b&interface=admin®ion_id=RegionOne => generated 193 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:44.438419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8ddbd-8589-4f45-b315-4abe82ce0511 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:44.489340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebae1f5-b1ce-4c56-83af-eed39d9aec4f None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:44.558851 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d388d7c-e0c7-4da5-9be4-6af49650e261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:44.559808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d388d7c-e0c7-4da5-9be4-6af49650e261 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:44.560290 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d388d7c-e0c7-4da5-9be4-6af49650e261 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:44.560728 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d388d7c-e0c7-4da5-9be4-6af49650e261 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:44.561983 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d388d7c-e0c7-4da5-9be4-6af49650e261 None admin] RBAC: Adding query filter params (name=image) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:44.562477 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d388d7c-e0c7-4da5-9be4-6af49650e261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:44.565324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d388d7c-e0c7-4da5-9be4-6af49650e261 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:44.575228 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8ddbd-8589-4f45-b315-4abe82ce0511 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:44.575454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 496/989] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:44.581407 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d388d7c-e0c7-4da5-9be4-6af49650e261 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:44.627762 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659abd5-7748-439f-ad54-0fa096572d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:44.628859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659abd5-7748-439f-ad54-0fa096572d32 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:44.629858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659abd5-7748-439f-ad54-0fa096572d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:44.630356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659abd5-7748-439f-ad54-0fa096572d32 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:44.631435 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659abd5-7748-439f-ad54-0fa096572d32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:44.634085 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659abd5-7748-439f-ad54-0fa096572d32 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:44.646964 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 494/990] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Sep 7 16:29:44 2022] GET /identity/v3/services => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:29:44.711336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:44.741551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d388d7c-e0c7-4da5-9be4-6af49650e261 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:44.790249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168b2a6-eeff-4013-b009-00c554aeb52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:44.790896 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b2a6-eeff-4013-b009-00c554aeb52c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:44.791172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b2a6-eeff-4013-b009-00c554aeb52c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:44.791445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b2a6-eeff-4013-b009-00c554aeb52c None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:44.792116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168b2a6-eeff-4013-b009-00c554aeb52c None admin] RBAC: Adding query filter params (type=image) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:44.792442 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168b2a6-eeff-4013-b009-00c554aeb52c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:44.793902 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168b2a6-eeff-4013-b009-00c554aeb52c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:44.805086 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 497/991] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:44 2022] GET /identity/v3/services?type=image => generated 122 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:45.949974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d7ba-c585-4f43-bff2-9cdf8d74e4e1 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:45.950499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d7ba-c585-4f43-bff2-9cdf8d74e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:45.950928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d7ba-c585-4f43-bff2-9cdf8d74e4e1 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:45.953554 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 495/992] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:45.960694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a68ef5-fb23-4807-9e92-0ea02b33d5b9 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:45.961556 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a68ef5-fb23-4807-9e92-0ea02b33d5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:45.961556 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a68ef5-fb23-4807-9e92-0ea02b33d5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:45.981910 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f5a68ef5-fb23-4807-9e92-0ea02b33d5b9 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:45.983143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f5a68ef5-fb23-4807-9e92-0ea02b33d5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:46.057814 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 498/993] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 16:29:46.350207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610d7ba-c585-4f43-bff2-9cdf8d74e4e1 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:46.405742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:46.461010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610d7ba-c585-4f43-bff2-9cdf8d74e4e1 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:46.497148 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af35a6c-80bb-44bc-a91f-545ba62e647b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:46.497794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35a6c-80bb-44bc-a91f-545ba62e647b None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:46.498126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35a6c-80bb-44bc-a91f-545ba62e647b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:46.498396 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35a6c-80bb-44bc-a91f-545ba62e647b None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:46.499063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af35a6c-80bb-44bc-a91f-545ba62e647b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:46.500469 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af35a6c-80bb-44bc-a91f-545ba62e647b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:46.579946 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 496/994] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Sep 7 16:29:46 2022] POST /identity/v3/services => generated 242 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:29:46.994356 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27f06-e817-45db-96f9-553779718b5b None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:46.994889 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27f06-e817-45db-96f9-553779718b5b None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:46.994889 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27f06-e817-45db-96f9-553779718b5b None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:46.996599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 499/995] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:47.002265 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90368ab8-17a3-4d1f-959d-3639b1915bff None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:47.002768 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90368ab8-17a3-4d1f-959d-3639b1915bff None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:47.002848 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90368ab8-17a3-4d1f-959d-3639b1915bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:47.026875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-90368ab8-17a3-4d1f-959d-3639b1915bff None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:47.028538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-90368ab8-17a3-4d1f-959d-3639b1915bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:47.157546 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 497/996] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:47.483194 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac1fe9-a8fb-4d62-8e87-c4e135b231a9 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:47.483459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac1fe9-a8fb-4d62-8e87-c4e135b231a9 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:47.483662 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac1fe9-a8fb-4d62-8e87-c4e135b231a9 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:47.485247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 500/997] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:47.491692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ac164-b2b1-42d0-89dd-d9f44e016efa None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:47.491992 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ac164-b2b1-42d0-89dd-d9f44e016efa None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:47.492264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ac164-b2b1-42d0-89dd-d9f44e016efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:47.508777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac1fe9-a8fb-4d62-8e87-c4e135b231a9 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:47.518723 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-2b6ac164-b2b1-42d0-89dd-d9f44e016efa None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:47.520351 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2b6ac164-b2b1-42d0-89dd-d9f44e016efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:47.562493 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:47.620110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:47.636586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 498/998] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:47.669505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac1fe9-a8fb-4d62-8e87-c4e135b231a9 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:47.710828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b927e-34e7-4305-b809-e64583fc7347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:47.711819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b927e-34e7-4305-b809-e64583fc7347 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:47.712231 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b927e-34e7-4305-b809-e64583fc7347 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:47.712651 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b927e-34e7-4305-b809-e64583fc7347 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:47.713401 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b927e-34e7-4305-b809-e64583fc7347 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:47.715000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b927e-34e7-4305-b809-e64583fc7347 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:47.727538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-8f3b927e-34e7-4305-b809-e64583fc7347 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 16:29:47.727538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:47.727538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:47.727538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:47.727538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:47.727538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:47.727538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:47.727538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:47.727538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 16:29:47.727538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:47.727538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:47.727538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:47.727538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:47.727538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:47.727538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:47.727538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:47.727538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:47.729536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:47.729536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:47.729536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:47.729536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:47.729536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:47.729536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:47.729536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:47.729536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:47.729536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:47.729536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:47.729536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:47.729536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:47.729536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:47.729536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:47.729536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:47.729536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:47.736094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:47.736094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:47.736094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:47.736094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:47.736094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:47.736094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:47.736094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:47.736094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:47.736094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:47.736094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:47.736094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:47.736094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:47.736094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 16:29:47.736094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:47.736094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 501/999] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Sep 7 16:29:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:47.739400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ac164-b2b1-42d0-89dd-d9f44e016efa None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:47.881302 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ac164-b2b1-42d0-89dd-d9f44e016efa None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:47.918561 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28c84e-8d9f-4c91-a3ab-cf658ec99025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:47.919176 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28c84e-8d9f-4c91-a3ab-cf658ec99025 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:47.919451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28c84e-8d9f-4c91-a3ab-cf658ec99025 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:47.919747 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28c84e-8d9f-4c91-a3ab-cf658ec99025 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:47.920385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28c84e-8d9f-4c91-a3ab-cf658ec99025 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:47.920679 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28c84e-8d9f-4c91-a3ab-cf658ec99025 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:47.922066 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28c84e-8d9f-4c91-a3ab-cf658ec99025 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:47.928174 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 499/1000] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Sep 7 16:29:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:47.933664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b927e-34e7-4305-b809-e64583fc7347 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:47.962827 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28c84e-8d9f-4c91-a3ab-cf658ec99025 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:48.016948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:48.063463 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b927e-34e7-4305-b809-e64583fc7347 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:48.104103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fadd7e-d8e1-4c38-8715-cfb429b7b9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:48.104713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fadd7e-d8e1-4c38-8715-cfb429b7b9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:48.104985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fadd7e-d8e1-4c38-8715-cfb429b7b9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:48.105262 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fadd7e-d8e1-4c38-8715-cfb429b7b9a4 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:48.106033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fadd7e-d8e1-4c38-8715-cfb429b7b9a4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:48.106333 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fadd7e-d8e1-4c38-8715-cfb429b7b9a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:48.108156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fadd7e-d8e1-4c38-8715-cfb429b7b9a4 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:48.109772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:48.115223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 502/1001] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Sep 7 16:29:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:48.120896 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fadd7e-d8e1-4c38-8715-cfb429b7b9a4 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:48.139695 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28c84e-8d9f-4c91-a3ab-cf658ec99025 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:48.182451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6727e-f658-4b7b-befe-e3c3425e79c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:48.183082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6727e-f658-4b7b-befe-e3c3425e79c5 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:48.183359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6727e-f658-4b7b-befe-e3c3425e79c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:48.183693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6727e-f658-4b7b-befe-e3c3425e79c5 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:48.184316 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6727e-f658-4b7b-befe-e3c3425e79c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:48.185740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6727e-f658-4b7b-befe-e3c3425e79c5 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:48.249821 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fadd7e-d8e1-4c38-8715-cfb429b7b9a4 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:48.291864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 500/1002] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Sep 7 16:29:47 2022] POST /identity/v3/services => generated 242 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:29:48.307342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba909f-8f39-44bc-93b8-60867fbcf98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:48.308024 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba909f-8f39-44bc-93b8-60867fbcf98a None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:48.308291 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba909f-8f39-44bc-93b8-60867fbcf98a None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:48.308665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba909f-8f39-44bc-93b8-60867fbcf98a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:48.309273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba909f-8f39-44bc-93b8-60867fbcf98a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:48.310691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba909f-8f39-44bc-93b8-60867fbcf98a None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:48.386933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 503/1003] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:29:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:29:49.023748 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c52c38-9d55-42ec-84e6-6393ae08e00a None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:49.024311 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c52c38-9d55-42ec-84e6-6393ae08e00a None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:49.024311 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c52c38-9d55-42ec-84e6-6393ae08e00a None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:49.025671 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 501/1004] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:49.031467 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9953cbe-efb1-46b0-b506-0a842d172bb6 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:49.031794 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9953cbe-efb1-46b0-b506-0a842d172bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:49.032188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9953cbe-efb1-46b0-b506-0a842d172bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:49.054042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-c9953cbe-efb1-46b0-b506-0a842d172bb6 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:49.055253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c9953cbe-efb1-46b0-b506-0a842d172bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:49.115077 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:49.147534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 504/1005] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:49 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:49.442599 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c52c38-9d55-42ec-84e6-6393ae08e00a None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:49.586955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:49.600479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c52c38-9d55-42ec-84e6-6393ae08e00a None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:49.656153 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c8f6e-fad6-4d58-a6e0-786cac2d3a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:49.656153 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c8f6e-fad6-4d58-a6e0-786cac2d3a0d None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:49.656153 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c8f6e-fad6-4d58-a6e0-786cac2d3a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:49.656153 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c8f6e-fad6-4d58-a6e0-786cac2d3a0d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:49.656781 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c8f6e-fad6-4d58-a6e0-786cac2d3a0d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:49.657886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c8f6e-fad6-4d58-a6e0-786cac2d3a0d None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:49.667904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-e86c8f6e-fad6-4d58-a6e0-786cac2d3a0d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 16:29:49.667904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:49.667904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:49.667904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:49.667904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:49.667904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:49.667904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:49.667904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:49.667904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 16:29:49.667904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:49.667904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:49.667904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:49.667904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:49.667904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:49.667904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:49.667904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:49.667904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:49.669692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:49.669692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:49.669692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:49.669692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:49.669692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:49.669692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:49.669692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:49.669692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:49.669692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:49.669692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:49.669692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:49.669692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:49.669692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:49.669692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:49.669692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:49.669692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:49.671216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:49.671216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:49.671216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:49.671216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:49.671216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:49.671216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:49.671216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:49.671216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:49.671216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:49.671216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:49.671216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:49.671216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:49.671216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 16:29:49.671216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:49.674104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 502/1006] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:49.677048 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9953cbe-efb1-46b0-b506-0a842d172bb6 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:49.855727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9953cbe-efb1-46b0-b506-0a842d172bb6 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:49.894589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9774a2a-efd4-4a8e-9bce-253cbf639820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:49.895175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9774a2a-efd4-4a8e-9bce-253cbf639820 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:49.895452 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9774a2a-efd4-4a8e-9bce-253cbf639820 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:49.895821 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9774a2a-efd4-4a8e-9bce-253cbf639820 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:49.896654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9774a2a-efd4-4a8e-9bce-253cbf639820 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:49.896962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9774a2a-efd4-4a8e-9bce-253cbf639820 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:49.898418 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9774a2a-efd4-4a8e-9bce-253cbf639820 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:49.908964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 505/1007] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Sep 7 16:29:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:49.911446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c8f6e-fad6-4d58-a6e0-786cac2d3a0d None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:50.020804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c8f6e-fad6-4d58-a6e0-786cac2d3a0d None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:50.057717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d56f6-2b1c-4760-98c7-ca556414f7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:50.058437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d56f6-2b1c-4760-98c7-ca556414f7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:50.058770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d56f6-2b1c-4760-98c7-ca556414f7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:50.058889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d56f6-2b1c-4760-98c7-ca556414f7f3 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:50.059506 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d56f6-2b1c-4760-98c7-ca556414f7f3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:50.059884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d56f6-2b1c-4760-98c7-ca556414f7f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:50.061258 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d56f6-2b1c-4760-98c7-ca556414f7f3 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:50.067000 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 503/1008] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Sep 7 16:29:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:50.073259 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9774a2a-efd4-4a8e-9bce-253cbf639820 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:50.132943 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:50.199377 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9774a2a-efd4-4a8e-9bce-253cbf639820 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:50.241067 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f3b19-b076-4b06-9c6c-283d3bf65021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:50.241698 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3b19-b076-4b06-9c6c-283d3bf65021 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:50.241975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3b19-b076-4b06-9c6c-283d3bf65021 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:50.242245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3b19-b076-4b06-9c6c-283d3bf65021 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:50.242953 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f3b19-b076-4b06-9c6c-283d3bf65021 None admin] RBAC: Adding query filter params (interface=public, service_id=b6cae50887bf44028df3f3c9603bc166, region_id=RegionOne) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:50.243259 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f3b19-b076-4b06-9c6c-283d3bf65021 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:50.244695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f3b19-b076-4b06-9c6c-283d3bf65021 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:50.256775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 506/1009] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Sep 7 16:29:50 2022] GET /identity/v3/endpoints?service_id=b6cae50887bf44028df3f3c9603bc166&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:50.258083 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d56f6-2b1c-4760-98c7-ca556414f7f3 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:50.280404 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:50.369322 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d56f6-2b1c-4760-98c7-ca556414f7f3 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:50.407262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d936c48-926a-40eb-9b8e-778e174966d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:50.407802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d936c48-926a-40eb-9b8e-778e174966d2 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:50.408080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d936c48-926a-40eb-9b8e-778e174966d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:50.408356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d936c48-926a-40eb-9b8e-778e174966d2 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:50.408957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d936c48-926a-40eb-9b8e-778e174966d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:50.410638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d936c48-926a-40eb-9b8e-778e174966d2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:50.418365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 504/1010] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Sep 7 16:29:50 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:29:51.106381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290258dd-ed43-4f35-9f63-1a143988edc0 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:51.106872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290258dd-ed43-4f35-9f63-1a143988edc0 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:51.107350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290258dd-ed43-4f35-9f63-1a143988edc0 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:51.109927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 507/1011] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:51.117224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18963e11-b358-4069-aa18-fba5f20a079a None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:51.117766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18963e11-b358-4069-aa18-fba5f20a079a None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:51.117766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18963e11-b358-4069-aa18-fba5f20a079a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:51.139365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-18963e11-b358-4069-aa18-fba5f20a079a None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:51.140669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-18963e11-b358-4069-aa18-fba5f20a079a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:51.165836 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffd907-b76a-4e7c-a249-c3d1486acc6d None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:51.166521 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffd907-b76a-4e7c-a249-c3d1486acc6d None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:51.166521 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffd907-b76a-4e7c-a249-c3d1486acc6d None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:51.167951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 508/1012] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:29:51.174154 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ea07a-fb3f-4f0c-9a52-0b43d26902af None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:51.174547 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ea07a-fb3f-4f0c-9a52-0b43d26902af None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:51.175221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ea07a-fb3f-4f0c-9a52-0b43d26902af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:51.207726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-422ea07a-fb3f-4f0c-9a52-0b43d26902af None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:51.209834 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-422ea07a-fb3f-4f0c-9a52-0b43d26902af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:51.227874 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 505/1013] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:51 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:51.315515 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 509/1014] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:51 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 16:29:51.585975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18963e11-b358-4069-aa18-fba5f20a079a None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:51.606294 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:51.672126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ea07a-fb3f-4f0c-9a52-0b43d26902af None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:51.733053 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18963e11-b358-4069-aa18-fba5f20a079a None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:51.751673 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:51.781503 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f488cbc-17bd-4948-b397-29eb8617e5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:51.782649 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f488cbc-17bd-4948-b397-29eb8617e5eb None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:51.783110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f488cbc-17bd-4948-b397-29eb8617e5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:51.783584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f488cbc-17bd-4948-b397-29eb8617e5eb None admin] PATH_INFO: `/v3/services/image` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:51.784273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f488cbc-17bd-4948-b397-29eb8617e5eb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:51.786802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f488cbc-17bd-4948-b397-29eb8617e5eb None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:51.804492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-4f488cbc-17bd-4948-b397-29eb8617e5eb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 16:29:51.804492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:51.804492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:51.804492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:51.804492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:51.804492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:51.804492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:51.804492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:51.804492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 16:29:51.804492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:51.804492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:51.804492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:51.804492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:51.804492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:51.804492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:51.804492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:51.804492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:51.806542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:51.806542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:51.806542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:51.806542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:51.806542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:51.806542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:51.806542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:51.806542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:51.806542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:51.806542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:51.806542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:51.806542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:51.806542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:51.806542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:51.806542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:51.806542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:51.808463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:51.808463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:51.808463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:51.808463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:51.808463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:51.808463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:51.808463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:51.808463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:51.808463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:51.808463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:51.808463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:51.808463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:51.808463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 16:29:51.808463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:51.808463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 506/1015] 10.222.0.25 () {56 vars in 1105 bytes} [Wed Sep 7 16:29:51 2022] GET /identity/v3/services/image => generated 86 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:51.812628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f488cbc-17bd-4948-b397-29eb8617e5eb None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:51.868366 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ea07a-fb3f-4f0c-9a52-0b43d26902af None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:51.918586 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8e778-4e96-4e5e-bad5-8aab21046a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:51.919212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8e778-4e96-4e5e-bad5-8aab21046a26 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:51.919592 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8e778-4e96-4e5e-bad5-8aab21046a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:51.920073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8e778-4e96-4e5e-bad5-8aab21046a26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:51.921072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8e778-4e96-4e5e-bad5-8aab21046a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:51.922373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8e778-4e96-4e5e-bad5-8aab21046a26 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:51.924373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 510/1016] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:51.933454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8e778-4e96-4e5e-bad5-8aab21046a26 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:51.939387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:51.967012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f488cbc-17bd-4948-b397-29eb8617e5eb None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:52.010746 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f779949-e807-4895-9ee2-b6623eb03677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:52.011946 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f779949-e807-4895-9ee2-b6623eb03677 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:52.012485 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f779949-e807-4895-9ee2-b6623eb03677 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:52.013200 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f779949-e807-4895-9ee2-b6623eb03677 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:52.013949 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f779949-e807-4895-9ee2-b6623eb03677 None admin] RBAC: Adding query filter params (name=image) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:52.014256 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f779949-e807-4895-9ee2-b6623eb03677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:52.015722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f779949-e807-4895-9ee2-b6623eb03677 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:52.023280 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 507/1017] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:52.028172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f779949-e807-4895-9ee2-b6623eb03677 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:52.086907 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8e778-4e96-4e5e-bad5-8aab21046a26 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:52.097349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:52.134336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4aff1-b1b1-40b7-b6f9-839ed699f67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:52.134866 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4aff1-b1b1-40b7-b6f9-839ed699f67d None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:52.135297 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4aff1-b1b1-40b7-b6f9-839ed699f67d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:52.135601 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4aff1-b1b1-40b7-b6f9-839ed699f67d None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:52.136667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4aff1-b1b1-40b7-b6f9-839ed699f67d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:52.139657 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4aff1-b1b1-40b7-b6f9-839ed699f67d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:52.141995 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f779949-e807-4895-9ee2-b6623eb03677 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:52.179396 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17029562-49aa-48d3-b0c8-adac927f7f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:52.180158 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17029562-49aa-48d3-b0c8-adac927f7f6a None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:52.180619 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17029562-49aa-48d3-b0c8-adac927f7f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:52.180908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17029562-49aa-48d3-b0c8-adac927f7f6a None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:52.181696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17029562-49aa-48d3-b0c8-adac927f7f6a None admin] RBAC: Adding query filter params (type=image) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:52.182054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17029562-49aa-48d3-b0c8-adac927f7f6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:52.183927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17029562-49aa-48d3-b0c8-adac927f7f6a None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:52.191033 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 508/1018] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:52.197112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17029562-49aa-48d3-b0c8-adac927f7f6a None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:52.200933 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:52.274509 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 511/1019] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Sep 7 16:29:51 2022] POST /identity/v3/projects => generated 311 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:29:52.314892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17029562-49aa-48d3-b0c8-adac927f7f6a None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:52.358516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844f1e3-229a-46fe-abd1-9ae6878d26e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:52.359153 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844f1e3-229a-46fe-abd1-9ae6878d26e3 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:52.359431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844f1e3-229a-46fe-abd1-9ae6878d26e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:52.359735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844f1e3-229a-46fe-abd1-9ae6878d26e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:52.360474 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844f1e3-229a-46fe-abd1-9ae6878d26e3 None admin] RBAC: Adding query filter params (interface=public, service_id=8333916c5a1046798c705a411ec92f91, region_id=RegionOne) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:52.360781 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844f1e3-229a-46fe-abd1-9ae6878d26e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:52.362272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844f1e3-229a-46fe-abd1-9ae6878d26e3 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:52.375048 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 509/1020] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Sep 7 16:29:52 2022] GET /identity/v3/endpoints?service_id=8333916c5a1046798c705a411ec92f91&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:52.376470 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4aff1-b1b1-40b7-b6f9-839ed699f67d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:52.506463 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4aff1-b1b1-40b7-b6f9-839ed699f67d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:52.551447 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c151b2-92ec-4577-8660-d0d8eaa1babe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:52.552332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c151b2-92ec-4577-8660-d0d8eaa1babe None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:52.552671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c151b2-92ec-4577-8660-d0d8eaa1babe None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:52.552979 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c151b2-92ec-4577-8660-d0d8eaa1babe None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:52.553773 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c151b2-92ec-4577-8660-d0d8eaa1babe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:52.555354 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c151b2-92ec-4577-8660-d0d8eaa1babe None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:52.565023 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 512/1021] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Sep 7 16:29:52 2022] GET /identity/v3/services => generated 1957 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:29:52.957737 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926702-c04b-48ff-bc56-e82d0d8235d4 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:52.957919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926702-c04b-48ff-bc56-e82d0d8235d4 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:52.958247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926702-c04b-48ff-bc56-e82d0d8235d4 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:52.959766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 510/1022] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:52.965184 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e64d9-124e-498b-9282-c700acd34833 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:52.965477 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e64d9-124e-498b-9282-c700acd34833 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:52.965759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e64d9-124e-498b-9282-c700acd34833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:52.985367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-ad9e64d9-124e-498b-9282-c700acd34833 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:52.986565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ad9e64d9-124e-498b-9282-c700acd34833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:53.006926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:53.063521 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 513/1023] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:52 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:53.336844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926702-c04b-48ff-bc56-e82d0d8235d4 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:53.432240 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:53.496894 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926702-c04b-48ff-bc56-e82d0d8235d4 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:53.548853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff3b2e-9325-4fe6-bc6c-61b1594cf25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:53.549513 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff3b2e-9325-4fe6-bc6c-61b1594cf25b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:53.549789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff3b2e-9325-4fe6-bc6c-61b1594cf25b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:53.550780 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff3b2e-9325-4fe6-bc6c-61b1594cf25b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:53.551693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff3b2e-9325-4fe6-bc6c-61b1594cf25b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:53.553146 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff3b2e-9325-4fe6-bc6c-61b1594cf25b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:53.563600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-e0ff3b2e-9325-4fe6-bc6c-61b1594cf25b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 16:29:53.563600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:53.563600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:53.563600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:53.563600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:53.563600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:53.563600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:53.563600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:53.563600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 16:29:53.563600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:53.563600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:53.563600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:53.563600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:53.563600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:53.563600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:53.563600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:53.563600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:53.565415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:53.565415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:53.565415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:53.565415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:53.565415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:53.565415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:53.565415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:53.565415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:53.565415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:53.565415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:53.565415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:53.565415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:53.565415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:53.565415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:53.565415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:53.565415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:53.567144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:53.567144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:53.567144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:53.567144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:53.567144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:53.567144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:53.567144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:53.567144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:53.567144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:53.567144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:53.567144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:53.567144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:53.567144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 16:29:53.567144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:53.567144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 511/1024] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:53.576298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e64d9-124e-498b-9282-c700acd34833 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:53.702966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e64d9-124e-498b-9282-c700acd34833 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:53.748265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6815d8-0cdd-4625-b00b-def7d434914c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:53.748900 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6815d8-0cdd-4625-b00b-def7d434914c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:53.749177 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6815d8-0cdd-4625-b00b-def7d434914c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:53.749445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6815d8-0cdd-4625-b00b-def7d434914c None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:53.750101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6815d8-0cdd-4625-b00b-def7d434914c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:53.750401 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6815d8-0cdd-4625-b00b-def7d434914c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:53.751870 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6815d8-0cdd-4625-b00b-def7d434914c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:53.758476 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 514/1025] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Sep 7 16:29:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:53.766414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff3b2e-9325-4fe6-bc6c-61b1594cf25b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:53.887011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff3b2e-9325-4fe6-bc6c-61b1594cf25b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:53.934565 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:53.944035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912082e-1987-4c4d-a1c0-b9eb27efe55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:53.944525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912082e-1987-4c4d-a1c0-b9eb27efe55d None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:53.957707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912082e-1987-4c4d-a1c0-b9eb27efe55d None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:53.957707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912082e-1987-4c4d-a1c0-b9eb27efe55d None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:53.957707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912082e-1987-4c4d-a1c0-b9eb27efe55d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:53.957707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912082e-1987-4c4d-a1c0-b9eb27efe55d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:53.957707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912082e-1987-4c4d-a1c0-b9eb27efe55d None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:53.964461 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 512/1026] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Sep 7 16:29:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:53.965529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6815d8-0cdd-4625-b00b-def7d434914c None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:53.998500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:54.128939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6815d8-0cdd-4625-b00b-def7d434914c None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:54.166374 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb2872-321b-4e85-945b-6cc35b97f9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:54.166973 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb2872-321b-4e85-945b-6cc35b97f9f3 None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:54.167284 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb2872-321b-4e85-945b-6cc35b97f9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:54.167604 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb2872-321b-4e85-945b-6cc35b97f9f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:54.168286 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb2872-321b-4e85-945b-6cc35b97f9f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:54.169639 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb2872-321b-4e85-945b-6cc35b97f9f3 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:54.263597 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 515/1027] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:29:53 2022] POST /identity/v3/endpoints => generated 334 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:29:54.715911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f576709-a681-42c2-9168-a12679dd3aa1 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:54.716631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f576709-a681-42c2-9168-a12679dd3aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:54.716631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f576709-a681-42c2-9168-a12679dd3aa1 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:54.717956 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 513/1028] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:29:54.724193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608c03d-9dc7-405e-9d4d-634174b11f30 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:54.724723 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608c03d-9dc7-405e-9d4d-634174b11f30 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:54.724723 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608c03d-9dc7-405e-9d4d-634174b11f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:54.746774 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f608c03d-9dc7-405e-9d4d-634174b11f30 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:54.748279 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f608c03d-9dc7-405e-9d4d-634174b11f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:54.863921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:54.877114 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 516/1029] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:54.947147 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aad0c-d29c-4c6a-b14a-109e351ce16f None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:54.947328 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aad0c-d29c-4c6a-b14a-109e351ce16f None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:54.947627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aad0c-d29c-4c6a-b14a-109e351ce16f None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:54.949217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 514/1030] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:29:54.954631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc17ac-2a47-4b20-ac3b-23e486581600 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:54.954954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc17ac-2a47-4b20-ac3b-23e486581600 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:54.955199 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc17ac-2a47-4b20-ac3b-23e486581600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:54.978163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-3abc17ac-2a47-4b20-ac3b-23e486581600 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:54.979760 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3abc17ac-2a47-4b20-ac3b-23e486581600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:55.091853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 517/1031] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:55.246405 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aad0c-d29c-4c6a-b14a-109e351ce16f None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:55.381212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc17ac-2a47-4b20-ac3b-23e486581600 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:55.392391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aad0c-d29c-4c6a-b14a-109e351ce16f None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:55.446086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127aa341-8707-4c16-87b9-6b90fdf66f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:55.447132 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127aa341-8707-4c16-87b9-6b90fdf66f28 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:55.447655 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127aa341-8707-4c16-87b9-6b90fdf66f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:55.448037 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127aa341-8707-4c16-87b9-6b90fdf66f28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:55.450026 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127aa341-8707-4c16-87b9-6b90fdf66f28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:55.452793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127aa341-8707-4c16-87b9-6b90fdf66f28 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:55.459537 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 515/1032] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:55.462796 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127aa341-8707-4c16-87b9-6b90fdf66f28 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:55.513903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc17ac-2a47-4b20-ac3b-23e486581600 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:55.553133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:55.572687 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e17a7f-920e-4956-9454-88bc436f725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:55.574343 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e17a7f-920e-4956-9454-88bc436f725d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:55.575127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e17a7f-920e-4956-9454-88bc436f725d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:55.575854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e17a7f-920e-4956-9454-88bc436f725d None admin] PATH_INFO: `/v3/services/image` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:55.577297 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e17a7f-920e-4956-9454-88bc436f725d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:55.580338 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e17a7f-920e-4956-9454-88bc436f725d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:55.584535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:55.601832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-16e17a7f-920e-4956-9454-88bc436f725d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 16:29:55.601832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:55.601832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:29:55.601832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:29:55.601832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:29:55.601832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:29:55.601832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:29:55.601832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:55.601832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 16:29:55.601832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:55.601832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:29:55.601832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:55.601832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:55.601832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:55.601832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:55.601832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:55.601832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:55.603964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:55.603964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:55.603964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:55.603964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:55.603964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:55.603964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:55.603964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:29:55.603964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:29:55.603964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:29:55.603964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:29:55.603964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:55.603964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:55.603964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:55.603964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:55.603964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:55.603964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:55.614653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:55.614653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:55.614653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:55.614653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:55.614653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:55.614653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:55.614653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:55.614653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:55.614653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:55.614653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:55.614653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:29:55.614653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:29:55.614653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 16:29:55.614653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:55.614653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 518/1033] 10.222.0.25 () {56 vars in 1105 bytes} [Wed Sep 7 16:29:55 2022] GET /identity/v3/services/image => generated 86 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:55.616303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e17a7f-920e-4956-9454-88bc436f725d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:55.641756 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127aa341-8707-4c16-87b9-6b90fdf66f28 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:55.692550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e0ffa-2550-435f-9992-d496da5a9952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:55.693837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e0ffa-2550-435f-9992-d496da5a9952 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:55.694369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e0ffa-2550-435f-9992-d496da5a9952 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:55.694843 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e0ffa-2550-435f-9992-d496da5a9952 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:55.695801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e0ffa-2550-435f-9992-d496da5a9952 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:55.698400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e0ffa-2550-435f-9992-d496da5a9952 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:55.773083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e17a7f-920e-4956-9454-88bc436f725d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:55.823512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 516/1034] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:29:55 2022] POST /identity/v3/users => generated 285 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:29:55.826466 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc0342-54f2-425c-ba61-0f8cbf446711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:55.827191 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc0342-54f2-425c-ba61-0f8cbf446711 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:55.827899 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc0342-54f2-425c-ba61-0f8cbf446711 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:55.828014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc0342-54f2-425c-ba61-0f8cbf446711 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:55.828754 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc0342-54f2-425c-ba61-0f8cbf446711 None admin] RBAC: Adding query filter params (name=image) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:55.829229 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc0342-54f2-425c-ba61-0f8cbf446711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:55.830722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc0342-54f2-425c-ba61-0f8cbf446711 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:55.843625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 519/1035] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:55.847991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e0ffa-2550-435f-9992-d496da5a9952 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:56.033645 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e0ffa-2550-435f-9992-d496da5a9952 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:56.064357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:56.089086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffafa3-25f0-49fa-916f-7c8f73e67bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:56.090116 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffafa3-25f0-49fa-916f-7c8f73e67bbf None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:56.090587 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffafa3-25f0-49fa-916f-7c8f73e67bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:56.091063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffafa3-25f0-49fa-916f-7c8f73e67bbf None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:56.092320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffafa3-25f0-49fa-916f-7c8f73e67bbf None admin] RBAC: Adding query filter params (type=image) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:56.092837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffafa3-25f0-49fa-916f-7c8f73e67bbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:56.095716 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffafa3-25f0-49fa-916f-7c8f73e67bbf None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:56.106499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 517/1036] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:56.114172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc0342-54f2-425c-ba61-0f8cbf446711 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:56.193606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:56.254008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc0342-54f2-425c-ba61-0f8cbf446711 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:56.300349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bbdcd-d919-490a-8d71-368452d46353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:56.300686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bbdcd-d919-490a-8d71-368452d46353 None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:56.301046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bbdcd-d919-490a-8d71-368452d46353 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:56.301213 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bbdcd-d919-490a-8d71-368452d46353 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:56.301877 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601bbdcd-d919-490a-8d71-368452d46353 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:56.303355 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601bbdcd-d919-490a-8d71-368452d46353 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:56.405199 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 520/1037] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:29:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:29:56.688060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb113cd-d918-43ad-a384-8823ba770a96 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:56.688392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb113cd-d918-43ad-a384-8823ba770a96 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:56.688605 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb113cd-d918-43ad-a384-8823ba770a96 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:56.690142 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 518/1038] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:56.696230 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00124f6-6af8-44a4-a769-ad4ff6579ca2 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:56.696618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00124f6-6af8-44a4-a769-ad4ff6579ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:56.696806 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00124f6-6af8-44a4-a769-ad4ff6579ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:56.715836 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-d00124f6-6af8-44a4-a769-ad4ff6579ca2 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:56.717030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-d00124f6-6af8-44a4-a769-ad4ff6579ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:56.805284 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 521/1039] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:57.078218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb113cd-d918-43ad-a384-8823ba770a96 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:57.272481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb113cd-d918-43ad-a384-8823ba770a96 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:57.335562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905c237-9062-402b-9375-3511adaf7ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:57.336609 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905c237-9062-402b-9375-3511adaf7ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:57.337109 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905c237-9062-402b-9375-3511adaf7ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:57.337591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905c237-9062-402b-9375-3511adaf7ac9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:57.357717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905c237-9062-402b-9375-3511adaf7ac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:29:57.367727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-8905c237-9062-402b-9375-3511adaf7ac9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 16:29:57.367727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:57.367727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:57.367727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:57.367727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:57.367727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:57.367727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:57.367727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:57.367727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:57.367727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:57.367727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:57.367727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:57.367727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:29:57.367727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:29:57.367727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:29:57.367727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:29:57.369126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:29:57.369126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:29:57.369126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:29:57.369126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:29:57.369126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:57.369126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:57.369126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:57.369126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:57.369126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:57.369126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:57.369126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:57.369126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:57.369126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:57.369126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:57.369126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:57.369126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:57.372551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:57.372551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:57.372551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:57.372551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:57.372551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:29:57.372551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:29:57.372551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:29:57.372551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:29:57.372551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:29:57.372551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:29:57.372551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 16:29:57.372551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:57.372551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 519/1040] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Sep 7 16:29:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:57.377329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00124f6-6af8-44a4-a769-ad4ff6579ca2 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:57.434495 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:57.536495 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00124f6-6af8-44a4-a769-ad4ff6579ca2 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:57.584231 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6442c-4475-4503-967a-743f4d9812c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:57.584924 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6442c-4475-4503-967a-743f4d9812c6 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:57.585197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6442c-4475-4503-967a-743f4d9812c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:57.585472 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6442c-4475-4503-967a-743f4d9812c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:57.586396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6442c-4475-4503-967a-743f4d9812c6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:57.586650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6442c-4475-4503-967a-743f4d9812c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:57.588036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6442c-4475-4503-967a-743f4d9812c6 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:57.599529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 522/1041] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Sep 7 16:29:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:57.606713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905c237-9062-402b-9375-3511adaf7ac9 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:57.694254 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:57.789275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905c237-9062-402b-9375-3511adaf7ac9 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:57.850148 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f8c62-929c-4518-8678-f4fb40cca023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:57.851150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f8c62-929c-4518-8678-f4fb40cca023 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:57.851696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f8c62-929c-4518-8678-f4fb40cca023 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:57.852198 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f8c62-929c-4518-8678-f4fb40cca023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:57.872408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f8c62-929c-4518-8678-f4fb40cca023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:57.875090 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f8c62-929c-4518-8678-f4fb40cca023 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:57.903897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-818f8c62-929c-4518-8678-f4fb40cca023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:57.903897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:57.903897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:57.903897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:57.903897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:57.903897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:57.903897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:57.903897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:57.903897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:57.903897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:57.903897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:57.903897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:57.903897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:57.903897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:57.903897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:57.903897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:57.904952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:57.904952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:57.904952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:57.904952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:57.904952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:57.904952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:57.904952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:57.904952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:57.904952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:57.904952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:57.904952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:57.904952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:57.904952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:57.904952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:57.904952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:57.904952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:57.904952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:57.905859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:57.905859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:57.905859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:57.907606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 520/1042] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:57.914305 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6442c-4475-4503-967a-743f4d9812c6 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:58.082824 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:58.088247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6442c-4475-4503-967a-743f4d9812c6 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:58.154816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3b213-c351-4148-aa7f-587be50665cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:58.155668 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3b213-c351-4148-aa7f-587be50665cb None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:58.156166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3b213-c351-4148-aa7f-587be50665cb None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:58.156617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3b213-c351-4148-aa7f-587be50665cb None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:58.157816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3b213-c351-4148-aa7f-587be50665cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:58.158366 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3b213-c351-4148-aa7f-587be50665cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:58.162005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3b213-c351-4148-aa7f-587be50665cb None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:58.183681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 523/1043] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:58.192796 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f8c62-929c-4518-8678-f4fb40cca023 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:58.336507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:58.348612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f8c62-929c-4518-8678-f4fb40cca023 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:58.391091 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c90f4b-b666-4cd8-865c-1161b70995ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:58.392114 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c90f4b-b666-4cd8-865c-1161b70995ab None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:58.392567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c90f4b-b666-4cd8-865c-1161b70995ab None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:58.393050 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c90f4b-b666-4cd8-865c-1161b70995ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:58.401243 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6e696-3234-44a7-b6f2-f10fb1d6338a None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:58.401547 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6e696-3234-44a7-b6f2-f10fb1d6338a None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:58.401783 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6e696-3234-44a7-b6f2-f10fb1d6338a None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:58.403292 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 524/1044] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:58.406108 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c90f4b-b666-4cd8-865c-1161b70995ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:58.407944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c90f4b-b666-4cd8-865c-1161b70995ab None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:58.409351 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb30d17-3521-4a40-817e-f131c7548e8e None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:58.409692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb30d17-3521-4a40-817e-f131c7548e8e None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:58.409967 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb30d17-3521-4a40-817e-f131c7548e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:58.421279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-38c90f4b-b666-4cd8-865c-1161b70995ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:29:58.421279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:58.421279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:58.421279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:58.421279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:58.421279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:58.421279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:58.421279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:58.421279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:58.421279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:58.421279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:58.421279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:58.421279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:29:58.421279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:29:58.421279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:29:58.421279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:58.422345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:58.423313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:58.423313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:58.423313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:29:58.423313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:29:58.423313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:29:58.423313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:29:58.423313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:29:58.423313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:29:58.423313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:29:58.423313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:58.425930 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 521/1045] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Sep 7 16:29:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:58.431720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c90f4b-b666-4cd8-865c-1161b70995ab None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:58.436665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-bdb30d17-3521-4a40-817e-f131c7548e8e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:58.443877 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-bdb30d17-3521-4a40-817e-f131c7548e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:58.551982 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 525/1046] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 16:29:58.562659 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c90f4b-b666-4cd8-865c-1161b70995ab None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:58.602340 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ed817-7860-46d3-92d3-5cdae1bad924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:58.603336 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ed817-7860-46d3-92d3-5cdae1bad924 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:58.603863 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ed817-7860-46d3-92d3-5cdae1bad924 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:58.604371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ed817-7860-46d3-92d3-5cdae1bad924 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:58.605316 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ed817-7860-46d3-92d3-5cdae1bad924 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:58.605828 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ed817-7860-46d3-92d3-5cdae1bad924 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:58.607456 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ed817-7860-46d3-92d3-5cdae1bad924 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:58.628206 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 522/1047] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Sep 7 16:29:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:58.636643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb30d17-3521-4a40-817e-f131c7548e8e None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:58.739578 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:58.751240 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb30d17-3521-4a40-817e-f131c7548e8e None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:58.802502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f86b60-a741-4a52-90c2-3f9e589bfc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:58.803561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86b60-a741-4a52-90c2-3f9e589bfc1f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:58.803977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86b60-a741-4a52-90c2-3f9e589bfc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:58.804393 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86b60-a741-4a52-90c2-3f9e589bfc1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:58.829635 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ed817-7860-46d3-92d3-5cdae1bad924 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:58.848669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:58.888547 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f86b60-a741-4a52-90c2-3f9e589bfc1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:58.889991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f86b60-a741-4a52-90c2-3f9e589bfc1f None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:58.971104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ed817-7860-46d3-92d3-5cdae1bad924 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:59.005811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:59.018555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 526/1048] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:29:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:29:59.018832 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54c424-a2a1-4fd9-85a7-f2d4c9a4f0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:59.019399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54c424-a2a1-4fd9-85a7-f2d4c9a4f0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:59.019737 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54c424-a2a1-4fd9-85a7-f2d4c9a4f0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:59.020013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54c424-a2a1-4fd9-85a7-f2d4c9a4f0c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:59.025360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb649be9-4d88-4afe-9728-096f5a243fdb None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:59.025656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb649be9-4d88-4afe-9728-096f5a243fdb None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:59.025978 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb649be9-4d88-4afe-9728-096f5a243fdb None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:59.027632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 527/1049] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:29:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:29:59.028460 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb649be9-4d88-4afe-9728-096f5a243fdb None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:59.041750 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54c424-a2a1-4fd9-85a7-f2d4c9a4f0c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:29:59.051981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-9a54c424-a2a1-4fd9-85a7-f2d4c9a4f0c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:29:59.051981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:59.051981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:59.051981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:59.051981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:59.051981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:59.051981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:59.051981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:59.051981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:59.051981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:59.051981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:59.051981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:59.051981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:29:59.051981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:29:59.051981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:29:59.051981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:29:59.053047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:29:59.053047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:29:59.053047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:29:59.053047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:29:59.053047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:59.053047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:59.053047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:59.053047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:59.053047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:59.053047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:59.053047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:59.053047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:59.053047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:59.053047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:59.053047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:59.053047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:59.053904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:59.053904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:59.053904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:59.053904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:59.053904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:29:59.053904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:29:59.053904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:29:59.053904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:29:59.053904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:29:59.053904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:29:59.053904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:29:59.053904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:59.053904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 523/1050] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:29:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:29:59.055963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32255142-033f-42e6-bed2-40ae2bda1328 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:59.056185 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32255142-033f-42e6-bed2-40ae2bda1328 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:59.056577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32255142-033f-42e6-bed2-40ae2bda1328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:59.084216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-32255142-033f-42e6-bed2-40ae2bda1328 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:29:59.086151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-32255142-033f-42e6-bed2-40ae2bda1328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:29:59.176604 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 524/1051] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:29:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:29:59.176958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb649be9-4d88-4afe-9728-096f5a243fdb None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:59.177449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32255142-033f-42e6-bed2-40ae2bda1328 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:59.185702 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:59.236408 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320b501-9cc3-4a92-ad96-131d68d9076e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:59.238325 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320b501-9cc3-4a92-ad96-131d68d9076e None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:59.238816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320b501-9cc3-4a92-ad96-131d68d9076e None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:59.239300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320b501-9cc3-4a92-ad96-131d68d9076e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:59.259838 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320b501-9cc3-4a92-ad96-131d68d9076e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:59.261978 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320b501-9cc3-4a92-ad96-131d68d9076e None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:59.293019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-e320b501-9cc3-4a92-ad96-131d68d9076e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:59.293019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:59.293019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:59.293019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:59.293019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:59.293019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:59.293019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:59.293019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:59.293019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:59.293019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:59.293019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:59.293019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:59.293019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:29:59.293019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:29:59.293019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:29:59.293019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:29:59.294072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:59.294072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:59.294072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:59.294072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:59.294072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:59.294072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:59.294072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:59.294072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:59.294072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:59.294072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:59.294072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:59.294072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:59.294072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:59.294072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:59.294072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:59.294072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:59.294072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:29:59.295011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:29:59.295011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:29:59.295011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:29:59.295011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 528/1052] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:59.303865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320b501-9cc3-4a92-ad96-131d68d9076e None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:59.312281 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32255142-033f-42e6-bed2-40ae2bda1328 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:59.354209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15689fcf-fed7-4fea-8ffa-f64a4ab7c860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:59.355224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15689fcf-fed7-4fea-8ffa-f64a4ab7c860 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:59.355811 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15689fcf-fed7-4fea-8ffa-f64a4ab7c860 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:59.356316 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15689fcf-fed7-4fea-8ffa-f64a4ab7c860 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:59.357278 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15689fcf-fed7-4fea-8ffa-f64a4ab7c860 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:59.357791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15689fcf-fed7-4fea-8ffa-f64a4ab7c860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:59.359380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15689fcf-fed7-4fea-8ffa-f64a4ab7c860 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:59.370353 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 525/1053] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:29:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:29:59.379933 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15689fcf-fed7-4fea-8ffa-f64a4ab7c860 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:59.382440 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:59.467259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:59.478569 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320b501-9cc3-4a92-ad96-131d68d9076e None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:59.506924 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15689fcf-fed7-4fea-8ffa-f64a4ab7c860 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:59.538416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa2bbd-659c-467c-9fb6-89a0efab860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:59.539416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa2bbd-659c-467c-9fb6-89a0efab860b None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:59.539895 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa2bbd-659c-467c-9fb6-89a0efab860b None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:59.540341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa2bbd-659c-467c-9fb6-89a0efab860b None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:59.541401 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa2bbd-659c-467c-9fb6-89a0efab860b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:29:59.541932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa2bbd-659c-467c-9fb6-89a0efab860b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:59.544506 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa2bbd-659c-467c-9fb6-89a0efab860b None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:59.548885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe5f16-ce1e-4803-b4ab-600987c6aa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:59.549562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe5f16-ce1e-4803-b4ab-600987c6aa31 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:59.550550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe5f16-ce1e-4803-b4ab-600987c6aa31 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:59.550831 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe5f16-ce1e-4803-b4ab-600987c6aa31 None admin] PATH_INFO: `/v3/users/b8d4d173dd994e67a6fb08b5dd27d910` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:59.563971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 529/1054] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:59.565386 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa2bbd-659c-467c-9fb6-89a0efab860b None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:59.567532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe5f16-ce1e-4803-b4ab-600987c6aa31 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d4d173dd994e67a6fb08b5dd27d910)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:59.569311 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe5f16-ce1e-4803-b4ab-600987c6aa31 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:59.575697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 526/1055] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:29:59 2022] GET /identity/v3/users/b8d4d173dd994e67a6fb08b5dd27d910 => generated 285 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:29:59.575697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe5f16-ce1e-4803-b4ab-600987c6aa31 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:59.693680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa2bbd-659c-467c-9fb6-89a0efab860b None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:59.695337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:59.726636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe5f16-ce1e-4803-b4ab-600987c6aa31 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:59.737327 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e6380-0a46-4f18-8ac0-37ae4199f5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:59.738131 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e6380-0a46-4f18-8ac0-37ae4199f5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:59.738627 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e6380-0a46-4f18-8ac0-37ae4199f5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:59.739115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e6380-0a46-4f18-8ac0-37ae4199f5b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:59.753697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:29:59.779111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540abfb-2320-4025-ab2d-31d9ee1edfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:59.779111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540abfb-2320-4025-ab2d-31d9ee1edfca None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:59.779111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540abfb-2320-4025-ab2d-31d9ee1edfca None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:59.779111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540abfb-2320-4025-ab2d-31d9ee1edfca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:59.779601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540abfb-2320-4025-ab2d-31d9ee1edfca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:59.779601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540abfb-2320-4025-ab2d-31d9ee1edfca None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:59.789061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-c540abfb-2320-4025-ab2d-31d9ee1edfca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:59.789061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:29:59.789061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:29:59.789061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:29:59.789061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:29:59.789061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:29:59.789061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:29:59.789061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:29:59.789061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:29:59.789061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:29:59.789061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:29:59.789061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:29:59.789061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:29:59.789061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:29:59.789061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:29:59.790104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:29:59.790104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:29:59.790104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:29:59.790104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:29:59.790104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:29:59.790104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:29:59.790104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:29:59.790104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:29:59.790104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:29:59.790104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:29:59.790104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:29:59.790104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:29:59.790104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:29:59.790104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:29:59.790104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:29:59.790104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:29:59.790104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:29:59.791247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:29:59.791247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:29:59.791247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:29:59.791247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:29:59.791247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:29:59.791247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:29:59.791247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:29:59.791247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:29:59.791247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 527/1056] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:29:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:29:59.791247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540abfb-2320-4025-ab2d-31d9ee1edfca None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:59.829109 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e6380-0a46-4f18-8ac0-37ae4199f5b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:29:59.830656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e6380-0a46-4f18-8ac0-37ae4199f5b0 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:29:59.921395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540abfb-2320-4025-ab2d-31d9ee1edfca None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:29:59.959997 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 530/1057] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:29:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:29:59.960873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e6380-0a46-4f18-8ac0-37ae4199f5b0 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:29:59.961242 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e67ad-c2d1-4aed-bdf9-0748c25f6811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:29:59.961880 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e67ad-c2d1-4aed-bdf9-0748c25f6811 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:29:59.962150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e67ad-c2d1-4aed-bdf9-0748c25f6811 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:29:59.962429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e67ad-c2d1-4aed-bdf9-0748c25f6811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:29:59.964035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:00.031619 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:00.054169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e67ad-c2d1-4aed-bdf9-0748c25f6811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:00.055671 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e67ad-c2d1-4aed-bdf9-0748c25f6811 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:00.103169 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e6380-0a46-4f18-8ac0-37ae4199f5b0 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:00.145493 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965906de-6bbd-4d37-9885-479dda294e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:00.146111 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965906de-6bbd-4d37-9885-479dda294e0d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:00.146391 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965906de-6bbd-4d37-9885-479dda294e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:00.146662 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965906de-6bbd-4d37-9885-479dda294e0d None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:00.147356 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965906de-6bbd-4d37-9885-479dda294e0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:00.148214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965906de-6bbd-4d37-9885-479dda294e0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:00.149126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965906de-6bbd-4d37-9885-479dda294e0d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:00.162477 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 531/1058] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:29:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:00.163435 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965906de-6bbd-4d37-9885-479dda294e0d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:00.177667 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 528/1059] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:29:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:30:00.179086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e67ad-c2d1-4aed-bdf9-0748c25f6811 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:00.233066 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:00.270792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:00.274270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965906de-6bbd-4d37-9885-479dda294e0d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:00.287544 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e67ad-c2d1-4aed-bdf9-0748c25f6811 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:00.348203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012de11d-b443-42dd-a2d8-0b1b6a9520a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:00.348874 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012de11d-b443-42dd-a2d8-0b1b6a9520a0 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:00.349102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012de11d-b443-42dd-a2d8-0b1b6a9520a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:00.349466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012de11d-b443-42dd-a2d8-0b1b6a9520a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:00.350209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012de11d-b443-42dd-a2d8-0b1b6a9520a0 None admin] RBAC: Adding query filter params (role.id=9fea51971cb64ba480f210a7c4679c9c, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=cf48978c20f04173b114e15e1ce2157c) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:00.350521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012de11d-b443-42dd-a2d8-0b1b6a9520a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:00.352157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012de11d-b443-42dd-a2d8-0b1b6a9520a0 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:00.352629 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803461c-2a73-46da-a209-2ae39ffec0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:00.353408 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803461c-2a73-46da-a209-2ae39ffec0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:00.353821 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803461c-2a73-46da-a209-2ae39ffec0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:00.354433 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803461c-2a73-46da-a209-2ae39ffec0c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:00.359900 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 529/1060] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:30:00 2022] GET /identity/v3/role_assignments?user.id=cf48978c20f04173b114e15e1ce2157c&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9fea51971cb64ba480f210a7c4679c9c => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:00.361078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012de11d-b443-42dd-a2d8-0b1b6a9520a0 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:00.376042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803461c-2a73-46da-a209-2ae39ffec0c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:00.378675 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803461c-2a73-46da-a209-2ae39ffec0c9 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:00.401654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-f803461c-2a73-46da-a209-2ae39ffec0c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:30:00.401654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:00.401654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:00.401654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:00.401654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:00.401654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:00.401654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:00.401654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:00.401654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:00.401654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:00.401654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:00.401654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:00.401654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:30:00.401654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:30:00.401654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:30:00.401654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:30:00.402691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:00.402691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:00.402691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:00.402691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:00.402691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:00.402691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:00.402691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:00.402691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:00.402691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:00.402691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:00.402691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:00.402691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:00.402691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:00.402691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:00.402691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:00.402691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:00.402691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:30:00.403636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:30:00.403636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:30:00.403636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:30:00.406019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 532/1061] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:30:00.414032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803461c-2a73-46da-a209-2ae39ffec0c9 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:00.533033 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012de11d-b443-42dd-a2d8-0b1b6a9520a0 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:00.600529 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bb896-7106-4da3-a051-36e098fafeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:00.601743 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bb896-7106-4da3-a051-36e098fafeb1 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:00.602247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bb896-7106-4da3-a051-36e098fafeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:00.602731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bb896-7106-4da3-a051-36e098fafeb1 None admin] PATH_INFO: `/v3/projects/e2ba6a5faff542cc93faba79130600d4` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:00.604898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bb896-7106-4da3-a051-36e098fafeb1 None admin] RBAC: Authorizing `identity:get_project(project_id=e2ba6a5faff542cc93faba79130600d4)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:00.607238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bb896-7106-4da3-a051-36e098fafeb1 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:00.609739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 530/1062] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:30:00 2022] GET /identity/v3/projects/e2ba6a5faff542cc93faba79130600d4 => generated 311 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:00.616458 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803461c-2a73-46da-a209-2ae39ffec0c9 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:00.621322 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bb896-7106-4da3-a051-36e098fafeb1 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:00.634887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:00.646046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:00.678360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bb5de-7a1e-4cfa-98d5-175f2dcca860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:00.679089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bb5de-7a1e-4cfa-98d5-175f2dcca860 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:00.679568 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bb5de-7a1e-4cfa-98d5-175f2dcca860 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:00.680039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bb5de-7a1e-4cfa-98d5-175f2dcca860 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:00.681019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bb5de-7a1e-4cfa-98d5-175f2dcca860 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:00.681504 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bb5de-7a1e-4cfa-98d5-175f2dcca860 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:00.683283 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bb5de-7a1e-4cfa-98d5-175f2dcca860 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:00.706639 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 533/1063] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:00.770644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bb896-7106-4da3-a051-36e098fafeb1 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:00.812791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48b857-c6c0-411c-8ec1-396a20a1accf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:00.813463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48b857-c6c0-411c-8ec1-396a20a1accf None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:00.813739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48b857-c6c0-411c-8ec1-396a20a1accf None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:00.814007 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48b857-c6c0-411c-8ec1-396a20a1accf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:00.814748 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48b857-c6c0-411c-8ec1-396a20a1accf None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=e2ba6a5faff542cc93faba79130600d4, user.id=b8d4d173dd994e67a6fb08b5dd27d910) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:00.815788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48b857-c6c0-411c-8ec1-396a20a1accf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:00.817437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48b857-c6c0-411c-8ec1-396a20a1accf None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:00.824545 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 531/1064] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:30:00 2022] GET /identity/v3/role_assignments?user.id=b8d4d173dd994e67a6fb08b5dd27d910&scope.project.id=e2ba6a5faff542cc93faba79130600d4&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:02.596375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adef4ae-82b9-43e6-9487-2a55b45d49fb None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:02.597221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adef4ae-82b9-43e6-9487-2a55b45d49fb None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:02.597221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adef4ae-82b9-43e6-9487-2a55b45d49fb None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:02.599557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 534/1065] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:02.607172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa487d6-1086-4f6a-90b2-f0879f1980ec None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:02.608029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa487d6-1086-4f6a-90b2-f0879f1980ec None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:02.608184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa487d6-1086-4f6a-90b2-f0879f1980ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:02.629699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-5aa487d6-1086-4f6a-90b2-f0879f1980ec None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:02.631077 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-5aa487d6-1086-4f6a-90b2-f0879f1980ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:02.745947 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 532/1066] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:03.014260 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adef4ae-82b9-43e6-9487-2a55b45d49fb None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:03.140922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adef4ae-82b9-43e6-9487-2a55b45d49fb None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:03.181391 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3922630-f07b-4037-9e27-04db526f77e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:03.182024 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3922630-f07b-4037-9e27-04db526f77e7 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:03.182302 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3922630-f07b-4037-9e27-04db526f77e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:03.182570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3922630-f07b-4037-9e27-04db526f77e7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:03.195121 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3922630-f07b-4037-9e27-04db526f77e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:30:03.200116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-d3922630-f07b-4037-9e27-04db526f77e7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 16:30:03.200116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:03.200116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:03.200116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:03.200116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:03.200116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:03.200116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:03.200116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:03.200116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:03.200116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:03.200116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:03.200116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:03.200116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:30:03.200116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:30:03.200116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:30:03.200116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:30:03.201320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:30:03.201320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:30:03.201320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:30:03.201320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:30:03.201320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:03.201320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:03.201320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:03.201320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:03.201320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:03.201320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:03.201320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:03.201320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:03.201320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:03.201320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:03.201320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:03.201320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:03.202315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:03.202315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:03.202315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:03.202315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:03.202315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:30:03.202315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:30:03.202315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:30:03.202315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:30:03.202315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:30:03.202315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:30:03.202315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 16:30:03.202315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:30:03.202315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 535/1067] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Sep 7 16:30:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:30:03.207846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa487d6-1086-4f6a-90b2-f0879f1980ec None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:03.215878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dcb90-2762-4902-9b0c-4307356b71a9 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:03.216267 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dcb90-2762-4902-9b0c-4307356b71a9 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:03.216615 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dcb90-2762-4902-9b0c-4307356b71a9 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:03.221709 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 536/1068] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:03.222968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:03.229763 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae8b39-b1c5-44e1-a117-33b178136fbc None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:03.230222 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae8b39-b1c5-44e1-a117-33b178136fbc None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:03.230703 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae8b39-b1c5-44e1-a117-33b178136fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:03.251523 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-32ae8b39-b1c5-44e1-a117-33b178136fbc None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:03.253452 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-32ae8b39-b1c5-44e1-a117-33b178136fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:03.285861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:03.328253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa487d6-1086-4f6a-90b2-f0879f1980ec None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:03.332951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 537/1069] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:03.368577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265dce6-9ae9-4dbc-9660-072d0ae05369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:03.369196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265dce6-9ae9-4dbc-9660-072d0ae05369 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:03.369471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265dce6-9ae9-4dbc-9660-072d0ae05369 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:03.369742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265dce6-9ae9-4dbc-9660-072d0ae05369 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:03.370412 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265dce6-9ae9-4dbc-9660-072d0ae05369 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:03.370710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265dce6-9ae9-4dbc-9660-072d0ae05369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:03.372383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265dce6-9ae9-4dbc-9660-072d0ae05369 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:03.382265 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 533/1070] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Sep 7 16:30:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:03.388718 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae8b39-b1c5-44e1-a117-33b178136fbc None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:03.528652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae8b39-b1c5-44e1-a117-33b178136fbc None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:03.580461 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcf39b-fc02-4855-9ed4-d53c5d182167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:03.581042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcf39b-fc02-4855-9ed4-d53c5d182167 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:03.581308 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcf39b-fc02-4855-9ed4-d53c5d182167 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:03.581581 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcf39b-fc02-4855-9ed4-d53c5d182167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:03.592587 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcf39b-fc02-4855-9ed4-d53c5d182167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:03.594303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcf39b-fc02-4855-9ed4-d53c5d182167 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:03.607402 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265dce6-9ae9-4dbc-9660-072d0ae05369 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:03.613631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-3ebcf39b-fc02-4855-9ed4-d53c5d182167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:30:03.613631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:03.613631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:03.613631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:03.613631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:03.613631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:03.613631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:03.613631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:03.613631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:03.613631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:03.613631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:03.613631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:03.613631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:30:03.613631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:30:03.613631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:30:03.613631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:30:03.615089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:03.615089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:03.615089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:03.615089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:03.615089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:03.615089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:03.615089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:03.615089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:03.615089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:03.615089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:03.615089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:03.615089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:03.615089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:03.615089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:03.615089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:03.615089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:03.615089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:30:03.616067 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:30:03.616067 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:30:03.616067 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:30:03.616067 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 538/1071] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:30:03.620767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcf39b-fc02-4855-9ed4-d53c5d182167 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:03.639652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:03.698327 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:03.744708 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265dce6-9ae9-4dbc-9660-072d0ae05369 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:03.754750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcf39b-fc02-4855-9ed4-d53c5d182167 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:03.801795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b76842-6c44-46e9-85f7-9fc6824ba9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:03.802417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b76842-6c44-46e9-85f7-9fc6824ba9ed None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:03.802691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b76842-6c44-46e9-85f7-9fc6824ba9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:03.802958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b76842-6c44-46e9-85f7-9fc6824ba9ed None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:03.803217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb082a-195c-4fcb-bff3-76cc7f5b778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:03.803673 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b76842-6c44-46e9-85f7-9fc6824ba9ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:03.803975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b76842-6c44-46e9-85f7-9fc6824ba9ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:03.804223 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb082a-195c-4fcb-bff3-76cc7f5b778b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:03.804706 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb082a-195c-4fcb-bff3-76cc7f5b778b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:03.805195 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb082a-195c-4fcb-bff3-76cc7f5b778b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:03.805389 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b76842-6c44-46e9-85f7-9fc6824ba9ed None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:03.819033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 539/1072] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:30:03.821586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb082a-195c-4fcb-bff3-76cc7f5b778b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:30:03.824967 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b76842-6c44-46e9-85f7-9fc6824ba9ed None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:03.827113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-6afb082a-195c-4fcb-bff3-76cc7f5b778b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:30:03.827113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:03.827113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:03.827113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:03.827113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:03.827113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:03.827113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:03.827113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:03.827113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:03.827113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:03.827113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:03.827113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:03.827113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:30:03.827113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:30:03.827113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:30:03.827113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:30:03.829035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:30:03.829035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:30:03.829035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:30:03.829035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:30:03.829035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:03.829035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:03.829035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:03.829035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:03.829035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:03.829035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:03.829035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:03.829035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:03.829035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:03.829035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:03.829035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:03.829035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:03.831665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:03.831665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:03.831665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:03.831665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:03.831665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:30:03.831665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:30:03.831665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:30:03.831665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:30:03.831665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:30:03.831665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:30:03.831665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:30:03.831665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:30:03.831665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 534/1073] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:30:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:30:03.839230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb082a-195c-4fcb-bff3-76cc7f5b778b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:03.918413 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:03.943653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b76842-6c44-46e9-85f7-9fc6824ba9ed None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:03.977892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb082a-195c-4fcb-bff3-76cc7f5b778b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:03.993364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793e4c2-abcb-4424-b153-fa657b7462b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:03.994008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793e4c2-abcb-4424-b153-fa657b7462b6 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:03.994285 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793e4c2-abcb-4424-b153-fa657b7462b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:03.994557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793e4c2-abcb-4424-b153-fa657b7462b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:04.004340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793e4c2-abcb-4424-b153-fa657b7462b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:04.005810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793e4c2-abcb-4424-b153-fa657b7462b6 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:04.011264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:04.016774 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58231e-497f-4910-9040-847d2a33093b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:04.017390 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58231e-497f-4910-9040-847d2a33093b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:04.019669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58231e-497f-4910-9040-847d2a33093b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:04.019669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58231e-497f-4910-9040-847d2a33093b None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:04.019669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58231e-497f-4910-9040-847d2a33093b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:04.019669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58231e-497f-4910-9040-847d2a33093b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:04.020454 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58231e-497f-4910-9040-847d2a33093b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:04.021630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-7793e4c2-abcb-4424-b153-fa657b7462b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:30:04.021630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:04.021630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:04.021630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:04.021630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:04.021630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:04.021630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:04.021630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:04.021630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:04.021630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:04.021630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:04.021630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:04.021630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:30:04.021630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:30:04.021630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:30:04.021630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:04.022626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:04.023808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:04.023808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:04.023808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:30:04.023808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:30:04.023808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:30:04.023808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:30:04.023808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:30:04.023808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:30:04.023808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:30:04.023808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:30:04.023808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 540/1074] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Sep 7 16:30:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:30:04.028875 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793e4c2-abcb-4424-b153-fa657b7462b6 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:04.031145 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 535/1075] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:30:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:04.037876 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58231e-497f-4910-9040-847d2a33093b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:04.154503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793e4c2-abcb-4424-b153-fa657b7462b6 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:04.155844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58231e-497f-4910-9040-847d2a33093b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:04.193884 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cfe56-8993-4fca-96cc-57e43191537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:04.194500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cfe56-8993-4fca-96cc-57e43191537a None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:04.194775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cfe56-8993-4fca-96cc-57e43191537a None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:04.195053 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cfe56-8993-4fca-96cc-57e43191537a None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:04.195817 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cfe56-8993-4fca-96cc-57e43191537a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:04.202556 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cfe56-8993-4fca-96cc-57e43191537a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:04.202688 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040337d9-9678-47c3-b2ec-62050269dbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:04.202688 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040337d9-9678-47c3-b2ec-62050269dbdb None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:04.202688 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040337d9-9678-47c3-b2ec-62050269dbdb None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:04.202972 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cfe56-8993-4fca-96cc-57e43191537a None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:04.203057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040337d9-9678-47c3-b2ec-62050269dbdb None admin] PATH_INFO: `/v3/users/b8d4d173dd994e67a6fb08b5dd27d910` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:04.203057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040337d9-9678-47c3-b2ec-62050269dbdb None admin] RBAC: Authorizing `identity:get_user(user_id=b8d4d173dd994e67a6fb08b5dd27d910)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:04.203057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040337d9-9678-47c3-b2ec-62050269dbdb None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:04.203279 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:04.203353 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 536/1076] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:30:04 2022] GET /identity/v3/users/b8d4d173dd994e67a6fb08b5dd27d910 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:04.208238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040337d9-9678-47c3-b2ec-62050269dbdb None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:04.218113 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 541/1077] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Sep 7 16:30:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:30:04.225309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cfe56-8993-4fca-96cc-57e43191537a None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:04.282449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:04.324201 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040337d9-9678-47c3-b2ec-62050269dbdb None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:04.359971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cfe56-8993-4fca-96cc-57e43191537a None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:04.362663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13596e55-91c3-4363-99d3-3a898f682e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:04.362663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13596e55-91c3-4363-99d3-3a898f682e0b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:04.362663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13596e55-91c3-4363-99d3-3a898f682e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:04.362663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13596e55-91c3-4363-99d3-3a898f682e0b None admin] PATH_INFO: `/v3/projects/e2ba6a5faff542cc93faba79130600d4` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:04.363835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13596e55-91c3-4363-99d3-3a898f682e0b None admin] RBAC: Authorizing `identity:get_project(project_id=e2ba6a5faff542cc93faba79130600d4)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:04.365298 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13596e55-91c3-4363-99d3-3a898f682e0b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:04.367005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 537/1078] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:30:04 2022] GET /identity/v3/projects/e2ba6a5faff542cc93faba79130600d4 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:04.373076 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13596e55-91c3-4363-99d3-3a898f682e0b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:04.399260 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a1613-f612-400d-bb5c-f5755a0a295d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:04.400346 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a1613-f612-400d-bb5c-f5755a0a295d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:04.400617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a1613-f612-400d-bb5c-f5755a0a295d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:04.400885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a1613-f612-400d-bb5c-f5755a0a295d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:04.412508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a1613-f612-400d-bb5c-f5755a0a295d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:04.413958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a1613-f612-400d-bb5c-f5755a0a295d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:04.430382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-1a5a1613-f612-400d-bb5c-f5755a0a295d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:30:04.430382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:04.430382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:04.430382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:04.430382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:04.430382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:04.430382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:04.430382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:04.430382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:04.430382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:04.430382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:04.430382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:04.430382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:30:04.430382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:30:04.430382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:30:04.430382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:30:04.432037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:04.432037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:04.432037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:04.432037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:04.432037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:04.432037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:04.432037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:04.432037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:04.432037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:04.432037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:04.432037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:04.432037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:04.432037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:04.432037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:04.432037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:04.432037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:04.432037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:30:04.433993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:30:04.433993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:30:04.433993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:30:04.433993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 542/1079] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:30:04.437550 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a1613-f612-400d-bb5c-f5755a0a295d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:04.491277 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:04.494587 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13596e55-91c3-4363-99d3-3a898f682e0b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:04.526887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:04.533108 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c2830-c08f-401b-9c19-34b219fce88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:04.536507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c2830-c08f-401b-9c19-34b219fce88a None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:04.536788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c2830-c08f-401b-9c19-34b219fce88a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:04.537108 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c2830-c08f-401b-9c19-34b219fce88a None admin] PATH_INFO: `/v3/projects/e2ba6a5faff542cc93faba79130600d4/users/b8d4d173dd994e67a6fb08b5dd27d910/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:04.539226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c2830-c08f-401b-9c19-34b219fce88a None admin] RBAC: Authorizing `identity:create_grant(project_id=e2ba6a5faff542cc93faba79130600d4, user_id=b8d4d173dd994e67a6fb08b5dd27d910, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:04.540834 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c2830-c08f-401b-9c19-34b219fce88a None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:04.554463 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a1613-f612-400d-bb5c-f5755a0a295d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:04.594741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106ad26-e9e6-4d43-b33f-f31f7a72e60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:04.595375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106ad26-e9e6-4d43-b33f-f31f7a72e60c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:04.595686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106ad26-e9e6-4d43-b33f-f31f7a72e60c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:04.596565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106ad26-e9e6-4d43-b33f-f31f7a72e60c None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:04.597229 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106ad26-e9e6-4d43-b33f-f31f7a72e60c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:04.597530 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106ad26-e9e6-4d43-b33f-f31f7a72e60c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:04.598920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106ad26-e9e6-4d43-b33f-f31f7a72e60c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:04.612763 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 543/1080] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:30:04.619012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106ad26-e9e6-4d43-b33f-f31f7a72e60c None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:04.624174 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 538/1081] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:30:04 2022] PUT /identity/v3/projects/e2ba6a5faff542cc93faba79130600d4/users/b8d4d173dd994e67a6fb08b5dd27d910/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:30:04.768745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106ad26-e9e6-4d43-b33f-f31f7a72e60c None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:04.780143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:04.821421 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b15e9-eb55-4514-8bac-2c6d672023fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:04.823201 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b15e9-eb55-4514-8bac-2c6d672023fa None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:04.823201 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b15e9-eb55-4514-8bac-2c6d672023fa None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:04.823201 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b15e9-eb55-4514-8bac-2c6d672023fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:04.831139 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b15e9-eb55-4514-8bac-2c6d672023fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:04.832709 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b15e9-eb55-4514-8bac-2c6d672023fa None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:04.845192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-f88b15e9-eb55-4514-8bac-2c6d672023fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:30:04.845192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:04.845192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:04.845192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:04.845192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:04.845192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:04.845192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:04.845192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:04.845192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:04.845192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:04.845192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:04.845192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:04.845192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:30:04.845192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:30:04.845192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:30:04.847069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:30:04.847069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:04.847069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:04.847069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:04.847069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:04.847069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:04.847069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:04.847069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:04.847069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:04.847069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:04.847069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:04.847069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:04.847069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:04.847069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:04.847069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:04.847069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:04.847069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:04.848854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:30:04.848854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:30:04.848854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:30:04.848854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:30:04.848854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:30:04.848854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:30:04.848854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:30:04.848854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:30:04.848854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 544/1082] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:30:04.853258 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c2830-c08f-401b-9c19-34b219fce88a None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:04.968328 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c2830-c08f-401b-9c19-34b219fce88a None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:05.010514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db62b7a-af20-4626-a1c7-a8a56ece5e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:05.011149 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db62b7a-af20-4626-a1c7-a8a56ece5e8e None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:05.011421 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db62b7a-af20-4626-a1c7-a8a56ece5e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:05.011721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db62b7a-af20-4626-a1c7-a8a56ece5e8e None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:05.012439 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db62b7a-af20-4626-a1c7-a8a56ece5e8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:05.012740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db62b7a-af20-4626-a1c7-a8a56ece5e8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:05.014226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db62b7a-af20-4626-a1c7-a8a56ece5e8e None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:05.028687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 539/1083] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:30:05.035151 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b15e9-eb55-4514-8bac-2c6d672023fa None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:05.160156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b15e9-eb55-4514-8bac-2c6d672023fa None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:05.199107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037b236-5ce0-4be4-a93c-00d1bd94dcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:05.200385 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037b236-5ce0-4be4-a93c-00d1bd94dcd6 None admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:05.200385 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037b236-5ce0-4be4-a93c-00d1bd94dcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:05.200385 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037b236-5ce0-4be4-a93c-00d1bd94dcd6 None admin] PATH_INFO: `/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/cf48978c20f04173b114e15e1ce2157c/roles/9fea51971cb64ba480f210a7c4679c9c` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:05.202766 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037b236-5ce0-4be4-a93c-00d1bd94dcd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1180c1ddef2b493f83c41425fd2e7917, user_id=cf48978c20f04173b114e15e1ce2157c, role_id=9fea51971cb64ba480f210a7c4679c9c)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:05.204231 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037b236-5ce0-4be4-a93c-00d1bd94dcd6 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:05.323164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 545/1084] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:30:05 2022] PUT /identity/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/cf48978c20f04173b114e15e1ce2157c/roles/9fea51971cb64ba480f210a7c4679c9c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:30:06.881135 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857037b-9c61-497a-bdc6-fa83661f8b29 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:06.881704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857037b-9c61-497a-bdc6-fa83661f8b29 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:06.881704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857037b-9c61-497a-bdc6-fa83661f8b29 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:06.883015 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 540/1085] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:06.888477 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45453c-d4c5-4af0-90df-53d7111e4c16 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:06.888912 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45453c-d4c5-4af0-90df-53d7111e4c16 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:06.889055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45453c-d4c5-4af0-90df-53d7111e4c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:06.907565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-da45453c-d4c5-4af0-90df-53d7111e4c16 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:06.909265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-da45453c-d4c5-4af0-90df-53d7111e4c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:06.930712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:06.978947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 546/1086] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:07.257036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857037b-9c61-497a-bdc6-fa83661f8b29 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:07.311218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:07.367037 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857037b-9c61-497a-bdc6-fa83661f8b29 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:07.404056 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76da12-436c-4b82-ac5e-7abfc8768ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:07.404706 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76da12-436c-4b82-ac5e-7abfc8768ffb None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:07.404987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76da12-436c-4b82-ac5e-7abfc8768ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:07.405259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76da12-436c-4b82-ac5e-7abfc8768ffb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:07.417727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76da12-436c-4b82-ac5e-7abfc8768ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:30:07.423005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-8e76da12-436c-4b82-ac5e-7abfc8768ffb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:30:07.423005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:07.423005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:07.423005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:07.423005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:07.423005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:07.423005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:07.423005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:07.423005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:07.423005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:07.423005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:07.423005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:07.423005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:30:07.423005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:30:07.423005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:30:07.423005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:30:07.424864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:30:07.424864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:30:07.424864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:30:07.424864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:30:07.424864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:07.424864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:07.424864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:07.424864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:07.424864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:07.424864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:07.424864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:07.424864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:07.424864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:07.424864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:07.424864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:07.424864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:07.426165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:07.426165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:07.426165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:07.426165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:07.426165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:30:07.426165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:30:07.426165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:30:07.426165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:30:07.426165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:30:07.426165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:30:07.426165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:30:07.426165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:30:07.426165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 541/1087] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:30:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:30:07.431058 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45453c-d4c5-4af0-90df-53d7111e4c16 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:07.504198 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6c092-770f-41a0-ab10-4f6d738f65d9 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:07.504486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6c092-770f-41a0-ab10-4f6d738f65d9 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:07.504785 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6c092-770f-41a0-ab10-4f6d738f65d9 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:07.506136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 542/1088] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:30:07.511269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad567cb6-f80f-4c45-8cf1-108900cad263 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:07.511503 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad567cb6-f80f-4c45-8cf1-108900cad263 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:07.511792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad567cb6-f80f-4c45-8cf1-108900cad263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:07.530216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-ad567cb6-f80f-4c45-8cf1-108900cad263 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:07.531442 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ad567cb6-f80f-4c45-8cf1-108900cad263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:07.536129 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45453c-d4c5-4af0-90df-53d7111e4c16 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:07.571168 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0ad87-764d-4fd2-b1d7-478b6c49de60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:07.571819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0ad87-764d-4fd2-b1d7-478b6c49de60 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:07.572103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0ad87-764d-4fd2-b1d7-478b6c49de60 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:07.572380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0ad87-764d-4fd2-b1d7-478b6c49de60 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:07.573045 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0ad87-764d-4fd2-b1d7-478b6c49de60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:07.573348 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0ad87-764d-4fd2-b1d7-478b6c49de60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:07.574711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0ad87-764d-4fd2-b1d7-478b6c49de60 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:07.584310 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 547/1089] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:30:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:07.590267 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0ad87-764d-4fd2-b1d7-478b6c49de60 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:07.603501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 543/1090] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 16:30:07.610504 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:07.697651 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0ad87-764d-4fd2-b1d7-478b6c49de60 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:07.733714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ccfe2-4b5f-4a75-be7d-abe75b694ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:07.734342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ccfe2-4b5f-4a75-be7d-abe75b694ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:07.734623 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ccfe2-4b5f-4a75-be7d-abe75b694ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:07.734897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ccfe2-4b5f-4a75-be7d-abe75b694ef3 None admin] PATH_INFO: `/v3/users/b8d4d173dd994e67a6fb08b5dd27d910` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:07.736150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ccfe2-4b5f-4a75-be7d-abe75b694ef3 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d4d173dd994e67a6fb08b5dd27d910)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:07.737581 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ccfe2-4b5f-4a75-be7d-abe75b694ef3 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:07.739188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 548/1091] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:30:07 2022] GET /identity/v3/users/b8d4d173dd994e67a6fb08b5dd27d910 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:30:07.750077 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad567cb6-f80f-4c45-8cf1-108900cad263 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:07.797273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:07.864926 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad567cb6-f80f-4c45-8cf1-108900cad263 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:07.880872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ccfe2-4b5f-4a75-be7d-abe75b694ef3 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:07.904625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58c1e6-01a7-4551-9985-d7d55388f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:07.905293 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58c1e6-01a7-4551-9985-d7d55388f432 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:07.905546 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58c1e6-01a7-4551-9985-d7d55388f432 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:07.905820 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58c1e6-01a7-4551-9985-d7d55388f432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:07.988182 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:07.989220 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58c1e6-01a7-4551-9985-d7d55388f432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:07.990712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58c1e6-01a7-4551-9985-d7d55388f432 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:08.000100 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ccfe2-4b5f-4a75-be7d-abe75b694ef3 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:08.030739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:08.037422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0579c6-f891-47fa-9941-3749ab142aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:08.038092 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0579c6-f891-47fa-9941-3749ab142aac None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:08.038092 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0579c6-f891-47fa-9941-3749ab142aac None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:08.038618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0579c6-f891-47fa-9941-3749ab142aac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:08.056838 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0579c6-f891-47fa-9941-3749ab142aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:30:08.062094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-af0579c6-f891-47fa-9941-3749ab142aac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 16:30:08.062094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:08.062094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:08.062094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:08.062094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:08.062094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:08.062094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:08.062094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:08.062094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:08.062094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:08.062094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:08.062094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:08.062094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:30:08.062094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:30:08.062094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:30:08.062094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:30:08.066145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:30:08.066145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:30:08.066145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:30:08.066145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:30:08.066145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:08.066145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:08.066145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:08.066145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:08.066145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:08.066145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:08.066145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:08.066145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:08.066145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:08.066145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:08.066145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:08.066145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:08.067344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:08.067344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:08.067344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:08.067344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:08.067344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:30:08.067344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:30:08.067344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:30:08.067344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:30:08.067344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:30:08.067344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:30:08.067344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 16:30:08.067344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:30:08.067344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 549/1092] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Sep 7 16:30:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:30:08.070315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0579c6-f891-47fa-9941-3749ab142aac None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:08.112374 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 544/1093] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:30:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:30:08.118835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58c1e6-01a7-4551-9985-d7d55388f432 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:08.191561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0579c6-f891-47fa-9941-3749ab142aac None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:08.230699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58c1e6-01a7-4551-9985-d7d55388f432 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:08.233683 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb8463-d2f0-4b65-805d-d7b7564c699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:08.234289 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb8463-d2f0-4b65-805d-d7b7564c699c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:08.234562 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb8463-d2f0-4b65-805d-d7b7564c699c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:08.234836 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb8463-d2f0-4b65-805d-d7b7564c699c None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:08.235499 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb8463-d2f0-4b65-805d-d7b7564c699c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:08.235808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb8463-d2f0-4b65-805d-d7b7564c699c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:08.237797 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb8463-d2f0-4b65-805d-d7b7564c699c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:08.246573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 550/1094] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Sep 7 16:30:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:30:08.252934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb8463-d2f0-4b65-805d-d7b7564c699c None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:08.265707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:08.268063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe8dff-60ad-4ebd-8297-84ff7cd0a149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:08.268704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe8dff-60ad-4ebd-8297-84ff7cd0a149 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:08.268983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe8dff-60ad-4ebd-8297-84ff7cd0a149 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:08.269254 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe8dff-60ad-4ebd-8297-84ff7cd0a149 None admin] PATH_INFO: `/v3/projects/e2ba6a5faff542cc93faba79130600d4` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:08.270384 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe8dff-60ad-4ebd-8297-84ff7cd0a149 None admin] RBAC: Authorizing `identity:get_project(project_id=e2ba6a5faff542cc93faba79130600d4)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:08.271865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe8dff-60ad-4ebd-8297-84ff7cd0a149 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:08.279499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 545/1095] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:30:08 2022] GET /identity/v3/projects/e2ba6a5faff542cc93faba79130600d4 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:30:08.280257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe8dff-60ad-4ebd-8297-84ff7cd0a149 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:08.292714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:08.373195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb8463-d2f0-4b65-805d-d7b7564c699c None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:08.404276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe8dff-60ad-4ebd-8297-84ff7cd0a149 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:08.414731 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4166e7e-47ab-4382-88ec-21249824a8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:08.415798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4166e7e-47ab-4382-88ec-21249824a8ff None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:08.416269 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4166e7e-47ab-4382-88ec-21249824a8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:08.416732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4166e7e-47ab-4382-88ec-21249824a8ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:08.436157 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4166e7e-47ab-4382-88ec-21249824a8ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:08.437656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4166e7e-47ab-4382-88ec-21249824a8ff None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:08.453698 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678a4ff-4e7c-43d5-8c0e-57121bd78fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:08.454225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-d4166e7e-47ab-4382-88ec-21249824a8ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:30:08.454225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:08.454225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:08.454225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:08.454225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:08.454225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:08.454225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:08.454225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:08.454225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:08.454225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:08.454225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:08.454225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:08.454225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:30:08.454225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:30:08.454225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:30:08.454225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:30:08.455375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:08.455375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:08.455375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:08.455375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:08.455375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:08.455375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:08.455375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:08.455375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:08.455375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:08.455375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:08.455375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:08.455375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:08.455375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:08.455375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:08.455375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:08.455375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:08.455375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:30:08.456371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:30:08.456371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:30:08.456371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:30:08.456549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678a4ff-4e7c-43d5-8c0e-57121bd78fee None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:08.456549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678a4ff-4e7c-43d5-8c0e-57121bd78fee None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:08.456549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678a4ff-4e7c-43d5-8c0e-57121bd78fee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:08.456801 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 551/1096] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:30:08.456928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678a4ff-4e7c-43d5-8c0e-57121bd78fee None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=e2ba6a5faff542cc93faba79130600d4, user.id=b8d4d173dd994e67a6fb08b5dd27d910) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:08.456928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678a4ff-4e7c-43d5-8c0e-57121bd78fee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:08.457410 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678a4ff-4e7c-43d5-8c0e-57121bd78fee None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:08.461525 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4166e7e-47ab-4382-88ec-21249824a8ff None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:08.464822 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 546/1097] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:30:08 2022] GET /identity/v3/role_assignments?user.id=b8d4d173dd994e67a6fb08b5dd27d910&scope.project.id=e2ba6a5faff542cc93faba79130600d4&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:30:08.541789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:08.601839 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4166e7e-47ab-4382-88ec-21249824a8ff None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:08.644451 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e84ae8-121f-47da-9471-2e7488f365fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:08.645020 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e84ae8-121f-47da-9471-2e7488f365fc None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:08.645302 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e84ae8-121f-47da-9471-2e7488f365fc None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:08.645572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e84ae8-121f-47da-9471-2e7488f365fc None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:08.646215 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e84ae8-121f-47da-9471-2e7488f365fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:08.646518 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e84ae8-121f-47da-9471-2e7488f365fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:08.647922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e84ae8-121f-47da-9471-2e7488f365fc None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:08.661980 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 552/1098] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:30:08.667847 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678a4ff-4e7c-43d5-8c0e-57121bd78fee None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:08.743535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:08.772983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678a4ff-4e7c-43d5-8c0e-57121bd78fee None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:08.808207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03765e-367a-4c7c-988e-1d3c95dcf763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:08.808832 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03765e-367a-4c7c-988e-1d3c95dcf763 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:08.809102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03765e-367a-4c7c-988e-1d3c95dcf763 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:08.809366 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03765e-367a-4c7c-988e-1d3c95dcf763 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:08.817008 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03765e-367a-4c7c-988e-1d3c95dcf763 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:08.818459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03765e-367a-4c7c-988e-1d3c95dcf763 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:08.831155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-bc03765e-367a-4c7c-988e-1d3c95dcf763 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:30:08.831155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:08.831155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:08.831155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:08.831155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:08.831155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:08.831155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:08.831155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:08.831155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:08.831155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:08.831155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:08.831155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:08.831155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:30:08.831155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:30:08.831155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:30:08.831155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:08.832216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:08.833178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:08.833178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:08.833178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:30:08.833178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:30:08.833178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:30:08.833178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:30:08.833178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:30:08.833178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:30:08.833178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 16:30:08.833178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:30:08.833178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 547/1099] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Sep 7 16:30:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:30:08.838105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e84ae8-121f-47da-9471-2e7488f365fc None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:08.943166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e84ae8-121f-47da-9471-2e7488f365fc None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:08.964558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:08.979137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb24b13-8868-4584-81dd-9d12b8771d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:08.979804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb24b13-8868-4584-81dd-9d12b8771d9b None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:08.980173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb24b13-8868-4584-81dd-9d12b8771d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:08.980491 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb24b13-8868-4584-81dd-9d12b8771d9b None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:08.981214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb24b13-8868-4584-81dd-9d12b8771d9b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:08.981523 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb24b13-8868-4584-81dd-9d12b8771d9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:08.982954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb24b13-8868-4584-81dd-9d12b8771d9b None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:09.002784 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 553/1100] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Sep 7 16:30:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:09.008835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03765e-367a-4c7c-988e-1d3c95dcf763 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:09.112676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03765e-367a-4c7c-988e-1d3c95dcf763 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:09.143261 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:09.148478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766473e-cca2-4a3e-a100-e55a82362cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:09.149078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766473e-cca2-4a3e-a100-e55a82362cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:09.149350 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766473e-cca2-4a3e-a100-e55a82362cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:09.149619 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766473e-cca2-4a3e-a100-e55a82362cf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:09.219454 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766473e-cca2-4a3e-a100-e55a82362cf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:09.221203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766473e-cca2-4a3e-a100-e55a82362cf8 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:09.324682 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 548/1101] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:30:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:30:09.330926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb24b13-8868-4584-81dd-9d12b8771d9b None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:09.443659 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb24b13-8868-4584-81dd-9d12b8771d9b None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:09.482301 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8642d0-a689-47c1-a84d-bb2a0825e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:09.482855 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8642d0-a689-47c1-a84d-bb2a0825e67d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:09.483129 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8642d0-a689-47c1-a84d-bb2a0825e67d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:09.483394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8642d0-a689-47c1-a84d-bb2a0825e67d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:09.493580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8642d0-a689-47c1-a84d-bb2a0825e67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:09.494992 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8642d0-a689-47c1-a84d-bb2a0825e67d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:09.510588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-9e8642d0-a689-47c1-a84d-bb2a0825e67d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:30:09.510588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:09.510588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:09.510588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:09.510588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:09.510588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:09.510588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:09.510588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:09.510588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:09.510588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:09.510588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:09.510588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:09.510588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:30:09.510588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:30:09.510588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:30:09.510588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:30:09.511692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:09.511692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:09.511692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:09.511692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:09.511692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:09.511692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:09.511692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:09.511692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:09.511692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:09.511692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:09.511692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:09.511692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:09.511692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:09.511692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:09.511692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:09.511692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:09.511692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:30:09.512615 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:30:09.512615 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:30:09.512615 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:30:09.512615 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 554/1102] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:30:09.518087 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766473e-cca2-4a3e-a100-e55a82362cf8 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:09.547417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:09.618668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766473e-cca2-4a3e-a100-e55a82362cf8 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:09.653026 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5f9cd-ccce-4e5c-91c2-366240dedc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:09.653638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5f9cd-ccce-4e5c-91c2-366240dedc19 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:09.653919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5f9cd-ccce-4e5c-91c2-366240dedc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:09.654190 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5f9cd-ccce-4e5c-91c2-366240dedc19 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:09.654829 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5f9cd-ccce-4e5c-91c2-366240dedc19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:09.655131 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5f9cd-ccce-4e5c-91c2-366240dedc19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:09.656529 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5f9cd-ccce-4e5c-91c2-366240dedc19 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:09.671113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 549/1103] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:09.677437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8642d0-a689-47c1-a84d-bb2a0825e67d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:09.710711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:09.785727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8642d0-a689-47c1-a84d-bb2a0825e67d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:09.820097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcf54b-30e6-47d1-91b0-aacc389ecee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:09.820723 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcf54b-30e6-47d1-91b0-aacc389ecee6 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:09.820996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcf54b-30e6-47d1-91b0-aacc389ecee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:09.821267 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcf54b-30e6-47d1-91b0-aacc389ecee6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:09.827917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcf54b-30e6-47d1-91b0-aacc389ecee6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:09.829356 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcf54b-30e6-47d1-91b0-aacc389ecee6 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:09.841841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-2cfcf54b-30e6-47d1-91b0-aacc389ecee6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:30:09.841841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:09.841841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:09.841841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:09.841841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:09.841841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:09.841841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:09.841841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:09.841841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:09.841841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:09.841841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:09.841841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:09.841841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:30:09.841841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:30:09.841841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:30:09.842942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:30:09.842942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:09.842942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:09.842942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:09.842942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:09.842942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:09.842942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:09.842942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:09.842942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:09.842942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:09.842942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:09.842942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:09.842942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:09.842942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:09.842942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:09.842942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:09.842942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:09.849561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:30:09.849561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:30:09.849561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:30:09.849561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:30:09.849561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:30:09.849561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:30:09.849561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:30:09.849561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:30:09.849561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 555/1104] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:30:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:30:09.850092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5f9cd-ccce-4e5c-91c2-366240dedc19 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:09.949645 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:09.958576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5f9cd-ccce-4e5c-91c2-366240dedc19 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:09.998003 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f4d59-ee3a-4313-be92-96dfb278139e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:09.998609 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f4d59-ee3a-4313-be92-96dfb278139e None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:09.998883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f4d59-ee3a-4313-be92-96dfb278139e None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:09.999151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f4d59-ee3a-4313-be92-96dfb278139e None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:09.999863 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f4d59-ee3a-4313-be92-96dfb278139e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:10.000164 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f4d59-ee3a-4313-be92-96dfb278139e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:10.001633 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f4d59-ee3a-4313-be92-96dfb278139e None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:10.014530 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 550/1105] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:30:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:30:10.021416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcf54b-30e6-47d1-91b0-aacc389ecee6 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:10.122674 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:10.132187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcf54b-30e6-47d1-91b0-aacc389ecee6 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:10.166958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cf150-0442-4782-8911-4ef476954cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:10.167600 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cf150-0442-4782-8911-4ef476954cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:10.167879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cf150-0442-4782-8911-4ef476954cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:10.168149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cf150-0442-4782-8911-4ef476954cd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:10.168859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cf150-0442-4782-8911-4ef476954cd1 None admin] RBAC: Adding query filter params (role.id=9fea51971cb64ba480f210a7c4679c9c, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=cf48978c20f04173b114e15e1ce2157c) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:10.169165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cf150-0442-4782-8911-4ef476954cd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:10.170581 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cf150-0442-4782-8911-4ef476954cd1 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:10.176610 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 556/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:30:10 2022] GET /identity/v3/role_assignments?user.id=cf48978c20f04173b114e15e1ce2157c&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9fea51971cb64ba480f210a7c4679c9c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:30:10.708068 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081d7f7-65bd-4232-8660-29a0017d80cd None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:10.708423 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081d7f7-65bd-4232-8660-29a0017d80cd None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:10.708603 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081d7f7-65bd-4232-8660-29a0017d80cd None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:10.709977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 551/1107] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:10.715721 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67d29a-1fe9-47e0-8331-9573b198b7c4 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:10.716008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67d29a-1fe9-47e0-8331-9573b198b7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:10.716287 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67d29a-1fe9-47e0-8331-9573b198b7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:10.735089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-eb67d29a-1fe9-47e0-8331-9573b198b7c4 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:10.736852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-eb67d29a-1fe9-47e0-8331-9573b198b7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:10.808586 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 557/1108] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:11.086238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081d7f7-65bd-4232-8660-29a0017d80cd None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:11.208313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081d7f7-65bd-4232-8660-29a0017d80cd None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:11.243238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d893b08-5e62-41b3-a4ea-e5fe9dc3c8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:11.243961 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d893b08-5e62-41b3-a4ea-e5fe9dc3c8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:11.244257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d893b08-5e62-41b3-a4ea-e5fe9dc3c8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:11.244515 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d893b08-5e62-41b3-a4ea-e5fe9dc3c8a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:11.245636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d893b08-5e62-41b3-a4ea-e5fe9dc3c8a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:11.247078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d893b08-5e62-41b3-a4ea-e5fe9dc3c8a5 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:11.251509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 552/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:30:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:11.255414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67d29a-1fe9-47e0-8331-9573b198b7c4 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:11.342127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:11.359701 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67d29a-1fe9-47e0-8331-9573b198b7c4 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:11.394439 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f97a0a-7e97-4f37-9d75-c18eccddddf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:11.395425 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f97a0a-7e97-4f37-9d75-c18eccddddf1 None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:11.395822 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f97a0a-7e97-4f37-9d75-c18eccddddf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:11.396234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f97a0a-7e97-4f37-9d75-c18eccddddf1 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:11.397310 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f97a0a-7e97-4f37-9d75-c18eccddddf1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:11.398906 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f97a0a-7e97-4f37-9d75-c18eccddddf1 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:11.497222 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 558/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:30:11 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:30:13.733175 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea38279-7cdd-4f10-bcad-a24499e5fab8 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:13.733754 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea38279-7cdd-4f10-bcad-a24499e5fab8 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:13.733754 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea38279-7cdd-4f10-bcad-a24499e5fab8 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:13.735028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 553/1111] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:13.741348 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8074c22-5b66-43a4-b46d-39330a2ddecd None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:13.742030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8074c22-5b66-43a4-b46d-39330a2ddecd None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:13.742030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8074c22-5b66-43a4-b46d-39330a2ddecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:13.760892 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-c8074c22-5b66-43a4-b46d-39330a2ddecd None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:13.762086 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c8074c22-5b66-43a4-b46d-39330a2ddecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:13.835898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 559/1112] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:14.105912 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea38279-7cdd-4f10-bcad-a24499e5fab8 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:14.138542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:14.218633 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea38279-7cdd-4f10-bcad-a24499e5fab8 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:14.253020 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced7342-a1ab-4d1c-a1b5-790ecaf5803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:14.253645 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced7342-a1ab-4d1c-a1b5-790ecaf5803d None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:14.253916 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced7342-a1ab-4d1c-a1b5-790ecaf5803d None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:14.254182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced7342-a1ab-4d1c-a1b5-790ecaf5803d None admin] PATH_INFO: `/v3/roles/e35c45d51df34051b68fa49475ac7250` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:14.255597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced7342-a1ab-4d1c-a1b5-790ecaf5803d None admin] RBAC: Authorizing `identity:get_role(role_id=e35c45d51df34051b68fa49475ac7250)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:14.256961 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced7342-a1ab-4d1c-a1b5-790ecaf5803d None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:14.258285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 554/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:30:14 2022] GET /identity/v3/roles/e35c45d51df34051b68fa49475ac7250 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:14.264284 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8074c22-5b66-43a4-b46d-39330a2ddecd None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:14.334340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:14.364845 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8074c22-5b66-43a4-b46d-39330a2ddecd None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:14.398524 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76021d19-65bd-4f9c-a14d-fea9fcef015b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:14.399156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76021d19-65bd-4f9c-a14d-fea9fcef015b None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:14.399428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76021d19-65bd-4f9c-a14d-fea9fcef015b None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:14.399722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76021d19-65bd-4f9c-a14d-fea9fcef015b None admin] PATH_INFO: `/v3/users/329dbbe3a31c4c3d81094d58d761b351` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:14.420619 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76021d19-65bd-4f9c-a14d-fea9fcef015b None admin] RBAC: Authorizing `identity:get_user(user_id=329dbbe3a31c4c3d81094d58d761b351)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:14.422059 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76021d19-65bd-4f9c-a14d-fea9fcef015b None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:14.423838 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 560/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:30:14 2022] GET /identity/v3/users/329dbbe3a31c4c3d81094d58d761b351 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:30:14.432446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced7342-a1ab-4d1c-a1b5-790ecaf5803d None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:14.537411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:14.549082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced7342-a1ab-4d1c-a1b5-790ecaf5803d None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:14.594812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4ae8d-218c-474e-ad85-31f6e8aef49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:14.596099 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4ae8d-218c-474e-ad85-31f6e8aef49b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:14.596527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4ae8d-218c-474e-ad85-31f6e8aef49b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:14.596806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4ae8d-218c-474e-ad85-31f6e8aef49b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:14.666761 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4ae8d-218c-474e-ad85-31f6e8aef49b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:14.668316 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4ae8d-218c-474e-ad85-31f6e8aef49b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:14.759016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:14.775205 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 555/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:30:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:30:14.781431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76021d19-65bd-4f9c-a14d-fea9fcef015b None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:14.883862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76021d19-65bd-4f9c-a14d-fea9fcef015b None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:14.912144 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:14.919667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36110b-99e0-41ba-97a8-17adaf05c9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:14.920301 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36110b-99e0-41ba-97a8-17adaf05c9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:14.920580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36110b-99e0-41ba-97a8-17adaf05c9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:14.925078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36110b-99e0-41ba-97a8-17adaf05c9d4 None admin] PATH_INFO: `/v3/projects/e2ba6a5faff542cc93faba79130600d4` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:14.925078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36110b-99e0-41ba-97a8-17adaf05c9d4 None admin] RBAC: Authorizing `identity:get_project(project_id=e2ba6a5faff542cc93faba79130600d4)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:14.925078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36110b-99e0-41ba-97a8-17adaf05c9d4 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:14.925459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 561/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:30:14 2022] GET /identity/v3/projects/e2ba6a5faff542cc93faba79130600d4 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:14.931781 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4ae8d-218c-474e-ad85-31f6e8aef49b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:15.034927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4ae8d-218c-474e-ad85-31f6e8aef49b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:15.069540 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd54d4-8ffa-4007-95e6-165c5fe25d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:15.070119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd54d4-8ffa-4007-95e6-165c5fe25d48 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:15.070399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd54d4-8ffa-4007-95e6-165c5fe25d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:15.070663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd54d4-8ffa-4007-95e6-165c5fe25d48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:15.071372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd54d4-8ffa-4007-95e6-165c5fe25d48 None admin] RBAC: Adding query filter params (role.id=e35c45d51df34051b68fa49475ac7250, scope.project.id=e2ba6a5faff542cc93faba79130600d4, user.id=329dbbe3a31c4c3d81094d58d761b351) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:15.071711 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd54d4-8ffa-4007-95e6-165c5fe25d48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:15.073115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd54d4-8ffa-4007-95e6-165c5fe25d48 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:15.078279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 556/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:30:14 2022] GET /identity/v3/role_assignments?user.id=329dbbe3a31c4c3d81094d58d761b351&scope.project.id=e2ba6a5faff542cc93faba79130600d4&role.id=e35c45d51df34051b68fa49475ac7250 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:17.247915 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef56c8c-1ac3-4da4-b691-c3e804955d72 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:17.248463 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef56c8c-1ac3-4da4-b691-c3e804955d72 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:17.248463 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef56c8c-1ac3-4da4-b691-c3e804955d72 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:17.249811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 562/1118] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:17.255419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d739-4255-436c-9e69-727947f05ee6 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:17.255872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d739-4255-436c-9e69-727947f05ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:17.255987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d739-4255-436c-9e69-727947f05ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:17.274625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-4317d739-4255-436c-9e69-727947f05ee6 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:17.275848 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4317d739-4255-436c-9e69-727947f05ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:17.322436 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:17.342366 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 557/1119] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:17.625589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef56c8c-1ac3-4da4-b691-c3e804955d72 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:17.732804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef56c8c-1ac3-4da4-b691-c3e804955d72 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:17.767986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f85007-0dc1-4bbf-b1e8-f7c46d2cff98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:17.768605 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f85007-0dc1-4bbf-b1e8-f7c46d2cff98 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:17.768882 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f85007-0dc1-4bbf-b1e8-f7c46d2cff98 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:17.769153 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f85007-0dc1-4bbf-b1e8-f7c46d2cff98 None admin] PATH_INFO: `/v3/roles/e35c45d51df34051b68fa49475ac7250` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:17.770545 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f85007-0dc1-4bbf-b1e8-f7c46d2cff98 None admin] RBAC: Authorizing `identity:get_role(role_id=e35c45d51df34051b68fa49475ac7250)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:17.771944 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f85007-0dc1-4bbf-b1e8-f7c46d2cff98 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:17.773265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 563/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:30:17 2022] GET /identity/v3/roles/e35c45d51df34051b68fa49475ac7250 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:17.779277 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317d739-4255-436c-9e69-727947f05ee6 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:17.890368 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317d739-4255-436c-9e69-727947f05ee6 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:17.927858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d31a9-af7c-494b-a7b2-6f5d97311e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:17.928490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d31a9-af7c-494b-a7b2-6f5d97311e40 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:17.928768 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d31a9-af7c-494b-a7b2-6f5d97311e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:17.929205 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d31a9-af7c-494b-a7b2-6f5d97311e40 None admin] PATH_INFO: `/v3/users/329dbbe3a31c4c3d81094d58d761b351` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:17.930206 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d31a9-af7c-494b-a7b2-6f5d97311e40 None admin] RBAC: Authorizing `identity:get_user(user_id=329dbbe3a31c4c3d81094d58d761b351)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:17.931689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d31a9-af7c-494b-a7b2-6f5d97311e40 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:17.933306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 558/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:30:17 2022] GET /identity/v3/users/329dbbe3a31c4c3d81094d58d761b351 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:17.939754 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f85007-0dc1-4bbf-b1e8-f7c46d2cff98 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:18.005310 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:18.043990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f85007-0dc1-4bbf-b1e8-f7c46d2cff98 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:18.080009 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1f427-c3be-4a27-b8e9-ffbabc413266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:18.080648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1f427-c3be-4a27-b8e9-ffbabc413266 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:18.080932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1f427-c3be-4a27-b8e9-ffbabc413266 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:18.081214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1f427-c3be-4a27-b8e9-ffbabc413266 None admin] PATH_INFO: `/v3/projects/e2ba6a5faff542cc93faba79130600d4` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:18.082379 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1f427-c3be-4a27-b8e9-ffbabc413266 None admin] RBAC: Authorizing `identity:get_project(project_id=e2ba6a5faff542cc93faba79130600d4)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:18.083841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1f427-c3be-4a27-b8e9-ffbabc413266 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:18.085493 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 564/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:30:17 2022] GET /identity/v3/projects/e2ba6a5faff542cc93faba79130600d4 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:18.091670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d31a9-af7c-494b-a7b2-6f5d97311e40 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:18.146176 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:18.198900 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d31a9-af7c-494b-a7b2-6f5d97311e40 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:18.237348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f692f-e4f6-49b5-979f-33407fe5b52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:18.238010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f692f-e4f6-49b5-979f-33407fe5b52f None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:18.238285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f692f-e4f6-49b5-979f-33407fe5b52f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:18.238553 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f692f-e4f6-49b5-979f-33407fe5b52f None admin] PATH_INFO: `/v3/projects/e2ba6a5faff542cc93faba79130600d4/users/329dbbe3a31c4c3d81094d58d761b351/roles/e35c45d51df34051b68fa49475ac7250` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:18.240691 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f692f-e4f6-49b5-979f-33407fe5b52f None admin] RBAC: Authorizing `identity:create_grant(project_id=e2ba6a5faff542cc93faba79130600d4, user_id=329dbbe3a31c4c3d81094d58d761b351, role_id=e35c45d51df34051b68fa49475ac7250)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:18.242116 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f692f-e4f6-49b5-979f-33407fe5b52f None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:18.314296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 559/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:30:18 2022] PUT /identity/v3/projects/e2ba6a5faff542cc93faba79130600d4/users/329dbbe3a31c4c3d81094d58d761b351/roles/e35c45d51df34051b68fa49475ac7250 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:30:20.490373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d89190-26b4-4dee-b868-c6149edfca1d None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:20.490952 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d89190-26b4-4dee-b868-c6149edfca1d None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:20.490952 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d89190-26b4-4dee-b868-c6149edfca1d None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:20.492299 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 565/1124] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:20.497603 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940708ad-efa4-4082-947d-c1d8ebf3cb45 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:20.498040 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940708ad-efa4-4082-947d-c1d8ebf3cb45 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:20.498135 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940708ad-efa4-4082-947d-c1d8ebf3cb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:20.516053 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-940708ad-efa4-4082-947d-c1d8ebf3cb45 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:20.517732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-940708ad-efa4-4082-947d-c1d8ebf3cb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:20.583452 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 560/1125] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:20.851628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d89190-26b4-4dee-b868-c6149edfca1d None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:20.957287 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d89190-26b4-4dee-b868-c6149edfca1d None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:20.986612 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:20.991376 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59c62b-f7c1-4e3a-b17f-903a6ebcfc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:20.992036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59c62b-f7c1-4e3a-b17f-903a6ebcfc14 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:20.992321 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59c62b-f7c1-4e3a-b17f-903a6ebcfc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:20.992594 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59c62b-f7c1-4e3a-b17f-903a6ebcfc14 None admin] PATH_INFO: `/v3/roles/e35c45d51df34051b68fa49475ac7250` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:20.997305 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59c62b-f7c1-4e3a-b17f-903a6ebcfc14 None admin] RBAC: Authorizing `identity:get_role(role_id=e35c45d51df34051b68fa49475ac7250)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:20.997305 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59c62b-f7c1-4e3a-b17f-903a6ebcfc14 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:20.997305 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 566/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:30:20 2022] GET /identity/v3/roles/e35c45d51df34051b68fa49475ac7250 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:21.003690 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940708ad-efa4-4082-947d-c1d8ebf3cb45 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:21.043786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:21.100296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940708ad-efa4-4082-947d-c1d8ebf3cb45 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:21.135338 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2d875-4934-4a6d-b4ed-ff21a930d4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:21.135903 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2d875-4934-4a6d-b4ed-ff21a930d4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:21.136176 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2d875-4934-4a6d-b4ed-ff21a930d4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:21.136444 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2d875-4934-4a6d-b4ed-ff21a930d4e5 None admin] PATH_INFO: `/v3/users/329dbbe3a31c4c3d81094d58d761b351` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:21.137537 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2d875-4934-4a6d-b4ed-ff21a930d4e5 None admin] RBAC: Authorizing `identity:get_user(user_id=329dbbe3a31c4c3d81094d58d761b351)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:21.138957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2d875-4934-4a6d-b4ed-ff21a930d4e5 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:21.140545 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 561/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:30:21 2022] GET /identity/v3/users/329dbbe3a31c4c3d81094d58d761b351 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:21.146496 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59c62b-f7c1-4e3a-b17f-903a6ebcfc14 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:21.247603 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59c62b-f7c1-4e3a-b17f-903a6ebcfc14 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:21.280973 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0cbbd-ca1f-4a38-827d-0c511471df1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:21.281563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0cbbd-ca1f-4a38-827d-0c511471df1d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:21.281871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0cbbd-ca1f-4a38-827d-0c511471df1d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:21.282141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0cbbd-ca1f-4a38-827d-0c511471df1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:21.347749 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:21.349873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0cbbd-ca1f-4a38-827d-0c511471df1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:21.351304 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0cbbd-ca1f-4a38-827d-0c511471df1d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:21.452014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 567/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:30:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:30:21.458117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2d875-4934-4a6d-b4ed-ff21a930d4e5 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:21.560758 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2d875-4934-4a6d-b4ed-ff21a930d4e5 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:21.571036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:21.596102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555c825-6715-4646-b847-8e5b4b469996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:21.596732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555c825-6715-4646-b847-8e5b4b469996 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:21.597004 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555c825-6715-4646-b847-8e5b4b469996 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:21.597273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555c825-6715-4646-b847-8e5b4b469996 None admin] PATH_INFO: `/v3/projects/e2ba6a5faff542cc93faba79130600d4` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:21.598382 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555c825-6715-4646-b847-8e5b4b469996 None admin] RBAC: Authorizing `identity:get_project(project_id=e2ba6a5faff542cc93faba79130600d4)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:21.599857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555c825-6715-4646-b847-8e5b4b469996 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:21.601514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 562/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:30:21 2022] GET /identity/v3/projects/e2ba6a5faff542cc93faba79130600d4 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:21.608097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0cbbd-ca1f-4a38-827d-0c511471df1d None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:21.718975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:21.722721 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0cbbd-ca1f-4a38-827d-0c511471df1d None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:21.765664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31edd2e-ac8d-44f4-96be-e6a3554ecf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:21.766832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31edd2e-ac8d-44f4-96be-e6a3554ecf90 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:21.767761 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31edd2e-ac8d-44f4-96be-e6a3554ecf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:21.768047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31edd2e-ac8d-44f4-96be-e6a3554ecf90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:21.768877 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31edd2e-ac8d-44f4-96be-e6a3554ecf90 None admin] RBAC: Adding query filter params (role.id=e35c45d51df34051b68fa49475ac7250, scope.project.id=e2ba6a5faff542cc93faba79130600d4, user.id=329dbbe3a31c4c3d81094d58d761b351) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:21.769189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31edd2e-ac8d-44f4-96be-e6a3554ecf90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:21.770613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31edd2e-ac8d-44f4-96be-e6a3554ecf90 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:21.776982 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 568/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:30:21 2022] GET /identity/v3/role_assignments?user.id=329dbbe3a31c4c3d81094d58d761b351&scope.project.id=e2ba6a5faff542cc93faba79130600d4&role.id=e35c45d51df34051b68fa49475ac7250 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:23.974140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb6cc-9edb-4120-9fe3-a32b62eab1fc None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:23.974697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb6cc-9edb-4120-9fe3-a32b62eab1fc None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:23.974697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb6cc-9edb-4120-9fe3-a32b62eab1fc None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:23.976145 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 563/1131] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:23.981750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c134e-6bab-4204-9b1e-ea0bea696e19 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:23.982172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c134e-6bab-4204-9b1e-ea0bea696e19 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:23.982286 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c134e-6bab-4204-9b1e-ea0bea696e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:24.001739 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-b71c134e-6bab-4204-9b1e-ea0bea696e19 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:24.002969 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b71c134e-6bab-4204-9b1e-ea0bea696e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:24.069684 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 569/1132] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:24.334715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfb6cc-9edb-4120-9fe3-a32b62eab1fc None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:24.439423 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfb6cc-9edb-4120-9fe3-a32b62eab1fc None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:24.474479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2759172-c730-445f-8000-39d270b27fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:24.475107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2759172-c730-445f-8000-39d270b27fca None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:24.475386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2759172-c730-445f-8000-39d270b27fca None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:24.475687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2759172-c730-445f-8000-39d270b27fca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:24.476797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2759172-c730-445f-8000-39d270b27fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:24.478220 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2759172-c730-445f-8000-39d270b27fca None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:24.479831 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 564/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:30:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:24.485864 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c134e-6bab-4204-9b1e-ea0bea696e19 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:24.584214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:24.591197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c134e-6bab-4204-9b1e-ea0bea696e19 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:24.628558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960732e-c60f-4802-b2c6-3938d41c771e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:24.629187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960732e-c60f-4802-b2c6-3938d41c771e None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:24.629466 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960732e-c60f-4802-b2c6-3938d41c771e None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:24.629734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960732e-c60f-4802-b2c6-3938d41c771e None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:24.630420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960732e-c60f-4802-b2c6-3938d41c771e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:24.631934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960732e-c60f-4802-b2c6-3938d41c771e None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:24.745553 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 570/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Sep 7 16:30:24 2022] POST /identity/v3/projects => generated 311 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:30:26.995123 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763eb7d-f510-4f4c-bb3d-69302c8e64cb None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:26.995718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763eb7d-f510-4f4c-bb3d-69302c8e64cb None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:26.995718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763eb7d-f510-4f4c-bb3d-69302c8e64cb None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:26.997049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 565/1135] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:27.002985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bf550-636f-4ad5-9c26-dfda6b3892d1 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:27.003430 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bf550-636f-4ad5-9c26-dfda6b3892d1 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:27.003653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bf550-636f-4ad5-9c26-dfda6b3892d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:27.022452 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8e4bf550-636f-4ad5-9c26-dfda6b3892d1 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:27.023660 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8e4bf550-636f-4ad5-9c26-dfda6b3892d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:27.095921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 571/1136] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:27.377036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763eb7d-f510-4f4c-bb3d-69302c8e64cb None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:27.434031 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:27.494544 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763eb7d-f510-4f4c-bb3d-69302c8e64cb None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:27.530272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0ed41-9a00-49e3-b67b-13a1cff4c6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:27.530996 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0ed41-9a00-49e3-b67b-13a1cff4c6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:27.531834 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0ed41-9a00-49e3-b67b-13a1cff4c6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:27.532098 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0ed41-9a00-49e3-b67b-13a1cff4c6b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:27.533433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0ed41-9a00-49e3-b67b-13a1cff4c6b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:27.534866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0ed41-9a00-49e3-b67b-13a1cff4c6b2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:27.541274 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 566/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:30:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:27.543051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bf550-636f-4ad5-9c26-dfda6b3892d1 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:27.631531 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:27.654119 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bf550-636f-4ad5-9c26-dfda6b3892d1 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:27.694594 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de18ae-c7d8-4683-8037-cee8cced1168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:27.695768 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de18ae-c7d8-4683-8037-cee8cced1168 None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:27.696253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de18ae-c7d8-4683-8037-cee8cced1168 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:27.696740 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de18ae-c7d8-4683-8037-cee8cced1168 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:27.697897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de18ae-c7d8-4683-8037-cee8cced1168 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:27.700560 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de18ae-c7d8-4683-8037-cee8cced1168 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:27.848179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 572/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:30:27 2022] POST /identity/v3/users => generated 286 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:30:30.149295 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00cbcd-7ede-452a-a5e3-fa903f35482a None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:30.149823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00cbcd-7ede-452a-a5e3-fa903f35482a None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:30.149823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00cbcd-7ede-452a-a5e3-fa903f35482a None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:30.151153 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 567/1139] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:30.157728 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864ccb7-f32c-4436-892d-20a8997c6fdd None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:30.158253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864ccb7-f32c-4436-892d-20a8997c6fdd None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:30.158253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864ccb7-f32c-4436-892d-20a8997c6fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:30.177455 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-c864ccb7-f32c-4436-892d-20a8997c6fdd None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:30.178641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c864ccb7-f32c-4436-892d-20a8997c6fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:30.256049 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 573/1140] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:30.534770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00cbcd-7ede-452a-a5e3-fa903f35482a None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:30.665645 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00cbcd-7ede-452a-a5e3-fa903f35482a None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:30.683913 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:30.708025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b33f20-7801-431d-b686-27a0b89b5573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:30.708672 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b33f20-7801-431d-b686-27a0b89b5573 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:30.708948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b33f20-7801-431d-b686-27a0b89b5573 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:30.709218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b33f20-7801-431d-b686-27a0b89b5573 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:30.721264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b33f20-7801-431d-b686-27a0b89b5573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:30:30.726101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-b8b33f20-7801-431d-b686-27a0b89b5573 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:30:30.726101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:30.726101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:30.726101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:30.726101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:30.726101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:30.726101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:30.726101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:30.726101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:30.726101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:30.726101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:30.726101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:30.726101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:30:30.726101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:30:30.726101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:30:30.726101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:30:30.727251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:30:30.727251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:30:30.727251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:30:30.727251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:30:30.727251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:30.727251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:30.727251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:30.727251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:30.727251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:30.727251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:30.727251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:30.727251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:30.727251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:30.727251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:30.727251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:30.727251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:30.728248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:30.728248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:30.728248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:30.728248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:30.728248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:30:30.728248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:30:30.728248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:30:30.728248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:30:30.728248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:30:30.728248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:30:30.728248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:30:30.728248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:30:30.728248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 568/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:30:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:30:30.733810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864ccb7-f32c-4436-892d-20a8997c6fdd None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:30.813680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:30.858717 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864ccb7-f32c-4436-892d-20a8997c6fdd None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:30.897966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915054b8-ef9d-4b26-a0b0-66f72fcfdb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:30.898583 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915054b8-ef9d-4b26-a0b0-66f72fcfdb66 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:30.898862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915054b8-ef9d-4b26-a0b0-66f72fcfdb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:30.899138 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915054b8-ef9d-4b26-a0b0-66f72fcfdb66 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:30.899953 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915054b8-ef9d-4b26-a0b0-66f72fcfdb66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:30.900179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915054b8-ef9d-4b26-a0b0-66f72fcfdb66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:30.901562 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915054b8-ef9d-4b26-a0b0-66f72fcfdb66 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:30.911562 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 574/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:30:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:30.917883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b33f20-7801-431d-b686-27a0b89b5573 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:31.040784 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b33f20-7801-431d-b686-27a0b89b5573 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:31.080188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac48cd-a4de-46f1-bc7b-31e068e83e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:31.080774 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac48cd-a4de-46f1-bc7b-31e068e83e63 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:31.081054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac48cd-a4de-46f1-bc7b-31e068e83e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:31.081329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac48cd-a4de-46f1-bc7b-31e068e83e63 None admin] PATH_INFO: `/v3/users/3a08287175ed47a3b290a8626ea9a445` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:31.098026 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac48cd-a4de-46f1-bc7b-31e068e83e63 None admin] RBAC: Authorizing `identity:get_user(user_id=3a08287175ed47a3b290a8626ea9a445)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:31.099531 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac48cd-a4de-46f1-bc7b-31e068e83e63 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:31.101242 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 569/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:30:30 2022] GET /identity/v3/users/3a08287175ed47a3b290a8626ea9a445 => generated 286 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:31.107830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915054b8-ef9d-4b26-a0b0-66f72fcfdb66 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:31.237253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915054b8-ef9d-4b26-a0b0-66f72fcfdb66 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:31.264143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:31.276331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b29e7-108e-47df-9a56-b780a7a3eb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:31.276950 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b29e7-108e-47df-9a56-b780a7a3eb69 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:31.277230 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b29e7-108e-47df-9a56-b780a7a3eb69 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:31.277506 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b29e7-108e-47df-9a56-b780a7a3eb69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:31.370256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b29e7-108e-47df-9a56-b780a7a3eb69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:31.371728 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b29e7-108e-47df-9a56-b780a7a3eb69 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:31.485479 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 575/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:30:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:30:31.491180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac48cd-a4de-46f1-bc7b-31e068e83e63 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:31.534904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:31.614384 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac48cd-a4de-46f1-bc7b-31e068e83e63 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:31.659134 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db57c3-c7b3-46c9-8413-fb130236ef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:31.659748 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db57c3-c7b3-46c9-8413-fb130236ef77 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:31.660032 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db57c3-c7b3-46c9-8413-fb130236ef77 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:31.660303 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db57c3-c7b3-46c9-8413-fb130236ef77 None admin] PATH_INFO: `/v3/projects/56dce196624a4b20bd7af606dc553a30` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:31.661532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db57c3-c7b3-46c9-8413-fb130236ef77 None admin] RBAC: Authorizing `identity:get_project(project_id=56dce196624a4b20bd7af606dc553a30)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:31.662986 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db57c3-c7b3-46c9-8413-fb130236ef77 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:31.664726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 570/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:30:31 2022] GET /identity/v3/projects/56dce196624a4b20bd7af606dc553a30 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:30:31.672075 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b29e7-108e-47df-9a56-b780a7a3eb69 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:31.702294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:31.803968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b29e7-108e-47df-9a56-b780a7a3eb69 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:31.843223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b635a-a8c1-4279-a756-5effb900897c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:31.844554 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b635a-a8c1-4279-a756-5effb900897c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:31.844848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b635a-a8c1-4279-a756-5effb900897c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:31.845124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b635a-a8c1-4279-a756-5effb900897c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:31.845874 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b635a-a8c1-4279-a756-5effb900897c None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=56dce196624a4b20bd7af606dc553a30, user.id=3a08287175ed47a3b290a8626ea9a445) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:31.846182 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b635a-a8c1-4279-a756-5effb900897c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:31.847716 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b635a-a8c1-4279-a756-5effb900897c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:31.854103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 576/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:30:31 2022] GET /identity/v3/role_assignments?user.id=3a08287175ed47a3b290a8626ea9a445&scope.project.id=56dce196624a4b20bd7af606dc553a30&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:34.110301 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44420a-87fa-496e-834b-aa1c9315e13f None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:34.110960 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44420a-87fa-496e-834b-aa1c9315e13f None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:34.110960 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44420a-87fa-496e-834b-aa1c9315e13f None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:34.112198 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 571/1147] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:34.118269 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dc987-e947-495a-b29b-519bac29b137 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:34.118756 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dc987-e947-495a-b29b-519bac29b137 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:34.118878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dc987-e947-495a-b29b-519bac29b137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:34.141925 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-bf5dc987-e947-495a-b29b-519bac29b137 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:34.143255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-bf5dc987-e947-495a-b29b-519bac29b137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:34.232001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 577/1148] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:34.509586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44420a-87fa-496e-834b-aa1c9315e13f None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:34.630790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:34.636995 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44420a-87fa-496e-834b-aa1c9315e13f None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:34.678113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60adf3-aec1-4cc4-a9eb-042f6c7a0214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:34.678751 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60adf3-aec1-4cc4-a9eb-042f6c7a0214 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:34.679023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60adf3-aec1-4cc4-a9eb-042f6c7a0214 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:34.679293 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60adf3-aec1-4cc4-a9eb-042f6c7a0214 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:34.691516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60adf3-aec1-4cc4-a9eb-042f6c7a0214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:30:34.698712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-dd60adf3-aec1-4cc4-a9eb-042f6c7a0214 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:30:34.698712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:34.698712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:34.698712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:34.698712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:34.698712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:34.698712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:34.698712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:34.698712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:34.698712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:34.698712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:34.698712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:34.698712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:30:34.698712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:30:34.698712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:30:34.698712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:30:34.699911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:30:34.699911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:30:34.699911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:30:34.699911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:30:34.699911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:34.699911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:34.699911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:34.699911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:34.699911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:34.699911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:34.699911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:34.699911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:34.699911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:34.699911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:34.699911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:34.699911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:34.700840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:34.700840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:34.700840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:34.700840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:34.700840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:30:34.700840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:30:34.700840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:30:34.700840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:30:34.700840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:30:34.700840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:30:34.700840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:30:34.700840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:30:34.700840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 572/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:30:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:30:34.706389 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dc987-e947-495a-b29b-519bac29b137 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:34.732379 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:34.831405 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dc987-e947-495a-b29b-519bac29b137 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:34.876968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373010d-1d4a-4ecd-bee8-a55e953aadda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:34.877586 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373010d-1d4a-4ecd-bee8-a55e953aadda None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:34.877858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373010d-1d4a-4ecd-bee8-a55e953aadda None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:34.878124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373010d-1d4a-4ecd-bee8-a55e953aadda None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:34.878783 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373010d-1d4a-4ecd-bee8-a55e953aadda None admin] RBAC: Adding query filter params (name=admin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:34.879085 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373010d-1d4a-4ecd-bee8-a55e953aadda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:34.880482 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373010d-1d4a-4ecd-bee8-a55e953aadda None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:34.894367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 578/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:30:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:34.902814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60adf3-aec1-4cc4-a9eb-042f6c7a0214 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:35.051554 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60adf3-aec1-4cc4-a9eb-042f6c7a0214 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:35.088755 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ab14a-a1a1-4bc8-9706-f5c781ba7f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:35.089484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ab14a-a1a1-4bc8-9706-f5c781ba7f5c None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:35.089959 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ab14a-a1a1-4bc8-9706-f5c781ba7f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:35.090434 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ab14a-a1a1-4bc8-9706-f5c781ba7f5c None admin] PATH_INFO: `/v3/users/3a08287175ed47a3b290a8626ea9a445` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:35.092355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ab14a-a1a1-4bc8-9706-f5c781ba7f5c None admin] RBAC: Authorizing `identity:get_user(user_id=3a08287175ed47a3b290a8626ea9a445)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:35.094971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ab14a-a1a1-4bc8-9706-f5c781ba7f5c None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:35.097683 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 573/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:30:34 2022] GET /identity/v3/users/3a08287175ed47a3b290a8626ea9a445 => generated 286 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:35.103830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373010d-1d4a-4ecd-bee8-a55e953aadda None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:35.198197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:35.220106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373010d-1d4a-4ecd-bee8-a55e953aadda None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:35.262843 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3b0bf-643f-4a55-a3ee-ebf28cd70ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:35.265513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3b0bf-643f-4a55-a3ee-ebf28cd70ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:35.269034 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3b0bf-643f-4a55-a3ee-ebf28cd70ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:35.269325 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3b0bf-643f-4a55-a3ee-ebf28cd70ea0 None admin] PATH_INFO: `/v3/projects/56dce196624a4b20bd7af606dc553a30` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:35.270569 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3b0bf-643f-4a55-a3ee-ebf28cd70ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=56dce196624a4b20bd7af606dc553a30)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:35.272047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3b0bf-643f-4a55-a3ee-ebf28cd70ea0 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:35.273734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 579/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:30:35 2022] GET /identity/v3/projects/56dce196624a4b20bd7af606dc553a30 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:35.279831 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ab14a-a1a1-4bc8-9706-f5c781ba7f5c None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:35.312081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:35.402390 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ab14a-a1a1-4bc8-9706-f5c781ba7f5c None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:35.441264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96f685-0462-4bdb-b232-ec48b074f0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:35.441937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96f685-0462-4bdb-b232-ec48b074f0f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:35.442227 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96f685-0462-4bdb-b232-ec48b074f0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:35.442529 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96f685-0462-4bdb-b232-ec48b074f0f2 None admin] PATH_INFO: `/v3/projects/56dce196624a4b20bd7af606dc553a30/users/3a08287175ed47a3b290a8626ea9a445/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:35.444887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96f685-0462-4bdb-b232-ec48b074f0f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=56dce196624a4b20bd7af606dc553a30, user_id=3a08287175ed47a3b290a8626ea9a445, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:35.446365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96f685-0462-4bdb-b232-ec48b074f0f2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:35.548005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 574/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:30:35 2022] PUT /identity/v3/projects/56dce196624a4b20bd7af606dc553a30/users/3a08287175ed47a3b290a8626ea9a445/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:30:37.773362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e6638-a785-46fb-9184-4f57448e7599 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:37.773915 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e6638-a785-46fb-9184-4f57448e7599 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:37.773915 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e6638-a785-46fb-9184-4f57448e7599 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:37.775232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 580/1154] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:37.781139 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01844bd-c8d0-4421-ba4c-e2033d7b9ae1 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:37.781555 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01844bd-c8d0-4421-ba4c-e2033d7b9ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:37.781699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01844bd-c8d0-4421-ba4c-e2033d7b9ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:37.800540 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-a01844bd-c8d0-4421-ba4c-e2033d7b9ae1 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:37.801734 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a01844bd-c8d0-4421-ba4c-e2033d7b9ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:37.868855 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 575/1155] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:38.149867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e6638-a785-46fb-9184-4f57448e7599 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:38.253804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e6638-a785-46fb-9184-4f57448e7599 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:38.288297 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31401d5-c865-417d-adbc-aad33f9255a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:38.288930 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31401d5-c865-417d-adbc-aad33f9255a5 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:38.289195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31401d5-c865-417d-adbc-aad33f9255a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:38.289463 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31401d5-c865-417d-adbc-aad33f9255a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:38.300000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31401d5-c865-417d-adbc-aad33f9255a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:30:38.304856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-e31401d5-c865-417d-adbc-aad33f9255a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:30:38.304856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:38.304856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:38.304856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:38.304856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:38.304856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:38.304856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:38.304856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:38.304856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:38.304856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:38.304856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:38.304856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:38.304856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:30:38.304856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:30:38.304856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:30:38.304856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:30:38.305988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:30:38.305988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:30:38.305988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:30:38.305988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:30:38.305988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:38.305988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:38.305988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:38.305988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:38.305988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:38.305988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:38.305988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:38.305988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:38.305988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:38.305988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:38.305988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:38.305988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:38.307221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:38.307221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:38.307221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:38.307221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:38.307221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:30:38.307221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:30:38.307221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:30:38.307221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:30:38.307221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:30:38.307221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:30:38.307221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:30:38.307221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:30:38.307221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 581/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:30:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:30:38.312170 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01844bd-c8d0-4421-ba4c-e2033d7b9ae1 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:38.329693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:38.407853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01844bd-c8d0-4421-ba4c-e2033d7b9ae1 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:38.441998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1a8ce-2083-4e14-8733-def3e4ca354b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:38.442596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1a8ce-2083-4e14-8733-def3e4ca354b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:38.442870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1a8ce-2083-4e14-8733-def3e4ca354b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:38.443137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1a8ce-2083-4e14-8733-def3e4ca354b None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:38.443815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1a8ce-2083-4e14-8733-def3e4ca354b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:38.444114 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1a8ce-2083-4e14-8733-def3e4ca354b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:38.445467 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1a8ce-2083-4e14-8733-def3e4ca354b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:38.453779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 576/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:30:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:38.459776 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31401d5-c865-417d-adbc-aad33f9255a5 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:38.471934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:38.558777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31401d5-c865-417d-adbc-aad33f9255a5 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:38.594657 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723d5e6-7207-4d63-b3e8-209356214eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:38.595294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723d5e6-7207-4d63-b3e8-209356214eab None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:38.595611 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723d5e6-7207-4d63-b3e8-209356214eab None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:38.595888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723d5e6-7207-4d63-b3e8-209356214eab None admin] PATH_INFO: `/v3/users/3a08287175ed47a3b290a8626ea9a445` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:38.597030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723d5e6-7207-4d63-b3e8-209356214eab None admin] RBAC: Authorizing `identity:get_user(user_id=3a08287175ed47a3b290a8626ea9a445)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:38.598465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723d5e6-7207-4d63-b3e8-209356214eab None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:38.600097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 582/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:30:38 2022] GET /identity/v3/users/3a08287175ed47a3b290a8626ea9a445 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:38.606000 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1a8ce-2083-4e14-8733-def3e4ca354b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:38.703503 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:38.725604 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1a8ce-2083-4e14-8733-def3e4ca354b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:38.761626 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb79aa-4e89-4c65-9e12-042566f6c892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:38.762232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb79aa-4e89-4c65-9e12-042566f6c892 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:38.762511 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb79aa-4e89-4c65-9e12-042566f6c892 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:38.762783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb79aa-4e89-4c65-9e12-042566f6c892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:38.832731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb79aa-4e89-4c65-9e12-042566f6c892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:38.834189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb79aa-4e89-4c65-9e12-042566f6c892 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:38.914353 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:38.937174 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 577/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:30:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:30:38.943573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723d5e6-7207-4d63-b3e8-209356214eab None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:39.025107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:39.048415 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723d5e6-7207-4d63-b3e8-209356214eab None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:39.083695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e383e64-436c-413b-a08a-94a6ee3012e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:39.084327 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e383e64-436c-413b-a08a-94a6ee3012e8 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:39.084603 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e383e64-436c-413b-a08a-94a6ee3012e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:39.084874 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e383e64-436c-413b-a08a-94a6ee3012e8 None admin] PATH_INFO: `/v3/projects/56dce196624a4b20bd7af606dc553a30` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:39.085986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e383e64-436c-413b-a08a-94a6ee3012e8 None admin] RBAC: Authorizing `identity:get_project(project_id=56dce196624a4b20bd7af606dc553a30)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:39.087402 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e383e64-436c-413b-a08a-94a6ee3012e8 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:39.089242 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 583/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:30:38 2022] GET /identity/v3/projects/56dce196624a4b20bd7af606dc553a30 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:30:39.096415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb79aa-4e89-4c65-9e12-042566f6c892 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:39.198525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb79aa-4e89-4c65-9e12-042566f6c892 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:39.235111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140338c-f66d-4e05-8686-c2a97c431a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:39.235741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140338c-f66d-4e05-8686-c2a97c431a98 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:39.236019 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140338c-f66d-4e05-8686-c2a97c431a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:39.236286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140338c-f66d-4e05-8686-c2a97c431a98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:39.237017 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140338c-f66d-4e05-8686-c2a97c431a98 None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=56dce196624a4b20bd7af606dc553a30, user.id=3a08287175ed47a3b290a8626ea9a445) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:39.237316 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140338c-f66d-4e05-8686-c2a97c431a98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:39.238760 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140338c-f66d-4e05-8686-c2a97c431a98 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:39.245234 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 578/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:30:39 2022] GET /identity/v3/role_assignments?user.id=3a08287175ed47a3b290a8626ea9a445&scope.project.id=56dce196624a4b20bd7af606dc553a30&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:41.457331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003309b-1dad-47d5-a10f-516b68ff9a02 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:41.457927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003309b-1dad-47d5-a10f-516b68ff9a02 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:41.457927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003309b-1dad-47d5-a10f-516b68ff9a02 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:41.459197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 584/1162] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:41.464451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb436398-9a3e-48d8-b5db-19d6bb71faea None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:41.464880 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb436398-9a3e-48d8-b5db-19d6bb71faea None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:41.464993 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb436398-9a3e-48d8-b5db-19d6bb71faea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:41.484592 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-cb436398-9a3e-48d8-b5db-19d6bb71faea None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:41.485779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-cb436398-9a3e-48d8-b5db-19d6bb71faea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:41.520664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:41.553168 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 579/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:41.820162 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003309b-1dad-47d5-a10f-516b68ff9a02 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:41.922931 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003309b-1dad-47d5-a10f-516b68ff9a02 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:41.960074 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd116d-2686-42c4-b74c-a85b900197d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:41.960693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd116d-2686-42c4-b74c-a85b900197d6 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:41.960972 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd116d-2686-42c4-b74c-a85b900197d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:41.961243 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd116d-2686-42c4-b74c-a85b900197d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:41.977859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:42.035865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd116d-2686-42c4-b74c-a85b900197d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:42.037331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd116d-2686-42c4-b74c-a85b900197d6 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:42.138690 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 585/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:30:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:30:42.145179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb436398-9a3e-48d8-b5db-19d6bb71faea None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:42.243689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb436398-9a3e-48d8-b5db-19d6bb71faea None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:42.276815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed2e0b-e72c-49bf-a66d-755d33a536f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:42.277446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed2e0b-e72c-49bf-a66d-755d33a536f3 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:42.277722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed2e0b-e72c-49bf-a66d-755d33a536f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:42.277991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed2e0b-e72c-49bf-a66d-755d33a536f3 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:42.285844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed2e0b-e72c-49bf-a66d-755d33a536f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:42.287322 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed2e0b-e72c-49bf-a66d-755d33a536f3 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:42.299152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-cbed2e0b-e72c-49bf-a66d-755d33a536f3 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 07 16:30:42.299152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:42.299152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 07 16:30:42.299152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 07 16:30:42.299152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:30:42.299152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:30:42.299152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:30:42.299152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:30:42.299152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 07 16:30:42.299152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:30:42.299152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:30:42.299152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:30:42.299152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:42.299152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:42.299152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:42.299152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:42.299152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:42.300795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:42.300795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:42.300795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:42.300795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:42.300795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:42.300795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:42.300795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:30:42.300795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:30:42.300795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:30:42.300795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:30:42.300795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:42.300795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:42.300795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:42.300795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:42.300795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:42.300795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:42.301940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:42.301940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:42.301940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:42.301940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:42.301940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:42.301940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:42.301940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:42.301940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:42.301940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:42.301940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:42.301940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 07 16:30:42.301940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:30:42.301940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 07 16:30:42.301940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:30:42.301940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 580/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Sep 7 16:30:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:30:42.306394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd116d-2686-42c4-b74c-a85b900197d6 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:42.352075 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:42.408151 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd116d-2686-42c4-b74c-a85b900197d6 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:42.442490 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e12e06-6ab0-4609-aeba-18e5979c204c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:42.443095 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e12e06-6ab0-4609-aeba-18e5979c204c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:42.443377 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e12e06-6ab0-4609-aeba-18e5979c204c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:42.443687 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e12e06-6ab0-4609-aeba-18e5979c204c None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:42.444323 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e12e06-6ab0-4609-aeba-18e5979c204c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:42.444626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e12e06-6ab0-4609-aeba-18e5979c204c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:42.445985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e12e06-6ab0-4609-aeba-18e5979c204c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:42.453714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 586/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Sep 7 16:30:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:44.623508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b291b-7ec4-45eb-a21d-b128cd8f459b None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:44.624082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b291b-7ec4-45eb-a21d-b128cd8f459b None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:44.624203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b291b-7ec4-45eb-a21d-b128cd8f459b None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:44.625518 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 581/1167] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:44.631340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb39741-8b09-49ce-9a93-5b45a5dfea79 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:44.631839 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb39741-8b09-49ce-9a93-5b45a5dfea79 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:44.631933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb39741-8b09-49ce-9a93-5b45a5dfea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:44.650455 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-9fb39741-8b09-49ce-9a93-5b45a5dfea79 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:44.651764 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9fb39741-8b09-49ce-9a93-5b45a5dfea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:44.719646 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 587/1168] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:44.987579 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b291b-7ec4-45eb-a21d-b128cd8f459b None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:45.020628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:45.092996 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b291b-7ec4-45eb-a21d-b128cd8f459b None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:45.130803 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc13141-0b06-47f9-a156-40175f3bada8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:45.131406 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc13141-0b06-47f9-a156-40175f3bada8 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:45.131711 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc13141-0b06-47f9-a156-40175f3bada8 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:45.131983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc13141-0b06-47f9-a156-40175f3bada8 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:45.132647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc13141-0b06-47f9-a156-40175f3bada8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:45.134010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc13141-0b06-47f9-a156-40175f3bada8 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:45.224191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 582/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Wed Sep 7 16:30:44 2022] POST /identity/v3/domains => generated 267 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:30:47.422934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37861492-9897-49b8-8fb1-d5eb85a7f75e None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:47.423506 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37861492-9897-49b8-8fb1-d5eb85a7f75e None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:47.423506 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37861492-9897-49b8-8fb1-d5eb85a7f75e None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:47.424852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 588/1170] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:47.430352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfe8c5-0842-4020-b6e4-e1a5d1c208df None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:47.430781 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfe8c5-0842-4020-b6e4-e1a5d1c208df None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:47.430900 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfe8c5-0842-4020-b6e4-e1a5d1c208df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:47.449319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-c0dfe8c5-0842-4020-b6e4-e1a5d1c208df None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:47.450499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c0dfe8c5-0842-4020-b6e4-e1a5d1c208df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:47.516399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 583/1171] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:47.787689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37861492-9897-49b8-8fb1-d5eb85a7f75e None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:47.827677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:47.890158 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37861492-9897-49b8-8fb1-d5eb85a7f75e None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:47.928449 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8c93b-45b0-4fe3-aecc-4d6884936f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:47.929103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8c93b-45b0-4fe3-aecc-4d6884936f62 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:47.929380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8c93b-45b0-4fe3-aecc-4d6884936f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:47.929651 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8c93b-45b0-4fe3-aecc-4d6884936f62 None admin] PATH_INFO: `/v3/domains/836400fe451448288e538905a4723881` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:47.941313 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8c93b-45b0-4fe3-aecc-4d6884936f62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=836400fe451448288e538905a4723881)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:47.942774 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8c93b-45b0-4fe3-aecc-4d6884936f62 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:47.944563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 589/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Wed Sep 7 16:30:47 2022] GET /identity/v3/domains/836400fe451448288e538905a4723881 => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:47.950581 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfe8c5-0842-4020-b6e4-e1a5d1c208df None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:47.977140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:48.058176 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfe8c5-0842-4020-b6e4-e1a5d1c208df None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:48.092654 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5ffc5-0b0d-4fa8-8f6f-a439972e1988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:48.093573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5ffc5-0b0d-4fa8-8f6f-a439972e1988 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:48.093856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5ffc5-0b0d-4fa8-8f6f-a439972e1988 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:48.094129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5ffc5-0b0d-4fa8-8f6f-a439972e1988 None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:48.094778 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5ffc5-0b0d-4fa8-8f6f-a439972e1988 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:48.096266 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5ffc5-0b0d-4fa8-8f6f-a439972e1988 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:48.218285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 584/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Sep 7 16:30:47 2022] POST /identity/v3/projects => generated 361 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:30:50.514314 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab21e1-b120-42ed-bca9-7b536c9e37a3 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:50.514884 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab21e1-b120-42ed-bca9-7b536c9e37a3 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:50.514884 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab21e1-b120-42ed-bca9-7b536c9e37a3 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:50.516219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 590/1174] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:50.521745 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581a567-c629-4900-91ff-82a8a5f3fab2 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:50.522188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581a567-c629-4900-91ff-82a8a5f3fab2 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:50.522282 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581a567-c629-4900-91ff-82a8a5f3fab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:50.540678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-4581a567-c629-4900-91ff-82a8a5f3fab2 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:50.541866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4581a567-c629-4900-91ff-82a8a5f3fab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:50.609673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 585/1175] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:50.895310 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab21e1-b120-42ed-bca9-7b536c9e37a3 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:50.996359 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:51.002211 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab21e1-b120-42ed-bca9-7b536c9e37a3 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:51.037562 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff9f81-c9c5-41d7-8c10-acdcb3ea0a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:51.038195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff9f81-c9c5-41d7-8c10-acdcb3ea0a5d None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:51.038489 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff9f81-c9c5-41d7-8c10-acdcb3ea0a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:51.038765 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff9f81-c9c5-41d7-8c10-acdcb3ea0a5d None admin] PATH_INFO: `/v3/domains/836400fe451448288e538905a4723881` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:51.039906 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff9f81-c9c5-41d7-8c10-acdcb3ea0a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=836400fe451448288e538905a4723881)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:51.041335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff9f81-c9c5-41d7-8c10-acdcb3ea0a5d None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:51.042949 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 591/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Wed Sep 7 16:30:50 2022] GET /identity/v3/domains/836400fe451448288e538905a4723881 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:51.049799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581a567-c629-4900-91ff-82a8a5f3fab2 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:51.052892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:51.151044 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581a567-c629-4900-91ff-82a8a5f3fab2 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:51.193059 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae41b4-7ec1-4a3c-8b29-43a05771c2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:51.193673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae41b4-7ec1-4a3c-8b29-43a05771c2e6 None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:51.193955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae41b4-7ec1-4a3c-8b29-43a05771c2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:51.194230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae41b4-7ec1-4a3c-8b29-43a05771c2e6 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:51.194975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae41b4-7ec1-4a3c-8b29-43a05771c2e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:51.196440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae41b4-7ec1-4a3c-8b29-43a05771c2e6 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:51.306757 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 586/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:30:51 2022] POST /identity/v3/users => generated 311 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:30:53.527091 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fc9b4-ecb1-4851-a161-c02befd5b727 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:53.527653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fc9b4-ecb1-4851-a161-c02befd5b727 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:53.527653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fc9b4-ecb1-4851-a161-c02befd5b727 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:53.528963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 592/1178] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:53.534545 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e0b42-5bb4-4e83-a374-c71f55204ba0 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:53.534963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e0b42-5bb4-4e83-a374-c71f55204ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:53.535127 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e0b42-5bb4-4e83-a374-c71f55204ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:53.554157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-947e0b42-5bb4-4e83-a374-c71f55204ba0 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:53.555340 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-947e0b42-5bb4-4e83-a374-c71f55204ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:53.612745 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:53.624998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 587/1179] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:53.899870 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fc9b4-ecb1-4851-a161-c02befd5b727 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:54.000420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fc9b4-ecb1-4851-a161-c02befd5b727 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:54.033462 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f78f1-5552-441c-ab8c-80576bdeaf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:54.034076 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f78f1-5552-441c-ab8c-80576bdeaf7b None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:54.034353 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f78f1-5552-441c-ab8c-80576bdeaf7b None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:54.034623 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f78f1-5552-441c-ab8c-80576bdeaf7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:54.044334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f78f1-5552-441c-ab8c-80576bdeaf7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:30:54.049793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-8a0f78f1-5552-441c-ab8c-80576bdeaf7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:30:54.049793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:54.049793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:54.049793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:54.049793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:54.049793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:54.049793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:54.049793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:54.049793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:54.049793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:54.049793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:54.049793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:54.049793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:30:54.049793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:30:54.049793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:30:54.049793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:30:54.050878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:30:54.050878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:30:54.050878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:30:54.050878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:30:54.050878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:54.050878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:54.050878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:54.050878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:54.050878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:54.050878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:54.050878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:54.050878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:54.050878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:54.050878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:54.050878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:54.050878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:54.051758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:54.051758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:54.051758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:54.051758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:54.051758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:30:54.051758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:30:54.051758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:30:54.051758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:30:54.051758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:30:54.051758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:30:54.051758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:30:54.051758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:30:54.051758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 593/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:30:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:30:54.057201 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e0b42-5bb4-4e83-a374-c71f55204ba0 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:54.154392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e0b42-5bb4-4e83-a374-c71f55204ba0 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:54.189279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a1b81-d91f-4869-b40a-3af5bbcfc8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:54.189881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a1b81-d91f-4869-b40a-3af5bbcfc8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:54.190159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a1b81-d91f-4869-b40a-3af5bbcfc8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:54.190427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a1b81-d91f-4869-b40a-3af5bbcfc8b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:54.191078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a1b81-d91f-4869-b40a-3af5bbcfc8b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:54.191376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a1b81-d91f-4869-b40a-3af5bbcfc8b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:54.192769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a1b81-d91f-4869-b40a-3af5bbcfc8b9 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:54.200858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 588/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:30:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:54.207038 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f78f1-5552-441c-ab8c-80576bdeaf7b None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:54.241673 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:54.323106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f78f1-5552-441c-ab8c-80576bdeaf7b None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:54.358077 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000a2f0-7b74-4067-b78b-d473011730bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:54.358711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000a2f0-7b74-4067-b78b-d473011730bb None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:54.358989 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000a2f0-7b74-4067-b78b-d473011730bb None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:54.359262 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000a2f0-7b74-4067-b78b-d473011730bb None admin] PATH_INFO: `/v3/users/cc078544f3b34a1593f71f8cd75d4690` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:54.372398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000a2f0-7b74-4067-b78b-d473011730bb None admin] RBAC: Authorizing `identity:get_user(user_id=cc078544f3b34a1593f71f8cd75d4690)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:54.374474 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000a2f0-7b74-4067-b78b-d473011730bb None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:54.376185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 594/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:30:54 2022] GET /identity/v3/users/cc078544f3b34a1593f71f8cd75d4690 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:54.382355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a1b81-d91f-4869-b40a-3af5bbcfc8b9 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:54.470592 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:54.518844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a1b81-d91f-4869-b40a-3af5bbcfc8b9 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:54.553943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e7f84-c9a1-4390-9c41-081f9bbc81fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:54.554635 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e7f84-c9a1-4390-9c41-081f9bbc81fb None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:54.554807 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e7f84-c9a1-4390-9c41-081f9bbc81fb None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:54.559707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e7f84-c9a1-4390-9c41-081f9bbc81fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:54.629140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e7f84-c9a1-4390-9c41-081f9bbc81fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:54.630598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e7f84-c9a1-4390-9c41-081f9bbc81fb None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:54.689976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:54.737570 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 589/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:30:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:30:54.743743 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000a2f0-7b74-4067-b78b-d473011730bb None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:54.827503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:54.843681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000a2f0-7b74-4067-b78b-d473011730bb None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:54.878089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf2bb1-8eda-44b7-8403-a47aa0b789fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:54.878801 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf2bb1-8eda-44b7-8403-a47aa0b789fc None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:54.879078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf2bb1-8eda-44b7-8403-a47aa0b789fc None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:54.879465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf2bb1-8eda-44b7-8403-a47aa0b789fc None admin] PATH_INFO: `/v3/projects/339b815d8c564acd97300978ef3acf38` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:54.880881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf2bb1-8eda-44b7-8403-a47aa0b789fc None admin] RBAC: Authorizing `identity:get_project(project_id=339b815d8c564acd97300978ef3acf38)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:54.882567 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf2bb1-8eda-44b7-8403-a47aa0b789fc None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:54.884452 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 595/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:30:54 2022] GET /identity/v3/projects/339b815d8c564acd97300978ef3acf38 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:54.891762 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e7f84-c9a1-4390-9c41-081f9bbc81fb None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:54.994370 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e7f84-c9a1-4390-9c41-081f9bbc81fb None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:55.033784 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9d71b-b820-4e36-9d71-03639d7ca5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:55.034405 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d71b-b820-4e36-9d71-03639d7ca5ca None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:55.034686 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d71b-b820-4e36-9d71-03639d7ca5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:55.034957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d71b-b820-4e36-9d71-03639d7ca5ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:55.036173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9d71b-b820-4e36-9d71-03639d7ca5ca None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=339b815d8c564acd97300978ef3acf38, user.id=cc078544f3b34a1593f71f8cd75d4690) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:55.036682 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9d71b-b820-4e36-9d71-03639d7ca5ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:55.039137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9d71b-b820-4e36-9d71-03639d7ca5ca None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:55.046038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 590/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:30:54 2022] GET /identity/v3/role_assignments?user.id=cc078544f3b34a1593f71f8cd75d4690&scope.project.id=339b815d8c564acd97300978ef3acf38&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:57.218880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd530d-bce4-4f80-a983-c01fef85f041 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:57.219508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd530d-bce4-4f80-a983-c01fef85f041 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:57.219508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd530d-bce4-4f80-a983-c01fef85f041 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:57.220772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 596/1186] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:30:57.226129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed330100-b3f0-4341-9513-78369d8c5431 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:57.226551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed330100-b3f0-4341-9513-78369d8c5431 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:57.226656 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed330100-b3f0-4341-9513-78369d8c5431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:57.245229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-ed330100-b3f0-4341-9513-78369d8c5431 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:30:57.246435 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ed330100-b3f0-4341-9513-78369d8c5431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:30:57.257474 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:57.312363 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 591/1187] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:30:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:30:57.579021 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd530d-bce4-4f80-a983-c01fef85f041 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:57.682020 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd530d-bce4-4f80-a983-c01fef85f041 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:57.715423 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeee1e-87e0-45ee-a105-a32233fc14b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:57.716070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeee1e-87e0-45ee-a105-a32233fc14b6 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:57.717030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeee1e-87e0-45ee-a105-a32233fc14b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:57.717299 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeee1e-87e0-45ee-a105-a32233fc14b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:57.727569 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfeee1e-87e0-45ee-a105-a32233fc14b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:30:57.733039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-0cfeee1e-87e0-45ee-a105-a32233fc14b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:30:57.733039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:30:57.733039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:30:57.733039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:30:57.733039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:30:57.733039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:30:57.733039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:30:57.733039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:30:57.733039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:30:57.733039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:30:57.733039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:30:57.733039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:30:57.733039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:30:57.733039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:30:57.733039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:30:57.733039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:30:57.734126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:30:57.734126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:30:57.734126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:30:57.734126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:30:57.734126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:30:57.734126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:30:57.734126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:30:57.734126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:30:57.734126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:30:57.734126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:30:57.734126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:30:57.734126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:30:57.734126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:30:57.734126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:30:57.734126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:30:57.734126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:30:57.735010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:30:57.735010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:30:57.735010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:30:57.735010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:30:57.735010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:30:57.735010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:30:57.735010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:30:57.735010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:30:57.735010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:30:57.735010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:30:57.735010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:30:57.735010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:30:57.735010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 597/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:30:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:30:57.740491 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed330100-b3f0-4341-9513-78369d8c5431 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:57.853779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed330100-b3f0-4341-9513-78369d8c5431 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:57.888507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e172a1e-5413-4501-88e5-d8061bc05f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:57.889610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e172a1e-5413-4501-88e5-d8061bc05f99 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:57.889893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e172a1e-5413-4501-88e5-d8061bc05f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:57.890169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e172a1e-5413-4501-88e5-d8061bc05f99 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:57.890826 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e172a1e-5413-4501-88e5-d8061bc05f99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:30:57.891127 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e172a1e-5413-4501-88e5-d8061bc05f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:57.892517 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e172a1e-5413-4501-88e5-d8061bc05f99 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:57.900722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 592/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:30:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:57.907450 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeee1e-87e0-45ee-a105-a32233fc14b6 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:57.923135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:58.007494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeee1e-87e0-45ee-a105-a32233fc14b6 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:58.041346 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f9f14-db67-402f-a40c-c8331dc1be2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:58.041969 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f9f14-db67-402f-a40c-c8331dc1be2e None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:58.042246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f9f14-db67-402f-a40c-c8331dc1be2e None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:58.042520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f9f14-db67-402f-a40c-c8331dc1be2e None admin] PATH_INFO: `/v3/users/cc078544f3b34a1593f71f8cd75d4690` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:58.043660 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f9f14-db67-402f-a40c-c8331dc1be2e None admin] RBAC: Authorizing `identity:get_user(user_id=cc078544f3b34a1593f71f8cd75d4690)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:58.045106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f9f14-db67-402f-a40c-c8331dc1be2e None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:58.046690 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 598/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:30:57 2022] GET /identity/v3/users/cc078544f3b34a1593f71f8cd75d4690 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:30:58.052573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e172a1e-5413-4501-88e5-d8061bc05f99 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:58.064630 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:58.155518 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e172a1e-5413-4501-88e5-d8061bc05f99 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:58.188699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49ebf4-cde6-455d-8f33-1419e97f4004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:58.189327 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49ebf4-cde6-455d-8f33-1419e97f4004 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:58.189597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49ebf4-cde6-455d-8f33-1419e97f4004 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:58.189871 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49ebf4-cde6-455d-8f33-1419e97f4004 None admin] PATH_INFO: `/v3/projects/339b815d8c564acd97300978ef3acf38` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:58.190968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49ebf4-cde6-455d-8f33-1419e97f4004 None admin] RBAC: Authorizing `identity:get_project(project_id=339b815d8c564acd97300978ef3acf38)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:58.192428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49ebf4-cde6-455d-8f33-1419e97f4004 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:58.194049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 593/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:30:58 2022] GET /identity/v3/projects/339b815d8c564acd97300978ef3acf38 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:30:58.200112 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f9f14-db67-402f-a40c-c8331dc1be2e None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:30:58.281288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:30:58.301074 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f9f14-db67-402f-a40c-c8331dc1be2e None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:30:58.337502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d7b22-d896-4406-a75f-0c08c21b6744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:30:58.338162 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d7b22-d896-4406-a75f-0c08c21b6744 None admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:30:58.338445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d7b22-d896-4406-a75f-0c08c21b6744 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:30:58.338722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d7b22-d896-4406-a75f-0c08c21b6744 None admin] PATH_INFO: `/v3/projects/339b815d8c564acd97300978ef3acf38/users/cc078544f3b34a1593f71f8cd75d4690/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:30:58.340917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d7b22-d896-4406-a75f-0c08c21b6744 None admin] RBAC: Authorizing `identity:create_grant(project_id=339b815d8c564acd97300978ef3acf38, user_id=cc078544f3b34a1593f71f8cd75d4690, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:30:58.342364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d7b22-d896-4406-a75f-0c08c21b6744 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:30:58.402636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 599/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:30:58 2022] PUT /identity/v3/projects/339b815d8c564acd97300978ef3acf38/users/cc078544f3b34a1593f71f8cd75d4690/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:31:00.626524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6bb89-b2ee-42c0-b597-73d1d1c941a6 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:31:00.627103 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6bb89-b2ee-42c0-b597-73d1d1c941a6 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:31:00.627103 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6bb89-b2ee-42c0-b597-73d1d1c941a6 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:31:00.628511 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 594/1193] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:31:00.633844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1ddb8-66de-40d0-9abb-b2c5b7cbf97b None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:31:00.634306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1ddb8-66de-40d0-9abb-b2c5b7cbf97b None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:31:00.634401 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1ddb8-66de-40d0-9abb-b2c5b7cbf97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:31:00.652944 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-bba1ddb8-66de-40d0-9abb-b2c5b7cbf97b None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:31:00.654150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-bba1ddb8-66de-40d0-9abb-b2c5b7cbf97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:31:00.722186 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 600/1194] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:31:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:31:00.999623 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6bb89-b2ee-42c0-b597-73d1d1c941a6 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:31:01.082288 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:31:01.107039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6bb89-b2ee-42c0-b597-73d1d1c941a6 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:31:01.141617 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397725de-4f61-460b-a094-a100b6dbcd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:31:01.142243 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397725de-4f61-460b-a094-a100b6dbcd2c None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:31:01.142521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397725de-4f61-460b-a094-a100b6dbcd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:31:01.142794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397725de-4f61-460b-a094-a100b6dbcd2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:31:01.153237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397725de-4f61-460b-a094-a100b6dbcd2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:31:01.158514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-397725de-4f61-460b-a094-a100b6dbcd2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:31:01.158514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:31:01.158514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:31:01.158514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:31:01.158514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:31:01.158514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:31:01.158514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:31:01.158514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:31:01.158514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:31:01.158514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:31:01.158514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:31:01.158514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:31:01.158514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:31:01.158514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:31:01.158514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:31:01.158514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:31:01.159749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:31:01.159749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:31:01.159749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:31:01.159749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:31:01.159749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:31:01.159749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:31:01.159749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:31:01.159749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:31:01.159749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:31:01.159749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:31:01.159749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:31:01.159749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:31:01.159749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:31:01.159749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:31:01.159749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:31:01.159749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:31:01.161016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:31:01.161016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:31:01.161016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:31:01.161016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:31:01.161016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:31:01.161016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:31:01.161016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:31:01.161016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:31:01.161016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:31:01.161016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:31:01.161016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:31:01.161016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:31:01.161016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 595/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:31:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:31:01.165772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1ddb8-66de-40d0-9abb-b2c5b7cbf97b None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:31:01.234511 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:31:01.265032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1ddb8-66de-40d0-9abb-b2c5b7cbf97b None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:31:01.301676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f86146-80cb-4ae1-8b35-306d79fa6493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:31:01.302277 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f86146-80cb-4ae1-8b35-306d79fa6493 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:31:01.302551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f86146-80cb-4ae1-8b35-306d79fa6493 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:31:01.302819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f86146-80cb-4ae1-8b35-306d79fa6493 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:31:01.303501 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f86146-80cb-4ae1-8b35-306d79fa6493 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:31:01.303799 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f86146-80cb-4ae1-8b35-306d79fa6493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:31:01.305151 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f86146-80cb-4ae1-8b35-306d79fa6493 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:31:01.313614 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 601/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:31:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:31:01.319714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397725de-4f61-460b-a094-a100b6dbcd2c None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:31:01.425829 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397725de-4f61-460b-a094-a100b6dbcd2c None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:31:01.465248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d5c72-24d3-4c79-b24e-5cb5008c09e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:31:01.465941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d5c72-24d3-4c79-b24e-5cb5008c09e2 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:31:01.466251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d5c72-24d3-4c79-b24e-5cb5008c09e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:31:01.466747 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d5c72-24d3-4c79-b24e-5cb5008c09e2 None admin] PATH_INFO: `/v3/users/cc078544f3b34a1593f71f8cd75d4690` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:31:01.468189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d5c72-24d3-4c79-b24e-5cb5008c09e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cc078544f3b34a1593f71f8cd75d4690)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:31:01.469674 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d5c72-24d3-4c79-b24e-5cb5008c09e2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:31:01.472053 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 596/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Sep 7 16:31:01 2022] GET /identity/v3/users/cc078544f3b34a1593f71f8cd75d4690 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:31:01.478026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f86146-80cb-4ae1-8b35-306d79fa6493 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:31:01.585654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f86146-80cb-4ae1-8b35-306d79fa6493 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:31:01.614650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:31:01.619431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d8e4b-18b6-4fd8-8d31-50c93f222b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:31:01.620060 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d8e4b-18b6-4fd8-8d31-50c93f222b4a None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:31:01.620333 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d8e4b-18b6-4fd8-8d31-50c93f222b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:31:01.620596 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d8e4b-18b6-4fd8-8d31-50c93f222b4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:31:01.688077 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d8e4b-18b6-4fd8-8d31-50c93f222b4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:31:01.689509 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d8e4b-18b6-4fd8-8d31-50c93f222b4a None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:31:01.788812 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 602/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:31:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:31:01.795938 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d5c72-24d3-4c79-b24e-5cb5008c09e2 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:31:01.801441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:31:01.902496 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d5c72-24d3-4c79-b24e-5cb5008c09e2 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:31:01.936842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef7654-81a1-4b7f-b8c7-2e47a699d1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:31:01.937507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef7654-81a1-4b7f-b8c7-2e47a699d1eb None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:31:01.937790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef7654-81a1-4b7f-b8c7-2e47a699d1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:31:01.938065 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef7654-81a1-4b7f-b8c7-2e47a699d1eb None admin] PATH_INFO: `/v3/projects/339b815d8c564acd97300978ef3acf38` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:31:01.939176 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef7654-81a1-4b7f-b8c7-2e47a699d1eb None admin] RBAC: Authorizing `identity:get_project(project_id=339b815d8c564acd97300978ef3acf38)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:31:01.940652 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef7654-81a1-4b7f-b8c7-2e47a699d1eb None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:31:01.942292 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 597/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Sep 7 16:31:01 2022] GET /identity/v3/projects/339b815d8c564acd97300978ef3acf38 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:31:01.948641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d8e4b-18b6-4fd8-8d31-50c93f222b4a None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:31:01.978853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:31:02.061862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d8e4b-18b6-4fd8-8d31-50c93f222b4a None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:31:02.095775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519efba-afae-4dc4-b6bf-27d96fc2fdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:31:02.096385 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519efba-afae-4dc4-b6bf-27d96fc2fdfa None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:31:02.096642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519efba-afae-4dc4-b6bf-27d96fc2fdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:31:02.096908 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519efba-afae-4dc4-b6bf-27d96fc2fdfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:31:02.097617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519efba-afae-4dc4-b6bf-27d96fc2fdfa None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=339b815d8c564acd97300978ef3acf38, user.id=cc078544f3b34a1593f71f8cd75d4690) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:31:02.097916 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519efba-afae-4dc4-b6bf-27d96fc2fdfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:31:02.099323 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519efba-afae-4dc4-b6bf-27d96fc2fdfa None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:31:02.105022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 603/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:31:01 2022] GET /identity/v3/role_assignments?user.id=cc078544f3b34a1593f71f8cd75d4690&scope.project.id=339b815d8c564acd97300978ef3acf38&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:31:11.932512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=64 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:31:12.102424 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=52 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:22.307158 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab025a0-99f2-42b7-a992-99c0f8a4055d None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:22.307819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab025a0-99f2-42b7-a992-99c0f8a4055d None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:22.307819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab025a0-99f2-42b7-a992-99c0f8a4055d None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:22.309144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 598/1201] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:32:22.314671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf790c50-83b3-4415-a78a-75be33b650dd None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:22.315169 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf790c50-83b3-4415-a78a-75be33b650dd None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:22.315282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf790c50-83b3-4415-a78a-75be33b650dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:22.334979 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-bf790c50-83b3-4415-a78a-75be33b650dd None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:32:22.341325 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-bf790c50-83b3-4415-a78a-75be33b650dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:32:22.413861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 604/1202] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:32:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:32:22.703395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab025a0-99f2-42b7-a992-99c0f8a4055d None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:22.812987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab025a0-99f2-42b7-a992-99c0f8a4055d None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:22.850639 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7a005-58b8-495a-84d3-ad74d0b8cb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:22.851273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7a005-58b8-495a-84d3-ad74d0b8cb15 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:22.851627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7a005-58b8-495a-84d3-ad74d0b8cb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:22.851899 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7a005-58b8-495a-84d3-ad74d0b8cb15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:22.863668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7a005-58b8-495a-84d3-ad74d0b8cb15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:22.865141 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7a005-58b8-495a-84d3-ad74d0b8cb15 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:22.880097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-9dc7a005-58b8-495a-84d3-ad74d0b8cb15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:22.880097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:22.880097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:22.880097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:22.880097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:22.880097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:22.880097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:22.880097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:22.880097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:22.880097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:22.880097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:22.880097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:22.880097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:32:22.880097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:32:22.880097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:32:22.880097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:32:22.881233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:22.881233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:22.881233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:22.881233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:22.881233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:22.881233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:22.881233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:22.881233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:22.881233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:22.881233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:22.881233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:22.881233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:22.881233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:22.881233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:22.881233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:22.881233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:22.881233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:32:22.882585 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:32:22.882585 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:22.882585 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:32:22.882585 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 599/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:22.887605 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf790c50-83b3-4415-a78a-75be33b650dd None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:22.992430 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf790c50-83b3-4415-a78a-75be33b650dd None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:23.022568 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:23.028494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d78bc-0e32-4ff5-a080-e67a3c4860a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:23.029108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d78bc-0e32-4ff5-a080-e67a3c4860a7 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:23.029388 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d78bc-0e32-4ff5-a080-e67a3c4860a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:23.029658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d78bc-0e32-4ff5-a080-e67a3c4860a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:23.030821 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d78bc-0e32-4ff5-a080-e67a3c4860a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:23.031132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d78bc-0e32-4ff5-a080-e67a3c4860a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:23.032542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d78bc-0e32-4ff5-a080-e67a3c4860a7 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:23.044624 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 605/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:23.050956 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7a005-58b8-495a-84d3-ad74d0b8cb15 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:23.107856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:23.156605 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7a005-58b8-495a-84d3-ad74d0b8cb15 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:23.193076 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98565c5-effa-43ed-a44a-a0be9ed298eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:23.193682 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98565c5-effa-43ed-a44a-a0be9ed298eb None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:23.193958 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98565c5-effa-43ed-a44a-a0be9ed298eb None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:23.194327 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98565c5-effa-43ed-a44a-a0be9ed298eb None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:23.194978 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98565c5-effa-43ed-a44a-a0be9ed298eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:23.196473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98565c5-effa-43ed-a44a-a0be9ed298eb None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:23.310646 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 600/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Sep 7 16:32:23 2022] POST /identity/v3/users => generated 251 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:32:25.545291 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509f383-12fd-4cfb-9f9b-1574e5839b68 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:25.545868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509f383-12fd-4cfb-9f9b-1574e5839b68 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:25.545868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509f383-12fd-4cfb-9f9b-1574e5839b68 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:25.547657 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 606/1206] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:32:25.553050 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58fc26-01c4-413d-aa8a-69a5cd067205 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:25.554313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58fc26-01c4-413d-aa8a-69a5cd067205 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:25.554313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58fc26-01c4-413d-aa8a-69a5cd067205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:25.572908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-dd58fc26-01c4-413d-aa8a-69a5cd067205 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:32:25.574091 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-dd58fc26-01c4-413d-aa8a-69a5cd067205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:32:25.642488 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 601/1207] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:32:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:32:25.913252 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509f383-12fd-4cfb-9f9b-1574e5839b68 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:26.029265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509f383-12fd-4cfb-9f9b-1574e5839b68 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:26.065054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8cb3a-0025-46f0-ae5b-b88313e62752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:26.065680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8cb3a-0025-46f0-ae5b-b88313e62752 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:26.065953 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8cb3a-0025-46f0-ae5b-b88313e62752 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:26.066223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8cb3a-0025-46f0-ae5b-b88313e62752 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:26.076583 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8cb3a-0025-46f0-ae5b-b88313e62752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:32:26.082102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-3ea8cb3a-0025-46f0-ae5b-b88313e62752 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:32:26.082102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:26.082102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:26.082102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:26.082102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:26.082102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:26.082102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:26.082102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:26.082102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:26.082102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:26.082102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:26.082102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:26.082102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:32:26.082102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:32:26.082102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:32:26.082102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:32:26.087580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:32:26.087580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:32:26.087580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:32:26.087580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:32:26.087580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:26.087580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:26.087580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:26.087580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:26.087580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:26.087580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:26.087580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:26.087580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:26.087580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:26.087580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:26.087580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:26.087580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:26.089007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:26.089007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:26.089007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:26.089007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:26.089007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:32:26.089007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:32:26.089007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:32:26.089007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:32:26.089007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:32:26.089007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:32:26.089007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:32:26.089007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:26.089007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 607/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:32:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:26.091186 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58fc26-01c4-413d-aa8a-69a5cd067205 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:26.130280 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:26.188664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58fc26-01c4-413d-aa8a-69a5cd067205 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:26.223746 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640bd6f-80f2-463d-b65c-ddda417711a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:26.224357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640bd6f-80f2-463d-b65c-ddda417711a9 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:26.224631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640bd6f-80f2-463d-b65c-ddda417711a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:26.224894 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640bd6f-80f2-463d-b65c-ddda417711a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:26.225545 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640bd6f-80f2-463d-b65c-ddda417711a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:26.225840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640bd6f-80f2-463d-b65c-ddda417711a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:26.227188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640bd6f-80f2-463d-b65c-ddda417711a9 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:26.235373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 602/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:32:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:26.241156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8cb3a-0025-46f0-ae5b-b88313e62752 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:26.295384 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:26.346224 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8cb3a-0025-46f0-ae5b-b88313e62752 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:26.379884 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec75bb1-870e-4adf-836c-edd9b707a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:26.380512 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec75bb1-870e-4adf-836c-edd9b707a2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:26.380790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec75bb1-870e-4adf-836c-edd9b707a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:26.381064 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec75bb1-870e-4adf-836c-edd9b707a2f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:26.392094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec75bb1-870e-4adf-836c-edd9b707a2f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:26.393576 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec75bb1-870e-4adf-836c-edd9b707a2f0 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:26.408970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-eec75bb1-870e-4adf-836c-edd9b707a2f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:26.408970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:26.408970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:26.408970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:26.408970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:26.408970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:26.408970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:26.408970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:26.408970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:26.408970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:26.408970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:26.408970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:26.408970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:32:26.408970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:32:26.408970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:32:26.408970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:32:26.410251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:26.410251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:26.410251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:26.410251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:26.410251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:26.410251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:26.410251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:26.410251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:26.410251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:26.410251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:26.410251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:26.410251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:26.410251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:26.410251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:26.410251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:26.410251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:26.410251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:32:26.411373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:32:26.411373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:26.411373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:26.411373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 608/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:26.415931 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640bd6f-80f2-463d-b65c-ddda417711a9 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:26.524876 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:26.528026 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640bd6f-80f2-463d-b65c-ddda417711a9 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:26.562052 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b8f6d-a265-462e-be20-94185abe3adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:26.562902 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b8f6d-a265-462e-be20-94185abe3adf None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:26.563140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b8f6d-a265-462e-be20-94185abe3adf None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:26.563413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b8f6d-a265-462e-be20-94185abe3adf None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:26.564083 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b8f6d-a265-462e-be20-94185abe3adf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:26.564387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b8f6d-a265-462e-be20-94185abe3adf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:26.565893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b8f6d-a265-462e-be20-94185abe3adf None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:26.578550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 603/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:26.584511 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec75bb1-870e-4adf-836c-edd9b707a2f0 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:26.689207 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec75bb1-870e-4adf-836c-edd9b707a2f0 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:26.690758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:26.726486 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5d992-8021-49e8-9444-62ed7c933956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:26.727104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5d992-8021-49e8-9444-62ed7c933956 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:26.727378 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5d992-8021-49e8-9444-62ed7c933956 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:26.727678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5d992-8021-49e8-9444-62ed7c933956 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:26.734812 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5d992-8021-49e8-9444-62ed7c933956 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:26.736266 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5d992-8021-49e8-9444-62ed7c933956 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:26.747691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-14d5d992-8021-49e8-9444-62ed7c933956 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:32:26.747691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:26.747691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:26.747691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:26.747691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:26.747691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:26.747691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:26.747691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:26.747691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:26.747691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:26.747691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:26.747691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:26.747691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:32:26.747691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:32:26.747691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:32:26.747691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:26.748858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:26.750369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:26.750369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:26.750369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:32:26.750369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:32:26.750369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:32:26.750369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:32:26.750369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:32:26.750369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:32:26.750369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:32:26.750369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:26.750369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 609/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:26.756210 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b8f6d-a265-462e-be20-94185abe3adf None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:26.854841 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b8f6d-a265-462e-be20-94185abe3adf None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:26.890547 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352e869-21c5-4bfc-8576-a72868fb8e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:26.891169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352e869-21c5-4bfc-8576-a72868fb8e31 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:26.891524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352e869-21c5-4bfc-8576-a72868fb8e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:26.891701 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352e869-21c5-4bfc-8576-a72868fb8e31 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:26.892409 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352e869-21c5-4bfc-8576-a72868fb8e31 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:26.892708 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352e869-21c5-4bfc-8576-a72868fb8e31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:26.894112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352e869-21c5-4bfc-8576-a72868fb8e31 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:26.910918 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 604/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Sep 7 16:32:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:26.916704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5d992-8021-49e8-9444-62ed7c933956 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:27.023505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5d992-8021-49e8-9444-62ed7c933956 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:27.059417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a257e-0577-4940-906b-5113f5242287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:27.060069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a257e-0577-4940-906b-5113f5242287 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:27.060345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a257e-0577-4940-906b-5113f5242287 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:27.060616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a257e-0577-4940-906b-5113f5242287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:27.094586 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:27.133816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a257e-0577-4940-906b-5113f5242287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:27.135152 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a257e-0577-4940-906b-5113f5242287 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:27.235502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 610/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:32:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:32:27.241477 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352e869-21c5-4bfc-8576-a72868fb8e31 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:27.261105 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:27.351355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352e869-21c5-4bfc-8576-a72868fb8e31 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:27.388457 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ab8e3-0a96-434b-b3cf-1644c9a49ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:27.389072 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ab8e3-0a96-434b-b3cf-1644c9a49ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:27.389457 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ab8e3-0a96-434b-b3cf-1644c9a49ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:27.389829 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ab8e3-0a96-434b-b3cf-1644c9a49ca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:27.401049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ab8e3-0a96-434b-b3cf-1644c9a49ca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:27.402503 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ab8e3-0a96-434b-b3cf-1644c9a49ca2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:27.418339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-905ab8e3-0a96-434b-b3cf-1644c9a49ca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:27.418339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:27.418339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:27.418339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:27.418339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:27.418339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:27.418339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:27.418339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:27.418339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:27.418339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:27.418339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:27.418339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:27.418339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:32:27.418339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:32:27.418339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:32:27.418339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:32:27.419618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:27.419618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:27.419618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:27.419618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:27.419618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:27.419618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:27.419618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:27.419618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:27.419618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:27.419618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:27.419618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:27.419618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:27.419618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:27.419618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:27.419618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:27.419618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:27.419618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:32:27.421932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:32:27.421932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:27.421932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:32:27.421932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 605/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:27.426241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a257e-0577-4940-906b-5113f5242287 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:27.490655 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:27.530957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a257e-0577-4940-906b-5113f5242287 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:27.564587 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4415a57-0a0b-4547-819f-d7f59386c4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:27.565191 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4415a57-0a0b-4547-819f-d7f59386c4fd None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:27.565474 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4415a57-0a0b-4547-819f-d7f59386c4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:27.565748 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4415a57-0a0b-4547-819f-d7f59386c4fd None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:27.566383 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4415a57-0a0b-4547-819f-d7f59386c4fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:27.566683 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4415a57-0a0b-4547-819f-d7f59386c4fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:27.568088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4415a57-0a0b-4547-819f-d7f59386c4fd None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:27.581384 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 611/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:27.586994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ab8e3-0a96-434b-b3cf-1644c9a49ca2 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:27.660763 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:27.693642 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ab8e3-0a96-434b-b3cf-1644c9a49ca2 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:27.728564 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aeb977-8b7c-435f-ae4e-656c54b5a2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:27.743925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aeb977-8b7c-435f-ae4e-656c54b5a2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:27.743925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aeb977-8b7c-435f-ae4e-656c54b5a2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:27.743925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aeb977-8b7c-435f-ae4e-656c54b5a2e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:27.743925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aeb977-8b7c-435f-ae4e-656c54b5a2e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:27.743925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aeb977-8b7c-435f-ae4e-656c54b5a2e1 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:27.750166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-31aeb977-8b7c-435f-ae4e-656c54b5a2e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:32:27.750166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:27.750166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:27.750166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:27.750166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:27.750166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:27.750166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:27.750166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:27.750166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:27.750166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:27.750166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:27.750166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:27.750166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:32:27.750166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:32:27.750166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:32:27.751392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:32:27.751392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:27.751392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:27.751392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:27.751392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:27.751392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:27.751392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:27.751392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:27.751392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:27.751392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:27.751392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:27.751392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:27.751392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:27.751392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:27.751392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:27.751392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:27.751392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:27.752509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:32:27.752509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:32:27.752509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:32:27.752509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:32:27.752509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:32:27.752509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:32:27.752509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:32:27.752509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:32:27.752509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 606/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:32:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:27.758958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4415a57-0a0b-4547-819f-d7f59386c4fd None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:27.863908 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4415a57-0a0b-4547-819f-d7f59386c4fd None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:27.888783 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:27.901058 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c23ee-da1a-4d2d-be6f-1404f60a279f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:27.901672 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c23ee-da1a-4d2d-be6f-1404f60a279f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:27.901950 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c23ee-da1a-4d2d-be6f-1404f60a279f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:27.902222 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c23ee-da1a-4d2d-be6f-1404f60a279f None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:27.902905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c23ee-da1a-4d2d-be6f-1404f60a279f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:27.903211 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c23ee-da1a-4d2d-be6f-1404f60a279f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:27.904669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c23ee-da1a-4d2d-be6f-1404f60a279f None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:27.916500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 612/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:32:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:27.923430 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aeb977-8b7c-435f-ae4e-656c54b5a2e1 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:28.030424 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aeb977-8b7c-435f-ae4e-656c54b5a2e1 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:28.060725 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:28.068199 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58c026-cab9-4184-914f-96426051d9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:28.068846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58c026-cab9-4184-914f-96426051d9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:28.069121 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58c026-cab9-4184-914f-96426051d9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:28.069394 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58c026-cab9-4184-914f-96426051d9f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:28.070154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58c026-cab9-4184-914f-96426051d9f3 None admin] RBAC: Adding query filter params (role.id=9b7a362fef7446e795c33b25a08f20bc, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=256e8478e5fb4c01acde0d597bae0b53) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:28.070485 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58c026-cab9-4184-914f-96426051d9f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:28.072020 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58c026-cab9-4184-914f-96426051d9f3 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:28.079210 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 607/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:32:27 2022] GET /identity/v3/role_assignments?user.id=256e8478e5fb4c01acde0d597bae0b53&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9b7a362fef7446e795c33b25a08f20bc => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:30.241109 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7068c0c-5e77-4747-9363-1425addb8864 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:30.241648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7068c0c-5e77-4747-9363-1425addb8864 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:30.241648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7068c0c-5e77-4747-9363-1425addb8864 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:30.242982 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 613/1220] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:32:30.248249 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71edbfc-afc5-405c-92f3-b35d27dccfb8 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:30.248684 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71edbfc-afc5-405c-92f3-b35d27dccfb8 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:30.248796 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71edbfc-afc5-405c-92f3-b35d27dccfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:30.268139 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-f71edbfc-afc5-405c-92f3-b35d27dccfb8 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:32:30.269395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f71edbfc-afc5-405c-92f3-b35d27dccfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:32:30.345082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 608/1221] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:32:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:32:30.618849 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7068c0c-5e77-4747-9363-1425addb8864 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:30.725650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7068c0c-5e77-4747-9363-1425addb8864 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:30.761665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14614fa-4221-4050-be81-cbc5abf3fa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:30.763780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14614fa-4221-4050-be81-cbc5abf3fa06 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:30.763780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14614fa-4221-4050-be81-cbc5abf3fa06 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:30.763780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14614fa-4221-4050-be81-cbc5abf3fa06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:30.774314 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14614fa-4221-4050-be81-cbc5abf3fa06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:32:30.779340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-b14614fa-4221-4050-be81-cbc5abf3fa06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:32:30.779340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:30.779340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:30.779340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:30.779340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:30.779340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:30.779340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:30.779340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:30.779340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:30.779340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:30.779340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:30.779340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:30.779340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:32:30.779340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:32:30.779340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:32:30.779340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:32:30.780640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:32:30.780640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:32:30.780640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:32:30.780640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:32:30.780640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:30.780640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:30.780640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:30.780640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:30.780640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:30.780640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:30.780640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:30.780640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:30.780640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:30.780640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:30.780640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:30.780640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:30.781588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:30.781588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:30.781588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:30.781588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:30.781588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:32:30.781588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:32:30.781588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:32:30.781588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:32:30.781588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:32:30.781588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:32:30.781588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:32:30.781588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:30.781588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 614/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:32:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:30.787164 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71edbfc-afc5-405c-92f3-b35d27dccfb8 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:30.893913 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71edbfc-afc5-405c-92f3-b35d27dccfb8 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:30.918873 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:30.930766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715ea7c-d56a-462a-8885-91d229277057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:30.931376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ea7c-d56a-462a-8885-91d229277057 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:30.931680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ea7c-d56a-462a-8885-91d229277057 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:30.931956 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ea7c-d56a-462a-8885-91d229277057 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:30.932611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715ea7c-d56a-462a-8885-91d229277057 None admin] RBAC: Adding query filter params (name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:30.932906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715ea7c-d56a-462a-8885-91d229277057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:30.934273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715ea7c-d56a-462a-8885-91d229277057 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:30.942935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 609/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:32:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:30.948744 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14614fa-4221-4050-be81-cbc5abf3fa06 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:30.995676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:31.057515 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14614fa-4221-4050-be81-cbc5abf3fa06 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:31.091974 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54542e2-2855-49f5-af1e-a8fccca0e522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:31.092601 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54542e2-2855-49f5-af1e-a8fccca0e522 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:31.093455 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54542e2-2855-49f5-af1e-a8fccca0e522 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:31.094389 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54542e2-2855-49f5-af1e-a8fccca0e522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:31.105389 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54542e2-2855-49f5-af1e-a8fccca0e522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:31.106823 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54542e2-2855-49f5-af1e-a8fccca0e522 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:31.122436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-c54542e2-2855-49f5-af1e-a8fccca0e522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:31.122436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:31.122436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:31.122436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:31.122436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:31.122436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:31.122436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:31.122436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:31.122436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:31.122436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:31.122436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:31.122436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:31.122436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:32:31.122436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:32:31.122436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:32:31.122436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:32:31.124281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:31.124281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:31.124281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:31.124281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:31.124281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:31.124281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:31.124281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:31.124281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:31.124281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:31.124281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:31.124281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:31.124281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:31.124281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:31.124281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:31.124281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:31.124281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:31.124281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:32:31.125544 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:32:31.125544 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:31.125544 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:31.125544 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 615/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:31.130675 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715ea7c-d56a-462a-8885-91d229277057 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:31.234362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715ea7c-d56a-462a-8885-91d229277057 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:31.267367 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426a466-9444-46ba-a167-768436c5f1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:31.268043 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426a466-9444-46ba-a167-768436c5f1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:31.268275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426a466-9444-46ba-a167-768436c5f1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:31.268550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426a466-9444-46ba-a167-768436c5f1f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:31.269208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426a466-9444-46ba-a167-768436c5f1f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:31.269509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426a466-9444-46ba-a167-768436c5f1f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:31.270863 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426a466-9444-46ba-a167-768436c5f1f4 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:31.283080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 610/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:31.288878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54542e2-2855-49f5-af1e-a8fccca0e522 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:31.386195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:31.392896 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54542e2-2855-49f5-af1e-a8fccca0e522 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:31.430417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d5f63-ad03-4436-9b47-3fb1d715faa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:31.441093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d5f63-ad03-4436-9b47-3fb1d715faa3 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:31.441093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d5f63-ad03-4436-9b47-3fb1d715faa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:31.441093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d5f63-ad03-4436-9b47-3fb1d715faa3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:31.441093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d5f63-ad03-4436-9b47-3fb1d715faa3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:31.441093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d5f63-ad03-4436-9b47-3fb1d715faa3 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:31.452011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-405d5f63-ad03-4436-9b47-3fb1d715faa3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:32:31.452011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:31.452011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:31.452011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:31.452011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:31.452011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:31.452011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:31.452011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:31.452011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:31.452011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:31.452011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:31.452011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:31.452011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:32:31.452011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:32:31.452011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:32:31.452011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:31.454073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:31.455294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:31.455294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:31.455294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:32:31.455294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:32:31.455294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:32:31.455294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:32:31.455294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:32:31.455294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:32:31.455294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:32:31.455294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:31.455294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 616/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:31.459552 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426a466-9444-46ba-a167-768436c5f1f4 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:31.506643 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:31.561123 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426a466-9444-46ba-a167-768436c5f1f4 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:31.597853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcd132-4dfa-4a5b-96e4-d86271fbbb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:31.598471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcd132-4dfa-4a5b-96e4-d86271fbbb7b None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:31.598740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcd132-4dfa-4a5b-96e4-d86271fbbb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:31.599009 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcd132-4dfa-4a5b-96e4-d86271fbbb7b None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:31.599777 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcd132-4dfa-4a5b-96e4-d86271fbbb7b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:31.600082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcd132-4dfa-4a5b-96e4-d86271fbbb7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:31.601571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcd132-4dfa-4a5b-96e4-d86271fbbb7b None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:31.621270 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 611/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Sep 7 16:32:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:31.628161 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d5f63-ad03-4436-9b47-3fb1d715faa3 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:31.736558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d5f63-ad03-4436-9b47-3fb1d715faa3 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:31.771555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f48dbe-2edc-4971-8409-61929a397359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:31.772265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f48dbe-2edc-4971-8409-61929a397359 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:31.772537 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f48dbe-2edc-4971-8409-61929a397359 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:31.772820 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f48dbe-2edc-4971-8409-61929a397359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:31.784887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f48dbe-2edc-4971-8409-61929a397359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:31.786343 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f48dbe-2edc-4971-8409-61929a397359 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:31.801406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-38f48dbe-2edc-4971-8409-61929a397359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:31.801406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:31.801406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:31.801406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:31.801406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:31.801406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:31.801406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:31.801406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:31.801406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:31.801406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:31.801406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:31.801406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:31.801406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:32:31.801406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:32:31.801406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:32:31.801406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:32:31.807686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:31.807686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:31.807686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:31.807686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:31.807686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:31.807686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:31.807686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:31.807686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:31.807686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:31.807686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:31.807686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:31.807686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:31.807686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:31.807686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:31.807686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:31.807686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:31.807686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:32:31.808625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:32:31.808625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:31.808625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:31.808625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 617/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:31.810280 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcd132-4dfa-4a5b-96e4-d86271fbbb7b None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:31.916727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcd132-4dfa-4a5b-96e4-d86271fbbb7b None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:31.920681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:31.956565 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d8fc2-4ad9-47c0-85a4-459f38c8026e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:31.957173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d8fc2-4ad9-47c0-85a4-459f38c8026e None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:31.957449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d8fc2-4ad9-47c0-85a4-459f38c8026e None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:31.957717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d8fc2-4ad9-47c0-85a4-459f38c8026e None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:31.958350 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d8fc2-4ad9-47c0-85a4-459f38c8026e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:31.958649 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d8fc2-4ad9-47c0-85a4-459f38c8026e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:31.960061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d8fc2-4ad9-47c0-85a4-459f38c8026e None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:31.972171 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 612/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:31.978080 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f48dbe-2edc-4971-8409-61929a397359 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:31.987850 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:32.084215 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f48dbe-2edc-4971-8409-61929a397359 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:32.119724 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d709c-857e-40cf-8d54-3dca3daf750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:32.120461 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d709c-857e-40cf-8d54-3dca3daf750c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:32.120748 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d709c-857e-40cf-8d54-3dca3daf750c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:32.121023 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d709c-857e-40cf-8d54-3dca3daf750c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:32.129204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d709c-857e-40cf-8d54-3dca3daf750c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:32.131322 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d709c-857e-40cf-8d54-3dca3daf750c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:32.145141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-716d709c-857e-40cf-8d54-3dca3daf750c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:32:32.145141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:32.145141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:32.145141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:32.145141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:32.145141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:32.145141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:32.145141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:32.145141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:32.145141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:32.145141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:32.145141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:32.145141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:32:32.145141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:32:32.145141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:32:32.146249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:32:32.146249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:32.146249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:32.146249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:32.146249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:32.146249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:32.146249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:32.146249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:32.146249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:32.146249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:32.146249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:32.146249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:32.146249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:32.146249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:32.146249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:32.146249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:32.146249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:32.147246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:32:32.147246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:32:32.147246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:32:32.147246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:32:32.147246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:32:32.147246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:32:32.147246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:32:32.147246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:32.147246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 618/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:32:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:32.152384 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d8fc2-4ad9-47c0-85a4-459f38c8026e None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:32.257657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d8fc2-4ad9-47c0-85a4-459f38c8026e None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:32.292771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3b9e4-37b1-4136-aefa-969c1e7736dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:32.293448 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3b9e4-37b1-4136-aefa-969c1e7736dc None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:32.293660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3b9e4-37b1-4136-aefa-969c1e7736dc None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:32.293921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3b9e4-37b1-4136-aefa-969c1e7736dc None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:32.294614 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3b9e4-37b1-4136-aefa-969c1e7736dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:32.294914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3b9e4-37b1-4136-aefa-969c1e7736dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:32.296884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3b9e4-37b1-4136-aefa-969c1e7736dc None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:32.309235 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 613/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:32:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:32.316161 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d709c-857e-40cf-8d54-3dca3daf750c None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:32.387156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:32.423233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d709c-857e-40cf-8d54-3dca3daf750c None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:32.457370 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539a2ba-a017-4a4e-97c3-2f854296ed00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:32.458029 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a2ba-a017-4a4e-97c3-2f854296ed00 None admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:32.458304 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a2ba-a017-4a4e-97c3-2f854296ed00 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:32.458573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a2ba-a017-4a4e-97c3-2f854296ed00 None admin] PATH_INFO: `/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/256e8478e5fb4c01acde0d597bae0b53/roles/9b7a362fef7446e795c33b25a08f20bc` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:32.473718 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539a2ba-a017-4a4e-97c3-2f854296ed00 None admin] RBAC: Authorizing `identity:create_grant(project_id=1180c1ddef2b493f83c41425fd2e7917, user_id=256e8478e5fb4c01acde0d597bae0b53, role_id=9b7a362fef7446e795c33b25a08f20bc)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:32.475156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539a2ba-a017-4a4e-97c3-2f854296ed00 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:32.610434 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 619/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:32:32 2022] PUT /identity/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/256e8478e5fb4c01acde0d597bae0b53/roles/9b7a362fef7446e795c33b25a08f20bc => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:32:34.774700 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efc75b-8901-4b84-b109-6370851a2f2e None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:34.775237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efc75b-8901-4b84-b109-6370851a2f2e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:34.775364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efc75b-8901-4b84-b109-6370851a2f2e None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:34.776716 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 614/1233] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:32:34.782762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8e379-0866-471e-b4b2-a0142e8997c9 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:34.783189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8e379-0866-471e-b4b2-a0142e8997c9 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:34.783359 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8e379-0866-471e-b4b2-a0142e8997c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:34.801680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-7bc8e379-0866-471e-b4b2-a0142e8997c9 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:32:34.802863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7bc8e379-0866-471e-b4b2-a0142e8997c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:32:34.870812 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 620/1234] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:32:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:32:35.143744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efc75b-8901-4b84-b109-6370851a2f2e None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:35.169122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:35.246449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efc75b-8901-4b84-b109-6370851a2f2e None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:35.283644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd077a44-c691-4e33-8269-e39f66cc765a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:35.284265 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd077a44-c691-4e33-8269-e39f66cc765a None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:35.284540 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd077a44-c691-4e33-8269-e39f66cc765a None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:35.284806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd077a44-c691-4e33-8269-e39f66cc765a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:35.295141 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd077a44-c691-4e33-8269-e39f66cc765a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:32:35.301110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-fd077a44-c691-4e33-8269-e39f66cc765a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:32:35.301110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:35.301110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:35.301110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:35.301110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:35.301110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:35.301110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:35.301110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:35.301110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:35.301110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:35.301110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:35.301110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:35.301110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:32:35.301110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:32:35.301110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:32:35.301110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:32:35.302166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:32:35.302166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:32:35.302166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:32:35.302166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:32:35.302166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:35.302166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:35.302166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:35.302166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:35.302166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:35.302166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:35.302166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:35.302166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:35.302166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:35.302166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:35.302166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:35.302166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:35.303152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:35.303152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:35.303152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:35.303152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:35.303152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:32:35.303152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:32:35.303152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:32:35.303152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:32:35.303152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:32:35.303152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:32:35.303152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:32:35.303152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:32:35.303152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 615/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Sep 7 16:32:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:35.328441 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8e379-0866-471e-b4b2-a0142e8997c9 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:35.355883 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:35.408437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8e379-0866-471e-b4b2-a0142e8997c9 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:35.442349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e2cd6-07ee-4cd1-a3b6-10f918d36740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:35.442944 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e2cd6-07ee-4cd1-a3b6-10f918d36740 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:35.448137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e2cd6-07ee-4cd1-a3b6-10f918d36740 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:35.448137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e2cd6-07ee-4cd1-a3b6-10f918d36740 None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:35.448137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e2cd6-07ee-4cd1-a3b6-10f918d36740 None admin] RBAC: Adding query filter params (name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:35.448137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e2cd6-07ee-4cd1-a3b6-10f918d36740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:35.448137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e2cd6-07ee-4cd1-a3b6-10f918d36740 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:35.454251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 621/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Sep 7 16:32:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:35.460348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd077a44-c691-4e33-8269-e39f66cc765a None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:35.545821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:35.560970 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd077a44-c691-4e33-8269-e39f66cc765a None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:35.595935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272c275-4bb5-4460-8ba6-b9966f737c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:35.596558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272c275-4bb5-4460-8ba6-b9966f737c8c None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:35.596830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272c275-4bb5-4460-8ba6-b9966f737c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:35.597094 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272c275-4bb5-4460-8ba6-b9966f737c8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:35.607536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272c275-4bb5-4460-8ba6-b9966f737c8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:35.609125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272c275-4bb5-4460-8ba6-b9966f737c8c None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:35.622885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-4272c275-4bb5-4460-8ba6-b9966f737c8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:35.622885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:35.622885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:35.622885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:35.622885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:35.622885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:35.622885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:35.622885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:35.622885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:35.622885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:35.622885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:35.622885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:35.622885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:32:35.622885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:32:35.622885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:32:35.622885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:32:35.625896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:35.625896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:35.625896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:35.625896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:35.625896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:35.625896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:35.625896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:35.625896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:35.625896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:35.625896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:35.625896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:35.625896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:35.625896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:35.625896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:35.625896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:35.625896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:35.625896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:32:35.627655 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:32:35.627655 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:35.627655 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:32:35.627655 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 616/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:35.630902 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e2cd6-07ee-4cd1-a3b6-10f918d36740 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:35.733173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e2cd6-07ee-4cd1-a3b6-10f918d36740 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:35.742132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:35.768749 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1668f83-19cb-48af-beca-ccd82b2f8a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:35.769354 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1668f83-19cb-48af-beca-ccd82b2f8a9a None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:35.769632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1668f83-19cb-48af-beca-ccd82b2f8a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:35.769904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1668f83-19cb-48af-beca-ccd82b2f8a9a None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:35.770562 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1668f83-19cb-48af-beca-ccd82b2f8a9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:35.770863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1668f83-19cb-48af-beca-ccd82b2f8a9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:35.772323 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1668f83-19cb-48af-beca-ccd82b2f8a9a None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:35.784474 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 622/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:35.791420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272c275-4bb5-4460-8ba6-b9966f737c8c None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:35.899398 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272c275-4bb5-4460-8ba6-b9966f737c8c None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:35.934067 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c0798-80da-42b8-b3fe-09e057455771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:35.934689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c0798-80da-42b8-b3fe-09e057455771 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:35.934966 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c0798-80da-42b8-b3fe-09e057455771 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:35.935230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c0798-80da-42b8-b3fe-09e057455771 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:35.938533 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:35.943737 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c0798-80da-42b8-b3fe-09e057455771 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:35.945165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c0798-80da-42b8-b3fe-09e057455771 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:35.956420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-a50c0798-80da-42b8-b3fe-09e057455771 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:32:35.956420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:35.956420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:35.956420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:35.956420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:35.956420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:35.956420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:35.956420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:35.956420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:35.956420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:35.956420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:35.956420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:35.956420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:32:35.956420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:32:35.956420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:32:35.956420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:35.957616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:35.958809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:35.958809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:35.958809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:32:35.958809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:32:35.958809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:32:35.958809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:32:35.958809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:32:35.958809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:32:35.958809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:32:35.958809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:32:35.958809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 617/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:35.964228 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1668f83-19cb-48af-beca-ccd82b2f8a9a None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:36.068696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1668f83-19cb-48af-beca-ccd82b2f8a9a None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:36.104787 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03e73c-a4af-44f8-a78a-0fa3a139f58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:36.105406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03e73c-a4af-44f8-a78a-0fa3a139f58c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:36.105709 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03e73c-a4af-44f8-a78a-0fa3a139f58c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:36.105990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03e73c-a4af-44f8-a78a-0fa3a139f58c None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:36.106705 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03e73c-a4af-44f8-a78a-0fa3a139f58c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:36.107016 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03e73c-a4af-44f8-a78a-0fa3a139f58c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:36.109056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03e73c-a4af-44f8-a78a-0fa3a139f58c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:36.128055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 623/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Sep 7 16:32:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:36.134331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c0798-80da-42b8-b3fe-09e057455771 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:36.238065 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c0798-80da-42b8-b3fe-09e057455771 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:36.272324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebff93-5e74-4bb0-a3a1-125fba5574a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:36.272929 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebff93-5e74-4bb0-a3a1-125fba5574a3 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:36.273209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebff93-5e74-4bb0-a3a1-125fba5574a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:36.273480 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebff93-5e74-4bb0-a3a1-125fba5574a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:36.336028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:36.342701 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebff93-5e74-4bb0-a3a1-125fba5574a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:36.344881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebff93-5e74-4bb0-a3a1-125fba5574a3 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:36.450466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 618/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:32:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:32:36.456572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03e73c-a4af-44f8-a78a-0fa3a139f58c None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:36.486155 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:36.560116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03e73c-a4af-44f8-a78a-0fa3a139f58c None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:36.597381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd695ee-8c13-4f05-a367-2e9b7b0f42f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:36.597933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd695ee-8c13-4f05-a367-2e9b7b0f42f8 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:36.598210 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd695ee-8c13-4f05-a367-2e9b7b0f42f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:36.598482 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd695ee-8c13-4f05-a367-2e9b7b0f42f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:36.610052 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd695ee-8c13-4f05-a367-2e9b7b0f42f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:36.611586 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd695ee-8c13-4f05-a367-2e9b7b0f42f8 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:36.632124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-6dd695ee-8c13-4f05-a367-2e9b7b0f42f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:36.632124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:36.632124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:36.632124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:36.632124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:36.632124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:36.632124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:36.632124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:36.632124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:36.632124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:36.632124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:36.632124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:36.632124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:32:36.632124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:32:36.632124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:32:36.632124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:32:36.633808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:36.633808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:36.633808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:36.633808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:36.633808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:36.633808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:36.633808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:36.633808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:36.633808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:36.633808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:36.633808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:36.633808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:36.633808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:36.633808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:36.633808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:36.633808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:36.633808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:32:36.635742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:32:36.635742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:36.635742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:36.635742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 624/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:36.639257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebff93-5e74-4bb0-a3a1-125fba5574a3 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:36.743452 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:36.749601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebff93-5e74-4bb0-a3a1-125fba5574a3 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:36.788159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5ba93-65d2-47ed-a591-83602901b023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:36.788765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5ba93-65d2-47ed-a591-83602901b023 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:36.789064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5ba93-65d2-47ed-a591-83602901b023 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:36.789332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5ba93-65d2-47ed-a591-83602901b023 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:36.789969 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5ba93-65d2-47ed-a591-83602901b023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:36.790267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5ba93-65d2-47ed-a591-83602901b023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:36.791658 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5ba93-65d2-47ed-a591-83602901b023 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:36.803509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 619/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:36.809539 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd695ee-8c13-4f05-a367-2e9b7b0f42f8 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:36.897080 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:36.923022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd695ee-8c13-4f05-a367-2e9b7b0f42f8 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:36.959905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9339d-2a10-4422-8f00-092b04fc1b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:36.960556 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9339d-2a10-4422-8f00-092b04fc1b33 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:36.961110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9339d-2a10-4422-8f00-092b04fc1b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:36.961560 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9339d-2a10-4422-8f00-092b04fc1b33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:36.970235 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9339d-2a10-4422-8f00-092b04fc1b33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:36.973838 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9339d-2a10-4422-8f00-092b04fc1b33 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:36.983174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-a1d9339d-2a10-4422-8f00-092b04fc1b33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:32:36.983174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:36.983174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:36.983174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:36.983174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:36.983174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:36.983174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:36.983174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:36.983174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:36.983174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:36.983174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:36.983174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:36.983174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:32:36.983174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:32:36.983174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:32:36.984422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:32:36.984422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:36.984422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:36.984422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:36.984422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:36.984422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:36.984422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:36.984422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:36.984422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:36.984422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:36.984422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:36.984422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:36.984422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:36.984422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:36.984422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:36.984422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:36.984422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:36.985599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:32:36.985599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:32:36.985599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:32:36.985599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:32:36.985599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:32:36.985599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:32:36.985599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:32:36.985599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:36.987644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 625/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:32:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:36.990584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5ba93-65d2-47ed-a591-83602901b023 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:37.104852 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5ba93-65d2-47ed-a591-83602901b023 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:37.142614 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d91cd-56e4-42e4-bc81-bc64083eb828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:37.143267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d91cd-56e4-42e4-bc81-bc64083eb828 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:37.143572 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d91cd-56e4-42e4-bc81-bc64083eb828 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:37.148657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d91cd-56e4-42e4-bc81-bc64083eb828 None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:37.148657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d91cd-56e4-42e4-bc81-bc64083eb828 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:37.148657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d91cd-56e4-42e4-bc81-bc64083eb828 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:37.148657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d91cd-56e4-42e4-bc81-bc64083eb828 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:37.160640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 620/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:32:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:37.167382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9339d-2a10-4422-8f00-092b04fc1b33 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:37.272590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9339d-2a10-4422-8f00-092b04fc1b33 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:37.307469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be210e98-2cf9-4a85-875b-4e101e7580ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:37.308100 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be210e98-2cf9-4a85-875b-4e101e7580ba None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:37.308377 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be210e98-2cf9-4a85-875b-4e101e7580ba None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:37.308647 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be210e98-2cf9-4a85-875b-4e101e7580ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:37.309441 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be210e98-2cf9-4a85-875b-4e101e7580ba None admin] RBAC: Adding query filter params (role.id=9b7a362fef7446e795c33b25a08f20bc, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=256e8478e5fb4c01acde0d597bae0b53) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:37.309744 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be210e98-2cf9-4a85-875b-4e101e7580ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:37.311189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be210e98-2cf9-4a85-875b-4e101e7580ba None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:37.317704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 626/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:32:37 2022] GET /identity/v3/role_assignments?user.id=256e8478e5fb4c01acde0d597bae0b53&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=9b7a362fef7446e795c33b25a08f20bc => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:39.583316 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ceab0-c3e6-45b5-a2ae-6f1be80a8158 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:39.583907 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ceab0-c3e6-45b5-a2ae-6f1be80a8158 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:39.583907 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ceab0-c3e6-45b5-a2ae-6f1be80a8158 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:39.585189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 621/1247] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:32:39.590672 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9371d-e90b-41cb-8199-54fd60eeadcb None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:39.591133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9371d-e90b-41cb-8199-54fd60eeadcb None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:39.591414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9371d-e90b-41cb-8199-54fd60eeadcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:39.598073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:39.610572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f1c9371d-e90b-41cb-8199-54fd60eeadcb None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:32:39.640995 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f1c9371d-e90b-41cb-8199-54fd60eeadcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:32:39.678469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 627/1248] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:32:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:32:39.951018 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ceab0-c3e6-45b5-a2ae-6f1be80a8158 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:39.969329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:40.050647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ceab0-c3e6-45b5-a2ae-6f1be80a8158 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:40.084547 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef538ed2-6e09-420f-97d9-9354b1fdac4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:40.085162 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef538ed2-6e09-420f-97d9-9354b1fdac4d None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:40.085436 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef538ed2-6e09-420f-97d9-9354b1fdac4d None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:40.085700 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef538ed2-6e09-420f-97d9-9354b1fdac4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:40.096607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef538ed2-6e09-420f-97d9-9354b1fdac4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:32:40.101416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-ef538ed2-6e09-420f-97d9-9354b1fdac4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:32:40.101416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:40.101416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:40.101416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:40.101416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:40.101416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:40.101416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:40.101416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:40.101416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:40.101416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:40.101416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:40.101416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:40.101416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:32:40.101416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:32:40.101416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:32:40.101416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:32:40.104022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:32:40.104022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:32:40.104022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:32:40.104022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:32:40.104022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:40.104022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:40.104022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:40.104022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:40.104022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:40.104022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:40.104022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:40.104022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:40.104022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:40.104022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:40.104022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:40.104022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:40.105078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:40.105078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:40.105078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:40.105078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:40.105078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:32:40.105078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:32:40.105078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:32:40.105078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:32:40.105078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:32:40.105078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:32:40.105078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:32:40.105078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:32:40.105078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 622/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:32:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:40.109293 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9371d-e90b-41cb-8199-54fd60eeadcb None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:40.208699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9371d-e90b-41cb-8199-54fd60eeadcb None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:40.239008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:40.243964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dd7d0-5270-4263-a215-96c6db06fc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:40.244572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dd7d0-5270-4263-a215-96c6db06fc9e None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:40.244848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dd7d0-5270-4263-a215-96c6db06fc9e None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:40.245118 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dd7d0-5270-4263-a215-96c6db06fc9e None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:40.245775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dd7d0-5270-4263-a215-96c6db06fc9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:40.246070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dd7d0-5270-4263-a215-96c6db06fc9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:40.247422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dd7d0-5270-4263-a215-96c6db06fc9e None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:40.255620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 628/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:32:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:40.261717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef538ed2-6e09-420f-97d9-9354b1fdac4d None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:40.341916 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:40.367238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef538ed2-6e09-420f-97d9-9354b1fdac4d None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:40.402216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e186ef-45de-4acd-994f-af87b75f40fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:40.402844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e186ef-45de-4acd-994f-af87b75f40fc None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:40.403119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e186ef-45de-4acd-994f-af87b75f40fc None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:40.403387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e186ef-45de-4acd-994f-af87b75f40fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:40.414806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e186ef-45de-4acd-994f-af87b75f40fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:40.416287 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e186ef-45de-4acd-994f-af87b75f40fc None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:40.431376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-c8e186ef-45de-4acd-994f-af87b75f40fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:40.431376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:40.431376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:40.431376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:40.431376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:40.431376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:40.431376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:40.431376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:40.431376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:40.431376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:40.431376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:40.431376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:40.431376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:32:40.431376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:32:40.431376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:32:40.431376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:32:40.432615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:40.432615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:40.432615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:40.432615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:40.432615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:40.432615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:40.432615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:40.432615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:40.432615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:40.432615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:40.432615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:40.432615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:40.432615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:40.432615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:40.432615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:40.432615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:40.432615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:32:40.433576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:32:40.433576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:40.433576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:32:40.433576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 623/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:40.439065 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dd7d0-5270-4263-a215-96c6db06fc9e None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:40.542077 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dd7d0-5270-4263-a215-96c6db06fc9e None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:40.579690 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aed210-6838-4b53-862a-f8eb331876d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:40.580300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aed210-6838-4b53-862a-f8eb331876d7 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:40.580579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aed210-6838-4b53-862a-f8eb331876d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:40.580855 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aed210-6838-4b53-862a-f8eb331876d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:40.581492 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aed210-6838-4b53-862a-f8eb331876d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:40.581795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aed210-6838-4b53-862a-f8eb331876d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:40.583209 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aed210-6838-4b53-862a-f8eb331876d7 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:40.596650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 629/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:40.602536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e186ef-45de-4acd-994f-af87b75f40fc None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:40.711143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e186ef-45de-4acd-994f-af87b75f40fc None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:40.739490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:40.747224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff0685-1da6-4561-9c20-b01d0cc70bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:40.747912 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff0685-1da6-4561-9c20-b01d0cc70bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:40.748191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff0685-1da6-4561-9c20-b01d0cc70bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:40.748467 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff0685-1da6-4561-9c20-b01d0cc70bc8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:40.757233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff0685-1da6-4561-9c20-b01d0cc70bc8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:40.758675 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff0685-1da6-4561-9c20-b01d0cc70bc8 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:40.770856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-97ff0685-1da6-4561-9c20-b01d0cc70bc8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:32:40.770856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:40.770856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:40.770856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:40.770856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:40.770856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:40.770856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:40.770856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:40.770856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:40.770856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:40.770856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:40.770856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:40.770856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:32:40.770856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:32:40.770856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:32:40.770856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:40.772213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:40.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:40.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:40.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:32:40.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:32:40.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:32:40.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:32:40.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:32:40.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:32:40.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:32:40.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:32:40.773443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 624/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:40.777853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aed210-6838-4b53-862a-f8eb331876d7 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:40.838838 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:40.888758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aed210-6838-4b53-862a-f8eb331876d7 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:40.925932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8dabf-b8ee-4758-873d-4fc8444b3aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:40.926538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8dabf-b8ee-4758-873d-4fc8444b3aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:40.926812 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8dabf-b8ee-4758-873d-4fc8444b3aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:40.927083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8dabf-b8ee-4758-873d-4fc8444b3aa7 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:40.927828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8dabf-b8ee-4758-873d-4fc8444b3aa7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:40.928132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8dabf-b8ee-4758-873d-4fc8444b3aa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:40.929556 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8dabf-b8ee-4758-873d-4fc8444b3aa7 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:40.947264 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 630/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Sep 7 16:32:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:40.954801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff0685-1da6-4561-9c20-b01d0cc70bc8 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:41.059609 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff0685-1da6-4561-9c20-b01d0cc70bc8 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:41.093401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f3d09-da71-4316-b335-9f0e6c266adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:41.093928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f3d09-da71-4316-b335-9f0e6c266adb None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:41.094206 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f3d09-da71-4316-b335-9f0e6c266adb None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:41.094475 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f3d09-da71-4316-b335-9f0e6c266adb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:41.150902 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:41.163216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f3d09-da71-4316-b335-9f0e6c266adb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:41.164707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f3d09-da71-4316-b335-9f0e6c266adb None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:41.270445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 625/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:32:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:32:41.276515 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8dabf-b8ee-4758-873d-4fc8444b3aa7 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:41.388781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8dabf-b8ee-4758-873d-4fc8444b3aa7 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:41.402421 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:41.424552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172678fb-c79b-407f-9c99-3ea713877afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:41.425222 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172678fb-c79b-407f-9c99-3ea713877afe None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:41.425501 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172678fb-c79b-407f-9c99-3ea713877afe None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:41.425772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172678fb-c79b-407f-9c99-3ea713877afe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:41.436518 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172678fb-c79b-407f-9c99-3ea713877afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:41.438595 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172678fb-c79b-407f-9c99-3ea713877afe None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:41.453563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-172678fb-c79b-407f-9c99-3ea713877afe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:41.453563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:41.453563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:41.453563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:41.453563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:41.453563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:41.453563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:41.453563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:41.453563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:41.453563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:41.453563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:41.453563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:41.453563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:32:41.453563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:32:41.453563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:32:41.453563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:32:41.454658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:41.454658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:41.454658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:41.454658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:41.454658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:41.454658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:41.454658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:41.454658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:41.454658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:41.454658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:41.454658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:41.454658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:41.454658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:41.454658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:41.454658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:41.454658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:41.454658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:32:41.455652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:32:41.455652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:41.455652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:41.455652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 631/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:41.460835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f3d09-da71-4316-b335-9f0e6c266adb None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:41.553325 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:41.566190 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f3d09-da71-4316-b335-9f0e6c266adb None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:41.604617 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e08220-377c-4d65-843a-c50b44ec601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:41.605333 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e08220-377c-4d65-843a-c50b44ec601d None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:41.605517 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e08220-377c-4d65-843a-c50b44ec601d None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:41.605781 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e08220-377c-4d65-843a-c50b44ec601d None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:41.606423 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e08220-377c-4d65-843a-c50b44ec601d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:41.606729 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e08220-377c-4d65-843a-c50b44ec601d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:41.608187 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e08220-377c-4d65-843a-c50b44ec601d None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:41.621804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 626/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:41.628045 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172678fb-c79b-407f-9c99-3ea713877afe None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:41.734486 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172678fb-c79b-407f-9c99-3ea713877afe None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:41.768566 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d795038-42a6-42d0-852f-496797563bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:41.769196 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d795038-42a6-42d0-852f-496797563bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:41.769472 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d795038-42a6-42d0-852f-496797563bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:41.769741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d795038-42a6-42d0-852f-496797563bb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:41.776673 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d795038-42a6-42d0-852f-496797563bb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:41.778133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d795038-42a6-42d0-852f-496797563bb3 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:41.790917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-0d795038-42a6-42d0-852f-496797563bb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:32:41.790917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:41.790917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:41.790917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:41.790917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:41.790917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:41.790917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:41.790917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:41.790917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:41.790917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:41.790917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:41.790917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:41.790917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:32:41.790917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:32:41.790917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:32:41.795852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:32:41.795852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:41.795852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:41.795852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:41.795852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:41.795852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:41.795852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:41.795852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:41.795852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:41.795852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:41.795852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:41.795852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:41.795852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:41.795852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:41.795852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:41.795852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:41.795852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:41.797628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:32:41.797628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:32:41.797628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:32:41.797628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:32:41.797628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:32:41.797628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:32:41.797628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:32:41.797628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:41.797628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 632/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:32:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:41.802086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e08220-377c-4d65-843a-c50b44ec601d None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:41.909702 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e08220-377c-4d65-843a-c50b44ec601d None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:41.947241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ed96e-7a24-476a-b2ed-6f14f8bd0076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:41.947878 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ed96e-7a24-476a-b2ed-6f14f8bd0076 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:41.948158 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ed96e-7a24-476a-b2ed-6f14f8bd0076 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:41.948427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ed96e-7a24-476a-b2ed-6f14f8bd0076 None admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:41.949173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ed96e-7a24-476a-b2ed-6f14f8bd0076 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:41.949479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ed96e-7a24-476a-b2ed-6f14f8bd0076 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:41.950905 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ed96e-7a24-476a-b2ed-6f14f8bd0076 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:41.966261 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 627/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:32:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:41.973564 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d795038-42a6-42d0-852f-496797563bb3 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:42.001953 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:42.079136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d795038-42a6-42d0-852f-496797563bb3 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:42.117925 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76f6f1-4460-40d3-b2df-e00de4df5107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:42.118517 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76f6f1-4460-40d3-b2df-e00de4df5107 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:42.118789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76f6f1-4460-40d3-b2df-e00de4df5107 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:42.119055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76f6f1-4460-40d3-b2df-e00de4df5107 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:42.119799 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76f6f1-4460-40d3-b2df-e00de4df5107 None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=256e8478e5fb4c01acde0d597bae0b53) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:42.120093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76f6f1-4460-40d3-b2df-e00de4df5107 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:42.121541 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76f6f1-4460-40d3-b2df-e00de4df5107 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:42.127277 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 633/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:32:41 2022] GET /identity/v3/role_assignments?user.id=256e8478e5fb4c01acde0d597bae0b53&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:44.372992 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df6855-8dc6-4653-a33f-9c068ddfee56 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:44.373584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df6855-8dc6-4653-a33f-9c068ddfee56 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:44.373584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df6855-8dc6-4653-a33f-9c068ddfee56 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:44.375078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 628/1261] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:32:44.380432 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efc732-52c7-407c-add0-4ea14f29718e None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:44.380905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efc732-52c7-407c-add0-4ea14f29718e None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:44.381033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efc732-52c7-407c-add0-4ea14f29718e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:44.399703 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-57efc732-52c7-407c-add0-4ea14f29718e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:32:44.400910 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-57efc732-52c7-407c-add0-4ea14f29718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:32:44.471086 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 634/1262] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:32:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:32:44.754573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df6855-8dc6-4653-a33f-9c068ddfee56 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:44.766399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:44.858196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df6855-8dc6-4653-a33f-9c068ddfee56 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:44.894994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7238747-e375-4c66-ac07-2ab2ad0cf4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:44.895662 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7238747-e375-4c66-ac07-2ab2ad0cf4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:44.895944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7238747-e375-4c66-ac07-2ab2ad0cf4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:44.896273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7238747-e375-4c66-ac07-2ab2ad0cf4c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:44.907769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7238747-e375-4c66-ac07-2ab2ad0cf4c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:32:44.912490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-c7238747-e375-4c66-ac07-2ab2ad0cf4c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:32:44.912490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:44.912490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:44.912490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:44.912490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:44.912490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:44.912490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:44.912490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:44.912490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:44.912490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:44.912490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:44.912490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:44.912490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:32:44.912490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:32:44.912490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:32:44.912490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:32:44.913628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:32:44.913628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:32:44.913628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:32:44.913628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:32:44.913628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:44.913628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:44.913628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:44.913628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:44.913628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:44.913628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:44.913628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:44.913628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:44.913628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:44.913628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:44.913628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:44.913628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:44.914927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:44.914927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:44.914927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:44.914927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:44.914927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:32:44.914927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:32:44.914927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:32:44.914927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:32:44.914927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:32:44.914927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:32:44.914927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:32:44.914927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:32:44.914927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 629/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:32:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:44.919881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efc732-52c7-407c-add0-4ea14f29718e None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:44.940648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:45.025209 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efc732-52c7-407c-add0-4ea14f29718e None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:45.060329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90ade6-033f-4df9-a6df-ec370a00610b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:45.060929 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90ade6-033f-4df9-a6df-ec370a00610b None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:45.061208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90ade6-033f-4df9-a6df-ec370a00610b None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:45.061479 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90ade6-033f-4df9-a6df-ec370a00610b None admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:45.062380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90ade6-033f-4df9-a6df-ec370a00610b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:45.062703 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90ade6-033f-4df9-a6df-ec370a00610b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:45.064091 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90ade6-033f-4df9-a6df-ec370a00610b None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:45.072353 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 635/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:32:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:45.078767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7238747-e375-4c66-ac07-2ab2ad0cf4c6 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:45.148039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:45.184972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7238747-e375-4c66-ac07-2ab2ad0cf4c6 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:45.221928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89083a2d-ef39-411a-8dce-3ee9aa0dff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:45.222562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89083a2d-ef39-411a-8dce-3ee9aa0dff7c None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:45.222835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89083a2d-ef39-411a-8dce-3ee9aa0dff7c None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:45.223102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89083a2d-ef39-411a-8dce-3ee9aa0dff7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:45.234746 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89083a2d-ef39-411a-8dce-3ee9aa0dff7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:45.236238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89083a2d-ef39-411a-8dce-3ee9aa0dff7c None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:45.251681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-89083a2d-ef39-411a-8dce-3ee9aa0dff7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:45.251681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:45.251681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:45.251681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:45.251681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:45.251681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:45.251681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:45.251681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:45.251681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:45.251681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:45.251681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:45.251681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:45.251681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:32:45.251681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:32:45.251681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:32:45.251681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:32:45.252842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:45.252842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:45.252842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:45.252842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:45.252842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:45.252842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:45.252842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:45.252842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:45.252842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:45.252842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:45.252842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:45.252842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:45.252842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:45.252842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:45.252842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:45.252842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:45.252842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:32:45.253915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:32:45.253915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:45.253915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:32:45.253915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 630/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:45.258901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90ade6-033f-4df9-a6df-ec370a00610b None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:45.340749 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:45.360552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90ade6-033f-4df9-a6df-ec370a00610b None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:45.394303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258de870-9778-444d-a52a-a7b10c8f59b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:45.395230 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258de870-9778-444d-a52a-a7b10c8f59b3 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:45.395230 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258de870-9778-444d-a52a-a7b10c8f59b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:45.395417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258de870-9778-444d-a52a-a7b10c8f59b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:45.396068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258de870-9778-444d-a52a-a7b10c8f59b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:45.396369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258de870-9778-444d-a52a-a7b10c8f59b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:45.397728 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258de870-9778-444d-a52a-a7b10c8f59b3 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:45.409625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 636/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:45.415404 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89083a2d-ef39-411a-8dce-3ee9aa0dff7c None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:45.518954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89083a2d-ef39-411a-8dce-3ee9aa0dff7c None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:45.541074 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:45.555070 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd994631-4179-459f-b7e6-2a9ec0ad086d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:45.555728 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd994631-4179-459f-b7e6-2a9ec0ad086d None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:45.556005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd994631-4179-459f-b7e6-2a9ec0ad086d None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:45.556269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd994631-4179-459f-b7e6-2a9ec0ad086d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:45.564215 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd994631-4179-459f-b7e6-2a9ec0ad086d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:45.565646 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd994631-4179-459f-b7e6-2a9ec0ad086d None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:45.576965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-bd994631-4179-459f-b7e6-2a9ec0ad086d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:32:45.576965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:45.576965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:45.576965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:45.576965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:45.576965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:45.576965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:45.576965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:45.576965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:45.576965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:45.576965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:45.576965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:45.576965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:32:45.576965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:32:45.576965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:32:45.576965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:45.579255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:45.580618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:45.580618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:45.580618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:32:45.580618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:32:45.580618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:32:45.580618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:32:45.580618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:32:45.580618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:32:45.580618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:32:45.580618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:32:45.580618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 631/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:45.584841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258de870-9778-444d-a52a-a7b10c8f59b3 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:45.698398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258de870-9778-444d-a52a-a7b10c8f59b3 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:45.740304 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bf7c2-5f34-4d45-9a62-ad933f6207e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:45.740911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bf7c2-5f34-4d45-9a62-ad933f6207e5 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:45.741188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bf7c2-5f34-4d45-9a62-ad933f6207e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:45.741462 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bf7c2-5f34-4d45-9a62-ad933f6207e5 None admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:45.742183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bf7c2-5f34-4d45-9a62-ad933f6207e5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:45.742490 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bf7c2-5f34-4d45-9a62-ad933f6207e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:45.744059 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bf7c2-5f34-4d45-9a62-ad933f6207e5 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:45.754242 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:45.763149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 637/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Sep 7 16:32:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:45.769547 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd994631-4179-459f-b7e6-2a9ec0ad086d None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:45.873681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd994631-4179-459f-b7e6-2a9ec0ad086d None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:45.910456 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfbc85-7ac1-40a7-92a5-540d93b0cc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:45.911084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfbc85-7ac1-40a7-92a5-540d93b0cc1e None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:45.911362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfbc85-7ac1-40a7-92a5-540d93b0cc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:45.911659 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfbc85-7ac1-40a7-92a5-540d93b0cc1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:45.924393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfbc85-7ac1-40a7-92a5-540d93b0cc1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:45.925871 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfbc85-7ac1-40a7-92a5-540d93b0cc1e None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:45.941527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-12cfbc85-7ac1-40a7-92a5-540d93b0cc1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:45.941527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:45.941527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:45.941527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:45.941527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:45.941527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:45.941527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:45.941527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:45.941527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:45.941527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:45.941527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:45.941527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:45.941527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:32:45.941527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:32:45.941527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:32:45.941527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:32:45.942801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:45.942801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:45.942801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:45.942801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:45.942801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:45.942801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:45.942801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:45.942801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:45.942801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:45.942801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:45.942801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:45.942801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:45.942801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:45.942801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:45.942801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:45.942801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:45.942801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:32:45.944028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:32:45.944028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:45.944028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:32:45.944028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 632/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:45.948529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bf7c2-5f34-4d45-9a62-ad933f6207e5 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:46.056766 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bf7c2-5f34-4d45-9a62-ad933f6207e5 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:46.101529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c019b-b787-4f52-b6dd-1f7d6a0387be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:46.102266 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c019b-b787-4f52-b6dd-1f7d6a0387be None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:46.102546 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c019b-b787-4f52-b6dd-1f7d6a0387be None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:46.102838 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c019b-b787-4f52-b6dd-1f7d6a0387be None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:46.103573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c019b-b787-4f52-b6dd-1f7d6a0387be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:46.103878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c019b-b787-4f52-b6dd-1f7d6a0387be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:46.105242 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c019b-b787-4f52-b6dd-1f7d6a0387be None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:46.117725 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 638/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:46.123823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfbc85-7ac1-40a7-92a5-540d93b0cc1e None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:46.158789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:46.232892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfbc85-7ac1-40a7-92a5-540d93b0cc1e None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:46.269490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1c650-576c-40a5-bf4a-53de00ec8e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:46.270130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c650-576c-40a5-bf4a-53de00ec8e8e None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:46.270411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c650-576c-40a5-bf4a-53de00ec8e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:46.270684 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c650-576c-40a5-bf4a-53de00ec8e8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:46.277798 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1c650-576c-40a5-bf4a-53de00ec8e8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:46.279296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1c650-576c-40a5-bf4a-53de00ec8e8e None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:46.292731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-2cd1c650-576c-40a5-bf4a-53de00ec8e8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:32:46.292731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:46.292731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:46.292731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:46.292731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:46.292731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:46.292731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:46.292731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:46.292731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:46.292731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:46.292731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:46.292731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:46.292731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:32:46.292731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:32:46.292731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:32:46.293875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:32:46.293875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:46.293875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:46.293875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:46.293875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:46.293875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:46.293875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:46.293875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:46.293875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:46.293875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:46.293875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:46.293875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:46.293875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:46.293875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:46.293875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:46.293875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:46.293875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:46.294977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:32:46.294977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:32:46.294977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:32:46.294977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:32:46.294977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:32:46.294977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:32:46.294977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:32:46.294977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:32:46.294977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 633/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:32:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:46.301126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c019b-b787-4f52-b6dd-1f7d6a0387be None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:46.364586 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:46.408113 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c019b-b787-4f52-b6dd-1f7d6a0387be None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:46.442491 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866891a0-067b-4ec6-8382-091156d0e45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:46.443098 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866891a0-067b-4ec6-8382-091156d0e45c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:46.443369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866891a0-067b-4ec6-8382-091156d0e45c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:46.443666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866891a0-067b-4ec6-8382-091156d0e45c None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:46.444346 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866891a0-067b-4ec6-8382-091156d0e45c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:46.444673 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866891a0-067b-4ec6-8382-091156d0e45c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:46.446076 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866891a0-067b-4ec6-8382-091156d0e45c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:46.459375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 639/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:32:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:46.468839 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1c650-576c-40a5-bf4a-53de00ec8e8e None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:46.565796 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:46.574491 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1c650-576c-40a5-bf4a-53de00ec8e8e None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:46.609783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8d75f-00db-4cde-98fa-a3636f02aeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:46.610459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8d75f-00db-4cde-98fa-a3636f02aeb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:46.610738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8d75f-00db-4cde-98fa-a3636f02aeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:46.611011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8d75f-00db-4cde-98fa-a3636f02aeb2 None admin] PATH_INFO: `/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/256e8478e5fb4c01acde0d597bae0b53/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:46.612977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8d75f-00db-4cde-98fa-a3636f02aeb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1180c1ddef2b493f83c41425fd2e7917, user_id=256e8478e5fb4c01acde0d597bae0b53, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:46.614418 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8d75f-00db-4cde-98fa-a3636f02aeb2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:46.723125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 634/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Sep 7 16:32:46 2022] PUT /identity/v3/projects/1180c1ddef2b493f83c41425fd2e7917/users/256e8478e5fb4c01acde0d597bae0b53/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:32:49.001519 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d9b88-54f1-4ed8-a42c-431b7a8979ad None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:49.002063 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d9b88-54f1-4ed8-a42c-431b7a8979ad None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:49.002063 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d9b88-54f1-4ed8-a42c-431b7a8979ad None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:49.003387 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 640/1274] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:32:49.009541 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858880c9-27a3-4c08-8ab3-e4b4bf91b0d6 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:49.010024 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858880c9-27a3-4c08-8ab3-e4b4bf91b0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:49.010119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858880c9-27a3-4c08-8ab3-e4b4bf91b0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:49.032106 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-858880c9-27a3-4c08-8ab3-e4b4bf91b0d6 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:32:49.033311 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-858880c9-27a3-4c08-8ab3-e4b4bf91b0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:32:49.134928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 635/1275] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:32:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:32:49.458620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d9b88-54f1-4ed8-a42c-431b7a8979ad None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:49.582440 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d9b88-54f1-4ed8-a42c-431b7a8979ad None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:49.602195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:49.628806 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa7ee1-02d5-4cfc-a239-2b13d665b914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:49.629433 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa7ee1-02d5-4cfc-a239-2b13d665b914 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:49.629708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa7ee1-02d5-4cfc-a239-2b13d665b914 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:49.629983 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa7ee1-02d5-4cfc-a239-2b13d665b914 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:49.640536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa7ee1-02d5-4cfc-a239-2b13d665b914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:32:49.647013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-98aa7ee1-02d5-4cfc-a239-2b13d665b914 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:32:49.647013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:49.647013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:49.647013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:49.647013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:49.647013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:49.647013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:49.647013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:49.647013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:49.647013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:49.647013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:49.647013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:49.647013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:32:49.647013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:32:49.647013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:32:49.647013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:32:49.648367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:32:49.648367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:32:49.648367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:32:49.648367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:32:49.648367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:49.648367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:49.648367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:49.648367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:49.648367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:49.648367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:49.648367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:49.648367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:49.648367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:49.648367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:49.648367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:49.648367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:49.649516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:49.649516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:49.649516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:49.649516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:49.649516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:32:49.649516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:32:49.649516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:32:49.649516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:32:49.649516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:32:49.649516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:32:49.649516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:32:49.649516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:49.649516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 641/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Sep 7 16:32:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:49.660317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858880c9-27a3-4c08-8ab3-e4b4bf91b0d6 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:49.739402 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:49.758845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858880c9-27a3-4c08-8ab3-e4b4bf91b0d6 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:49.792484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fa807-2237-48ef-a752-791ad90dd290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:49.793109 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa807-2237-48ef-a752-791ad90dd290 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:49.793386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa807-2237-48ef-a752-791ad90dd290 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:49.793656 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa807-2237-48ef-a752-791ad90dd290 None admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:49.794324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fa807-2237-48ef-a752-791ad90dd290 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:49.794667 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fa807-2237-48ef-a752-791ad90dd290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:49.796653 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fa807-2237-48ef-a752-791ad90dd290 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:49.805491 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 636/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Sep 7 16:32:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:49.811382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa7ee1-02d5-4cfc-a239-2b13d665b914 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:49.912923 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa7ee1-02d5-4cfc-a239-2b13d665b914 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:49.949063 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01fc73-471d-49e5-a8ab-8809776640b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:49.949692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01fc73-471d-49e5-a8ab-8809776640b8 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:49.949964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01fc73-471d-49e5-a8ab-8809776640b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:49.950233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01fc73-471d-49e5-a8ab-8809776640b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:49.960603 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01fc73-471d-49e5-a8ab-8809776640b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:49.963537 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01fc73-471d-49e5-a8ab-8809776640b8 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:49.978005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-6b01fc73-471d-49e5-a8ab-8809776640b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:49.978005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:49.978005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:49.978005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:49.978005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:49.978005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:49.978005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:49.978005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:49.978005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:49.978005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:49.978005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:49.978005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:49.978005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:32:49.978005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:32:49.978005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:32:49.978005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:32:49.979409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:49.979409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:49.979409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:49.979409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:49.979409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:49.979409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:49.979409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:49.979409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:49.979409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:49.979409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:49.979409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:49.979409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:49.979409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:49.979409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:49.979409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:49.979409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:49.979409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:32:49.980628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:32:49.980628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:49.980628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:49.980628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 642/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:49.985867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fa807-2237-48ef-a752-791ad90dd290 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:50.094424 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fa807-2237-48ef-a752-791ad90dd290 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:50.136909 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03245c5c-2ae6-4132-a7ca-7e3f3347dea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:50.137525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03245c5c-2ae6-4132-a7ca-7e3f3347dea1 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:50.137939 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03245c5c-2ae6-4132-a7ca-7e3f3347dea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:50.138221 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03245c5c-2ae6-4132-a7ca-7e3f3347dea1 None admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:50.138869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03245c5c-2ae6-4132-a7ca-7e3f3347dea1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:50.139176 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03245c5c-2ae6-4132-a7ca-7e3f3347dea1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:50.141868 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03245c5c-2ae6-4132-a7ca-7e3f3347dea1 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:50.154471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 637/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:50.160525 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01fc73-471d-49e5-a8ab-8809776640b8 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:50.199973 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:50.273712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01fc73-471d-49e5-a8ab-8809776640b8 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:50.309099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc8c24-e62b-4b71-9ea1-a6aac1c59909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:50.309729 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc8c24-e62b-4b71-9ea1-a6aac1c59909 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:50.310010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc8c24-e62b-4b71-9ea1-a6aac1c59909 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:50.310314 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc8c24-e62b-4b71-9ea1-a6aac1c59909 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:50.318444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc8c24-e62b-4b71-9ea1-a6aac1c59909 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:50.319920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc8c24-e62b-4b71-9ea1-a6aac1c59909 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:50.332248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-3dbc8c24-e62b-4b71-9ea1-a6aac1c59909 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:32:50.332248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:50.332248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:50.332248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:50.332248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:50.332248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:50.332248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:50.332248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:50.332248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:50.332248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:50.332248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:50.332248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:50.332248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:32:50.332248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:32:50.332248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:32:50.332248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:50.334083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:50.336047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:50.336047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:50.336047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:32:50.336047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:32:50.336047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:32:50.336047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:32:50.336047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:32:50.336047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:32:50.336047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:32:50.336047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:50.336047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 643/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:50.340127 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03245c5c-2ae6-4132-a7ca-7e3f3347dea1 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:50.344204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:50.445287 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03245c5c-2ae6-4132-a7ca-7e3f3347dea1 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:50.480353 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d109ad-ed45-44f2-af9a-f2b9352ddac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:50.480989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d109ad-ed45-44f2-af9a-f2b9352ddac1 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:50.481264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d109ad-ed45-44f2-af9a-f2b9352ddac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:50.481533 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d109ad-ed45-44f2-af9a-f2b9352ddac1 None admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:50.482255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d109ad-ed45-44f2-af9a-f2b9352ddac1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:50.482557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d109ad-ed45-44f2-af9a-f2b9352ddac1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:50.484763 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d109ad-ed45-44f2-af9a-f2b9352ddac1 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:50.503874 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 638/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Sep 7 16:32:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:50.509850 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc8c24-e62b-4b71-9ea1-a6aac1c59909 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:50.624580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:50.634785 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc8c24-e62b-4b71-9ea1-a6aac1c59909 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:50.672909 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cab36-b845-47b6-88c1-8b476737a41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:50.673520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cab36-b845-47b6-88c1-8b476737a41b None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:50.673797 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cab36-b845-47b6-88c1-8b476737a41b None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:50.674068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cab36-b845-47b6-88c1-8b476737a41b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:50.743598 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cab36-b845-47b6-88c1-8b476737a41b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:50.745070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cab36-b845-47b6-88c1-8b476737a41b None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:50.835175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:50.846843 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 644/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Sep 7 16:32:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:32:50.852779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d109ad-ed45-44f2-af9a-f2b9352ddac1 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:50.916602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:50.956414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d109ad-ed45-44f2-af9a-f2b9352ddac1 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:50.993328 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac3bad-bb19-42e9-bd17-b2d07e055e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:50.994167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac3bad-bb19-42e9-bd17-b2d07e055e25 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:50.994378 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac3bad-bb19-42e9-bd17-b2d07e055e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:50.994647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac3bad-bb19-42e9-bd17-b2d07e055e25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:51.006737 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac3bad-bb19-42e9-bd17-b2d07e055e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:51.008271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac3bad-bb19-42e9-bd17-b2d07e055e25 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:51.025352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-0fac3bad-bb19-42e9-bd17-b2d07e055e25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:51.025352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:51.025352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:51.025352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:51.025352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:51.025352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:51.025352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:51.025352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:51.025352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:51.025352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:51.025352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:51.025352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:51.025352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:32:51.025352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:32:51.025352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:32:51.025352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:32:51.026586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:51.026586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:51.026586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:51.026586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:51.026586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:51.026586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:51.026586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:51.026586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:51.026586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:51.026586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:51.026586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:51.026586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:51.026586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:51.026586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:51.026586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:51.026586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:51.026586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:32:51.027580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:32:51.027580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:32:51.027580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:32:51.027580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 639/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:32:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:51.033208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cab36-b845-47b6-88c1-8b476737a41b None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:51.160895 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cab36-b845-47b6-88c1-8b476737a41b None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:51.197201 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b0b74-c3f7-4bcb-b9bc-10e07cea1128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:51.197808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b0b74-c3f7-4bcb-b9bc-10e07cea1128 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:51.198095 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b0b74-c3f7-4bcb-b9bc-10e07cea1128 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:51.198369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b0b74-c3f7-4bcb-b9bc-10e07cea1128 None admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:51.199004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b0b74-c3f7-4bcb-b9bc-10e07cea1128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:51.199305 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b0b74-c3f7-4bcb-b9bc-10e07cea1128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:51.200767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b0b74-c3f7-4bcb-b9bc-10e07cea1128 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:51.213721 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 645/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Sep 7 16:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:51.220222 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac3bad-bb19-42e9-bd17-b2d07e055e25 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:51.322344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac3bad-bb19-42e9-bd17-b2d07e055e25 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:51.336704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:51.356976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70917dbd-32c5-4952-bfec-f218b80949a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:51.357602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70917dbd-32c5-4952-bfec-f218b80949a3 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:51.357883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70917dbd-32c5-4952-bfec-f218b80949a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:51.358151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70917dbd-32c5-4952-bfec-f218b80949a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:51.364799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70917dbd-32c5-4952-bfec-f218b80949a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:51.367052 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70917dbd-32c5-4952-bfec-f218b80949a3 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:51.377915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application [None req-70917dbd-32c5-4952-bfec-f218b80949a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:32:51.377915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:51.377915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:51.377915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:51.377915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:51.377915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:51.377915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:51.377915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:51.377915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:51.377915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:51.377915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:51.377915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:51.377915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:32:51.377915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:32:51.377915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:32:51.378974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:32:51.378974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:51.378974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:51.378974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:51.378974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:51.378974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:51.378974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:51.378974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:51.378974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:51.378974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:51.378974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:51.378974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:51.378974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:51.378974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:51.378974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:51.378974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:51.378974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:51.380159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:32:51.380159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:32:51.380159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:32:51.380159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:32:51.380159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:32:51.380159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:32:51.380159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:32:51.380159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: ERROR keystone.server.flask.application Sep 07 16:32:51.380159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 640/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Sep 7 16:32:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:32:51.385017 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b0b74-c3f7-4bcb-b9bc-10e07cea1128 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:51.438447 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:51.491329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b0b74-c3f7-4bcb-b9bc-10e07cea1128 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:51.529237 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed1546-6fb5-4015-aedd-f201f2946108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:51.529843 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed1546-6fb5-4015-aedd-f201f2946108 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:51.530123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed1546-6fb5-4015-aedd-f201f2946108 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:51.530462 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed1546-6fb5-4015-aedd-f201f2946108 None admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:51.531515 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed1546-6fb5-4015-aedd-f201f2946108 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:51.531820 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed1546-6fb5-4015-aedd-f201f2946108 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:51.533268 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed1546-6fb5-4015-aedd-f201f2946108 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:51.545792 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 646/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Sep 7 16:32:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:51.552215 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70917dbd-32c5-4952-bfec-f218b80949a3 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:51.654438 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70917dbd-32c5-4952-bfec-f218b80949a3 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:51.689953 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29812e83-1bf5-424d-bce9-2a97311896b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:51.690555 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29812e83-1bf5-424d-bce9-2a97311896b2 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:51.690828 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29812e83-1bf5-424d-bce9-2a97311896b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:51.691093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29812e83-1bf5-424d-bce9-2a97311896b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:51.691829 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29812e83-1bf5-424d-bce9-2a97311896b2 None admin] RBAC: Adding query filter params (role.id=d318a8a7f3744d3688dbf1b172690c2a, scope.project.id=1180c1ddef2b493f83c41425fd2e7917, user.id=256e8478e5fb4c01acde0d597bae0b53) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:51.692171 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29812e83-1bf5-424d-bce9-2a97311896b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:51.693596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29812e83-1bf5-424d-bce9-2a97311896b2 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:51.699813 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 641/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Sep 7 16:32:51 2022] GET /identity/v3/role_assignments?user.id=256e8478e5fb4c01acde0d597bae0b53&scope.project.id=1180c1ddef2b493f83c41425fd2e7917&role.id=d318a8a7f3744d3688dbf1b172690c2a => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:53.943419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33f80-0398-4ec4-877c-663378a388f7 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:53.944002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33f80-0398-4ec4-877c-663378a388f7 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:53.944002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33f80-0398-4ec4-877c-663378a388f7 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:53.945367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 647/1288] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:32:53.951433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd265b8f-0c62-4732-8bd4-c24dad8581aa None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:53.952001 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd265b8f-0c62-4732-8bd4-c24dad8581aa None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:53.952001 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd265b8f-0c62-4732-8bd4-c24dad8581aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:53.971681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-bd265b8f-0c62-4732-8bd4-c24dad8581aa None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:32:53.976969 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-bd265b8f-0c62-4732-8bd4-c24dad8581aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:32:54.005584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:54.043029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 642/1289] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:32:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 16:32:54.321832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd33f80-0398-4ec4-877c-663378a388f7 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:54.437359 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd33f80-0398-4ec4-877c-663378a388f7 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:54.450061 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:54.476771 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706eaaa-ae72-4179-8b8b-752fc4fe845c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:54.477425 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706eaaa-ae72-4179-8b8b-752fc4fe845c None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:54.477706 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706eaaa-ae72-4179-8b8b-752fc4fe845c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:54.477982 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706eaaa-ae72-4179-8b8b-752fc4fe845c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:54.478573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706eaaa-ae72-4179-8b8b-752fc4fe845c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:54.480014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706eaaa-ae72-4179-8b8b-752fc4fe845c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:54.491108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-2706eaaa-ae72-4179-8b8b-752fc4fe845c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:32:54.491108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:54.491108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:32:54.491108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:32:54.491108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:32:54.491108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:32:54.491108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:32:54.491108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:32:54.491108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:32:54.491108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:54.491108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:32:54.491108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:54.491108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:32:54.491108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:32:54.491108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:32:54.491108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:32:54.491108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:32:54.493127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:32:54.493127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:32:54.493127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:32:54.493127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:32:54.493127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:32:54.493127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:32:54.493127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:32:54.493127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:32:54.493127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:32:54.493127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:32:54.493127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:32:54.493127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:32:54.493127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:32:54.493127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:32:54.493127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:32:54.493127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:32:54.494802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:32:54.494802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:32:54.494802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:32:54.494802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:32:54.494802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:32:54.494802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:32:54.494802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:32:54.494802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:32:54.494802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:32:54.494802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:32:54.494802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:32:54.494802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:32:54.494802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:32:54.494802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:32:54.494802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 648/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Sep 7 16:32:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:32:54.498605 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd265b8f-0c62-4732-8bd4-c24dad8581aa None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:54.617061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd265b8f-0c62-4732-8bd4-c24dad8581aa None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:54.654244 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66401af-71ee-4a25-86f6-a00f4a2639a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:54.654857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66401af-71ee-4a25-86f6-a00f4a2639a4 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:54.655133 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66401af-71ee-4a25-86f6-a00f4a2639a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:54.655403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66401af-71ee-4a25-86f6-a00f4a2639a4 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:54.657333 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66401af-71ee-4a25-86f6-a00f4a2639a4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:54.658083 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66401af-71ee-4a25-86f6-a00f4a2639a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:54.659069 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66401af-71ee-4a25-86f6-a00f4a2639a4 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:54.664338 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 643/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Wed Sep 7 16:32:54 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:54.670325 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706eaaa-ae72-4179-8b8b-752fc4fe845c None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:54.778121 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706eaaa-ae72-4179-8b8b-752fc4fe845c None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:54.811625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c334ca-e284-45a6-ae28-aea0998c7833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:54.812236 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c334ca-e284-45a6-ae28-aea0998c7833 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:54.812571 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c334ca-e284-45a6-ae28-aea0998c7833 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:54.812898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c334ca-e284-45a6-ae28-aea0998c7833 None admin] PATH_INFO: `/v3/services` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:54.813520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c334ca-e284-45a6-ae28-aea0998c7833 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:32:54.813822 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c334ca-e284-45a6-ae28-aea0998c7833 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:54.815184 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c334ca-e284-45a6-ae28-aea0998c7833 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:54.819638 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 649/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Wed Sep 7 16:32:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:32:57.141345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dc024-3383-4f2c-91ce-3775bd06cfa0 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:57.141968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dc024-3383-4f2c-91ce-3775bd06cfa0 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:57.141968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dc024-3383-4f2c-91ce-3775bd06cfa0 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:57.143314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 644/1293] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:32:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:32:57.149317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215cd14-24f0-455b-bc19-6bb5bcafa2fd None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:57.149845 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215cd14-24f0-455b-bc19-6bb5bcafa2fd None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:57.149845 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215cd14-24f0-455b-bc19-6bb5bcafa2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:57.175912 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f215cd14-24f0-455b-bc19-6bb5bcafa2fd None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:32:57.176734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f215cd14-24f0-455b-bc19-6bb5bcafa2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:32:57.207676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:57.245419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 650/1294] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:32:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:32:57.514782 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dc024-3383-4f2c-91ce-3775bd06cfa0 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:32:57.549024 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:32:57.619622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dc024-3383-4f2c-91ce-3775bd06cfa0 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:32:57.652010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858114d-441e-4d7c-8378-bd8a38daa33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:32:57.652615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858114d-441e-4d7c-8378-bd8a38daa33f None admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:32:57.652892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858114d-441e-4d7c-8378-bd8a38daa33f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:32:57.653159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858114d-441e-4d7c-8378-bd8a38daa33f None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:32:57.653822 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858114d-441e-4d7c-8378-bd8a38daa33f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:32:57.655189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858114d-441e-4d7c-8378-bd8a38daa33f None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:32:57.908941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 645/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Sep 7 16:32:57 2022] POST /identity/v3/services => generated 246 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:33:00.231029 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42a454-29c2-458b-a23f-977e6bca16fd None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:33:00.231619 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42a454-29c2-458b-a23f-977e6bca16fd None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:33:00.231619 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42a454-29c2-458b-a23f-977e6bca16fd None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:33:00.233054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 651/1296] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:33:00.239738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a4677-143a-4097-aa18-615dee65493d None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:33:00.240337 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a4677-143a-4097-aa18-615dee65493d None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:33:00.240337 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a4677-143a-4097-aa18-615dee65493d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:33:00.260511 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-d25a4677-143a-4097-aa18-615dee65493d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:33:00.261743 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d25a4677-143a-4097-aa18-615dee65493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:33:00.342488 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 646/1297] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:33:00 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:33:00.617414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42a454-29c2-458b-a23f-977e6bca16fd None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:33:00.720394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42a454-29c2-458b-a23f-977e6bca16fd None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:33:00.753950 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed956f73-c116-4198-80a3-7784eb10dd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:33:00.754567 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed956f73-c116-4198-80a3-7784eb10dd45 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:33:00.754841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed956f73-c116-4198-80a3-7784eb10dd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:33:00.755109 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed956f73-c116-4198-80a3-7784eb10dd45 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:33:00.755855 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed956f73-c116-4198-80a3-7784eb10dd45 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:33:00.757180 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed956f73-c116-4198-80a3-7784eb10dd45 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:33:00.766136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-ed956f73-c116-4198-80a3-7784eb10dd45 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:33:00.766136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:33:00.766136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:33:00.766136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:33:00.766136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:33:00.766136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:33:00.766136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:33:00.766136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:33:00.766136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:33:00.766136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:33:00.766136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:33:00.766136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:33:00.766136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:33:00.766136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:33:00.766136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:33:00.766136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:33:00.766136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:33:00.767966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:33:00.767966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:33:00.767966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:33:00.767966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:33:00.767966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:33:00.767966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:33:00.767966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:33:00.767966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:33:00.767966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:33:00.767966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:33:00.767966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:33:00.767966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:33:00.767966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:33:00.767966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:33:00.767966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:33:00.767966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:33:00.769714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:33:00.769714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:33:00.769714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:33:00.769714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:33:00.769714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:33:00.769714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:33:00.769714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:33:00.769714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:33:00.769714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:33:00.769714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:33:00.769714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:33:00.769714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:33:00.769714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:33:00.769714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:33:00.769714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 652/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Sep 7 16:33:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:33:00.773383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a4677-143a-4097-aa18-615dee65493d None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:33:00.791824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:33:00.870862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a4677-143a-4097-aa18-615dee65493d None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:33:00.903702 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6798d-7b3d-4148-8f47-710c35bdc634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:33:00.904274 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6798d-7b3d-4148-8f47-710c35bdc634 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:33:00.904546 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6798d-7b3d-4148-8f47-710c35bdc634 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:33:00.904838 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6798d-7b3d-4148-8f47-710c35bdc634 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:33:00.905491 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6798d-7b3d-4148-8f47-710c35bdc634 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:33:00.906365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6798d-7b3d-4148-8f47-710c35bdc634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:33:00.907735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6798d-7b3d-4148-8f47-710c35bdc634 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:33:00.912740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 647/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Wed Sep 7 16:33:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:33:00.918939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed956f73-c116-4198-80a3-7784eb10dd45 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:33:00.950195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:33:01.019310 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed956f73-c116-4198-80a3-7784eb10dd45 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:33:01.052680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05346157-43e2-4455-9924-8f0d80278d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:33:01.053283 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05346157-43e2-4455-9924-8f0d80278d0f None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:33:01.053564 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05346157-43e2-4455-9924-8f0d80278d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:33:01.053876 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05346157-43e2-4455-9924-8f0d80278d0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:33:01.054513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05346157-43e2-4455-9924-8f0d80278d0f None admin] RBAC: Adding query filter params (interface=public, service_id=b364fe3c3ddf4cba80c828fd1057679e, region_id=RegionOne) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:33:01.054805 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05346157-43e2-4455-9924-8f0d80278d0f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:33:01.056229 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05346157-43e2-4455-9924-8f0d80278d0f None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:33:01.061514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 653/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Sep 7 16:33:00 2022] GET /identity/v3/endpoints?service_id=b364fe3c3ddf4cba80c828fd1057679e&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:33:01.067922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6798d-7b3d-4148-8f47-710c35bdc634 None admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:33:01.153422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:33:01.172714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6798d-7b3d-4148-8f47-710c35bdc634 None admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:33:01.208030 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8423c0-d52c-40b2-aec6-cef062fe0cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:33:01.208632 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8423c0-d52c-40b2-aec6-cef062fe0cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:33:01.208909 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8423c0-d52c-40b2-aec6-cef062fe0cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:33:01.209177 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8423c0-d52c-40b2-aec6-cef062fe0cc4 None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:33:01.209769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8423c0-d52c-40b2-aec6-cef062fe0cc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:33:01.211169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8423c0-d52c-40b2-aec6-cef062fe0cc4 None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:33:01.218387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 648/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Sep 7 16:33:01 2022] GET /identity/v3/services => generated 2191 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:33:03.387107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df0ef4-f4bc-402d-84a5-d0999bad8ac1 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:33:03.387715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df0ef4-f4bc-402d-84a5-d0999bad8ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:33:03.387715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df0ef4-f4bc-402d-84a5-d0999bad8ac1 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:33:03.389071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 654/1302] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:33:03.395287 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b376c2-faf7-46a9-913d-9315eb1b9b1e None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:33:03.395741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b376c2-faf7-46a9-913d-9315eb1b9b1e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:33:03.395881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b376c2-faf7-46a9-913d-9315eb1b9b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:33:03.414751 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-77b376c2-faf7-46a9-913d-9315eb1b9b1e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:33:03.419177 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-77b376c2-faf7-46a9-913d-9315eb1b9b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:33:03.484391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 649/1303] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:33:03 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:33:03.755314 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df0ef4-f4bc-402d-84a5-d0999bad8ac1 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:33:03.851535 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:33:03.858392 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df0ef4-f4bc-402d-84a5-d0999bad8ac1 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:33:03.891986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d229e-9f3d-4b5d-bb7b-f0f0b5e56297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:33:03.892609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d229e-9f3d-4b5d-bb7b-f0f0b5e56297 None admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:33:03.892875 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d229e-9f3d-4b5d-bb7b-f0f0b5e56297 None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:33:03.893142 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d229e-9f3d-4b5d-bb7b-f0f0b5e56297 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:33:03.893704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d229e-9f3d-4b5d-bb7b-f0f0b5e56297 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:33:03.895045 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d229e-9f3d-4b5d-bb7b-f0f0b5e56297 None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:33:03.903642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application [None req-450d229e-9f3d-4b5d-bb7b-f0f0b5e56297 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:33:03.903642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:33:03.903642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:33:03.903642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:33:03.903642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:33:03.903642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:33:03.903642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:33:03.903642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:33:03.903642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:33:03.903642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:33:03.903642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:33:03.903642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:33:03.903642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:33:03.903642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:33:03.903642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:33:03.903642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:33:03.903642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:33:03.904859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:33:03.904859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:33:03.904859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:33:03.904859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:33:03.904859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:33:03.904859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:33:03.904859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:33:03.904859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:33:03.904859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:33:03.904859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:33:03.904859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:33:03.904859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:33:03.904859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:33:03.904859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:33:03.904859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:33:03.904859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:33:03.906371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:33:03.906371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application with Lock( Sep 07 16:33:03.906371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:33:03.906371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:33:03.906371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:33:03.906371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:33:03.906371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:33:03.906371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:33:03.906371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:33:03.906371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:33:03.906371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:33:03.906371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:33:03.906371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:33:03.906371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: ERROR keystone.server.flask.application Sep 07 16:33:03.906371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 655/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Sep 7 16:33:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:33:03.911322 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b376c2-faf7-46a9-913d-9315eb1b9b1e None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:33:03.989133 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:33:04.012741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b376c2-faf7-46a9-913d-9315eb1b9b1e None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:33:04.048067 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40eba3-284e-4560-b089-742d514c2b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:33:04.048918 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40eba3-284e-4560-b089-742d514c2b9f None admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:33:04.049256 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40eba3-284e-4560-b089-742d514c2b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:33:04.049722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40eba3-284e-4560-b089-742d514c2b9f None admin] PATH_INFO: `/v3/services` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:33:04.050772 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40eba3-284e-4560-b089-742d514c2b9f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:33:04.051081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40eba3-284e-4560-b089-742d514c2b9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:33:04.052598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40eba3-284e-4560-b089-742d514c2b9f None admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:33:04.057660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 650/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Wed Sep 7 16:33:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:33:04.063710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d229e-9f3d-4b5d-bb7b-f0f0b5e56297 None admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:33:04.161624 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d229e-9f3d-4b5d-bb7b-f0f0b5e56297 None admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:33:04.194607 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdc3e0-597d-4204-b060-d342d556e54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:33:04.195406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdc3e0-597d-4204-b060-d342d556e54c None admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:33:04.195569 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdc3e0-597d-4204-b060-d342d556e54c None admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:33:04.195812 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdc3e0-597d-4204-b060-d342d556e54c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:33:04.196482 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfdc3e0-597d-4204-b060-d342d556e54c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:33:04.197834 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfdc3e0-597d-4204-b060-d342d556e54c None admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:33:04.306207 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 656/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:33:04 2022] POST /identity/v3/endpoints => generated 331 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:33:14.054608 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=30 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:33:14.301499 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:10.356383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd31f0-29ee-42d5-9318-178f60c9533b None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:10.356943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd31f0-29ee-42d5-9318-178f60c9533b None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:10.356943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd31f0-29ee-42d5-9318-178f60c9533b None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:10.363895 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5807e7b-f101-401b-a72a-fe70a3b99c4b None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:10.364420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5807e7b-f101-401b-a72a-fe70a3b99c4b None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:10.364420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5807e7b-f101-401b-a72a-fe70a3b99c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:10.367292 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 651/1307] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:41:10 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:41:10.465949 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-a5807e7b-f101-401b-a72a-fe70a3b99c4b None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:41:10.467085 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a5807e7b-f101-401b-a72a-fe70a3b99c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:10.599525 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 657/1308] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:41:10.938421 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efff4f-b47c-4742-b6fb-03ac27ad350c None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:10.940131 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efff4f-b47c-4742-b6fb-03ac27ad350c None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:10.940938 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efff4f-b47c-4742-b6fb-03ac27ad350c None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:10.944956 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 652/1309] 10.222.0.25 () {54 vars in 965 bytes} [Wed Sep 7 16:41:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:41:10.953417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b7700-bf40-4970-9060-1d4658c0d5b9 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:10.954122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b7700-bf40-4970-9060-1d4658c0d5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:10.954534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b7700-bf40-4970-9060-1d4658c0d5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:11.047409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-403b7700-bf40-4970-9060-1d4658c0d5b9 None None] MFA Rules not processed for user `bac099b78bd04e02b8614c8afce53ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:41:11.047409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-403b7700-bf40-4970-9060-1d4658c0d5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:11.071706 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:11.140442 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 658/1310] 10.222.0.25 () {58 vars in 1062 bytes} [Wed Sep 7 16:41:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:41:11.147430 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efff4f-b47c-4742-b6fb-03ac27ad350c None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:41:11.149533 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-59efff4f-b47c-4742-b6fb-03ac27ad350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:11.321865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efff4f-b47c-4742-b6fb-03ac27ad350c None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:41:11.442442 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90a498-884c-4836-a82e-77c622c14523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:41:11.443105 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a498-884c-4836-a82e-77c622c14523 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:11.443394 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a498-884c-4836-a82e-77c622c14523 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:11.443969 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a498-884c-4836-a82e-77c622c14523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:11.445606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-be90a498-884c-4836-a82e-77c622c14523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:11.529821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:11.614963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90a498-884c-4836-a82e-77c622c14523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:41:11.616646 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90a498-884c-4836-a82e-77c622c14523 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:41:11.646033 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 653/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:41:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:41:14.198561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e0c3b-5317-429f-b1b7-187f5b25b2a5 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:14.199169 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e0c3b-5317-429f-b1b7-187f5b25b2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:14.199169 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e0c3b-5317-429f-b1b7-187f5b25b2a5 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:14.200596 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 659/1312] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:41:14.205996 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93955151-93e4-4f84-bcad-ad24d22a02e9 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:14.206411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93955151-93e4-4f84-bcad-ad24d22a02e9 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:14.206526 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93955151-93e4-4f84-bcad-ad24d22a02e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:14.279856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-93955151-93e4-4f84-bcad-ad24d22a02e9 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:41:14.281084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-93955151-93e4-4f84-bcad-ad24d22a02e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:14.380905 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 654/1313] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:41:14.668203 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e0c3b-5317-429f-b1b7-187f5b25b2a5 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:41:14.669786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f87e0c3b-5317-429f-b1b7-187f5b25b2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:14.785246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e0c3b-5317-429f-b1b7-187f5b25b2a5 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:41:14.860923 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:14.863633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36197a-0c13-496f-b9e8-2677a0ea9983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:41:14.864362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36197a-0c13-496f-b9e8-2677a0ea9983 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:14.864636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36197a-0c13-496f-b9e8-2677a0ea9983 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:14.864909 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36197a-0c13-496f-b9e8-2677a0ea9983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:14.866501 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-dc36197a-0c13-496f-b9e8-2677a0ea9983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:14.994118 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36197a-0c13-496f-b9e8-2677a0ea9983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:41:14.996120 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36197a-0c13-496f-b9e8-2677a0ea9983 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:41:15.016256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 660/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:41:17.854232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918d156-dd88-42bc-ade4-c30ec5b30b79 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:17.854837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918d156-dd88-42bc-ade4-c30ec5b30b79 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:17.855111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918d156-dd88-42bc-ade4-c30ec5b30b79 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:17.856521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 655/1315] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:41:17.861991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107cabb-1136-4f2f-9b0d-b183fd996baa None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:17.862457 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107cabb-1136-4f2f-9b0d-b183fd996baa None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:17.862570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107cabb-1136-4f2f-9b0d-b183fd996baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:17.932320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f107cabb-1136-4f2f-9b0d-b183fd996baa None None] MFA Rules not processed for user `4ba85db5bf4841828041a1a8149cc423`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:41:17.933466 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f107cabb-1136-4f2f-9b0d-b183fd996baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:17.985245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:18.032636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 661/1316] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:41:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:41:18.321494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918d156-dd88-42bc-ade4-c30ec5b30b79 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:41:18.323607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-5918d156-dd88-42bc-ade4-c30ec5b30b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:18.333405 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:18.430181 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918d156-dd88-42bc-ade4-c30ec5b30b79 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:41:18.506671 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd71f7-6cd5-40f8-b326-b3285d3ec781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:41:18.507282 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd71f7-6cd5-40f8-b326-b3285d3ec781 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:18.507660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd71f7-6cd5-40f8-b326-b3285d3ec781 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:18.507935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd71f7-6cd5-40f8-b326-b3285d3ec781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:18.509649 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3efd71f7-6cd5-40f8-b326-b3285d3ec781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:18.574946 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:18.622711 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd71f7-6cd5-40f8-b326-b3285d3ec781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:41:18.624179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd71f7-6cd5-40f8-b326-b3285d3ec781 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:41:18.642422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 656/1317] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:41:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:41:22.059358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48c5e4-65d9-43a1-9c27-d103898330e3 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:22.060025 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48c5e4-65d9-43a1-9c27-d103898330e3 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:22.060025 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48c5e4-65d9-43a1-9c27-d103898330e3 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:22.061288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 662/1318] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:41:22.067112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2b2bf-4a9c-4f08-a980-063166556134 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:22.067650 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2b2bf-4a9c-4f08-a980-063166556134 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:22.067763 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2b2bf-4a9c-4f08-a980-063166556134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:22.140573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-34c2b2bf-4a9c-4f08-a980-063166556134 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:41:22.141786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-34c2b2bf-4a9c-4f08-a980-063166556134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:22.259212 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 657/1319] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:41:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:41:22.579573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe31ad-d03a-4d46-8e9a-810292e5f635 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:22.579851 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe31ad-d03a-4d46-8e9a-810292e5f635 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:22.580115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe31ad-d03a-4d46-8e9a-810292e5f635 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:22.581481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 663/1320] 10.222.0.25 () {54 vars in 965 bytes} [Wed Sep 7 16:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:41:22.587935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e9014-8d0c-43ad-8394-84c48a60096d None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:22.589264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e9014-8d0c-43ad-8394-84c48a60096d None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:22.589264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e9014-8d0c-43ad-8394-84c48a60096d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:22.612074 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:22.674661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-a64e9014-8d0c-43ad-8394-84c48a60096d None None] MFA Rules not processed for user `bac099b78bd04e02b8614c8afce53ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:41:22.675949 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a64e9014-8d0c-43ad-8394-84c48a60096d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:22.761428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 658/1321] 10.222.0.25 () {58 vars in 1062 bytes} [Wed Sep 7 16:41:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:41:22.771981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe31ad-d03a-4d46-8e9a-810292e5f635 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:41:22.774974 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-38fe31ad-d03a-4d46-8e9a-810292e5f635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:22.898815 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe31ad-d03a-4d46-8e9a-810292e5f635 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:41:22.976752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38e2a4-0fbb-4340-9c14-59e49d177569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:41:22.977255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38e2a4-0fbb-4340-9c14-59e49d177569 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:22.977535 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38e2a4-0fbb-4340-9c14-59e49d177569 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:22.977810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38e2a4-0fbb-4340-9c14-59e49d177569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:22.980096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-bc38e2a4-0fbb-4340-9c14-59e49d177569 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:22.988233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:23.097957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38e2a4-0fbb-4340-9c14-59e49d177569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:41:23.099418 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38e2a4-0fbb-4340-9c14-59e49d177569 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:41:23.118286 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 664/1322] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:41:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:41:26.996378 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d496b-8c28-413a-afb5-44f46f0e1cd0 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:26.996946 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d496b-8c28-413a-afb5-44f46f0e1cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:26.996946 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d496b-8c28-413a-afb5-44f46f0e1cd0 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:26.998338 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 659/1323] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:41:27.003816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755d9cf-2fd1-474b-9e40-88bd7e9ff7b3 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:27.004336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755d9cf-2fd1-474b-9e40-88bd7e9ff7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:27.004432 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755d9cf-2fd1-474b-9e40-88bd7e9ff7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:27.075948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-c755d9cf-2fd1-474b-9e40-88bd7e9ff7b3 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:41:27.077188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c755d9cf-2fd1-474b-9e40-88bd7e9ff7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:27.140576 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:27.183332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 665/1324] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:41:27.470141 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d496b-8c28-413a-afb5-44f46f0e1cd0 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:41:27.471758 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-403d496b-8c28-413a-afb5-44f46f0e1cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:27.595447 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d496b-8c28-413a-afb5-44f46f0e1cd0 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:41:27.608751 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:27.674154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ba842-46ed-4a28-b176-a9e76a34167f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:41:27.674757 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ba842-46ed-4a28-b176-a9e76a34167f service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:27.675031 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ba842-46ed-4a28-b176-a9e76a34167f service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:27.675304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ba842-46ed-4a28-b176-a9e76a34167f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:27.676917 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-480ba842-46ed-4a28-b176-a9e76a34167f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:27.810966 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ba842-46ed-4a28-b176-a9e76a34167f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:41:27.812501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ba842-46ed-4a28-b176-a9e76a34167f service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:41:27.833148 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 660/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:41:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:41:30.129362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77598d4-9ae2-48f1-b258-c1d4a64fa048 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:30.129956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77598d4-9ae2-48f1-b258-c1d4a64fa048 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:30.129956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77598d4-9ae2-48f1-b258-c1d4a64fa048 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:30.131347 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 666/1326] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:41:30.138871 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b704de8-9ba9-4110-8361-0960b8195f11 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:30.139742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b704de8-9ba9-4110-8361-0960b8195f11 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:30.140130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b704de8-9ba9-4110-8361-0960b8195f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:30.195951 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:30.216104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-1b704de8-9ba9-4110-8361-0960b8195f11 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:41:30.217316 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1b704de8-9ba9-4110-8361-0960b8195f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:30.340972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 661/1327] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:41:30.641491 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77598d4-9ae2-48f1-b258-c1d4a64fa048 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:41:30.643118 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-d77598d4-9ae2-48f1-b258-c1d4a64fa048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:30.756491 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77598d4-9ae2-48f1-b258-c1d4a64fa048 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:41:30.834907 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d0df3-458a-4f97-bf26-eda07d0da536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:41:30.835416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d0df3-458a-4f97-bf26-eda07d0da536 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:30.835731 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d0df3-458a-4f97-bf26-eda07d0da536 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:30.836008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d0df3-458a-4f97-bf26-eda07d0da536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:30.838183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a47d0df3-458a-4f97-bf26-eda07d0da536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:30.857737 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:30.955120 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d0df3-458a-4f97-bf26-eda07d0da536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:41:30.956579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d0df3-458a-4f97-bf26-eda07d0da536 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:41:30.975847 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 667/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:41:33.238217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780f482-51b2-41c4-8d29-fe3f3e9a1b18 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:33.238782 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780f482-51b2-41c4-8d29-fe3f3e9a1b18 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:33.238782 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780f482-51b2-41c4-8d29-fe3f3e9a1b18 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:33.240196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 662/1329] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:41:33.246164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144955a-5492-415e-8b17-bd63ee8fc096 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:33.246695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144955a-5492-415e-8b17-bd63ee8fc096 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:33.246695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144955a-5492-415e-8b17-bd63ee8fc096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:33.325947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-6144955a-5492-415e-8b17-bd63ee8fc096 None None] MFA Rules not processed for user `4ba85db5bf4841828041a1a8149cc423`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:41:33.327194 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-6144955a-5492-415e-8b17-bd63ee8fc096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:33.398088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:33.437594 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 668/1330] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:41:33 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:41:33.732558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780f482-51b2-41c4-8d29-fe3f3e9a1b18 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:41:33.734165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2780f482-51b2-41c4-8d29-fe3f3e9a1b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:33.849038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780f482-51b2-41c4-8d29-fe3f3e9a1b18 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:41:33.872821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:33.936399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea639e-c04a-4398-869a-d73522a59dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:41:33.937010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea639e-c04a-4398-869a-d73522a59dfe service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:33.937287 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea639e-c04a-4398-869a-d73522a59dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:33.937615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea639e-c04a-4398-869a-d73522a59dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:33.939269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-adea639e-c04a-4398-869a-d73522a59dfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:34.059469 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea639e-c04a-4398-869a-d73522a59dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:41:34.060956 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea639e-c04a-4398-869a-d73522a59dfe service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:41:34.081316 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 663/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:41:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:41:36.775597 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30520164-8ad5-4a82-9e5d-b5db5ab742f6 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:36.776145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30520164-8ad5-4a82-9e5d-b5db5ab742f6 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:36.776235 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30520164-8ad5-4a82-9e5d-b5db5ab742f6 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:36.777542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 669/1332] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:41:36.783608 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41406ff2-04f4-4fe5-8ef7-121450c78a80 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:36.784168 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41406ff2-04f4-4fe5-8ef7-121450c78a80 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:36.784168 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41406ff2-04f4-4fe5-8ef7-121450c78a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:36.847297 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:36.849956 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-41406ff2-04f4-4fe5-8ef7-121450c78a80 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:41:36.851156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-41406ff2-04f4-4fe5-8ef7-121450c78a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:36.950455 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 664/1333] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:41:37.257472 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30520164-8ad5-4a82-9e5d-b5db5ab742f6 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:41:37.259151 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-30520164-8ad5-4a82-9e5d-b5db5ab742f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:37.365124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30520164-8ad5-4a82-9e5d-b5db5ab742f6 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:41:37.440967 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e5874-58fa-4e6d-aed6-cffe3e71db2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:41:37.441627 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e5874-58fa-4e6d-aed6-cffe3e71db2a service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:37.441905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e5874-58fa-4e6d-aed6-cffe3e71db2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:37.442173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e5874-58fa-4e6d-aed6-cffe3e71db2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:37.443790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5a4e5874-58fa-4e6d-aed6-cffe3e71db2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:37.470948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:37.554558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e5874-58fa-4e6d-aed6-cffe3e71db2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:41:37.556477 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e5874-58fa-4e6d-aed6-cffe3e71db2a service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:41:37.578986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 670/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:41:39.833837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe4b4d-5eb4-4e87-8909-a55561b5fe5d None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:39.834441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe4b4d-5eb4-4e87-8909-a55561b5fe5d None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:39.834441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe4b4d-5eb4-4e87-8909-a55561b5fe5d None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:39.835930 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 665/1335] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:41:39.842484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a85d6-4c05-4287-bd62-a5bcd3d2775e None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:39.842978 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a85d6-4c05-4287-bd62-a5bcd3d2775e None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:39.842978 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a85d6-4c05-4287-bd62-a5bcd3d2775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:39.913607 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-595a85d6-4c05-4287-bd62-a5bcd3d2775e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:41:39.915014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-595a85d6-4c05-4287-bd62-a5bcd3d2775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:39.993812 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:40.016400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 671/1336] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:41:40.306784 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe4b4d-5eb4-4e87-8909-a55561b5fe5d None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:41:40.308795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-fdfe4b4d-5eb4-4e87-8909-a55561b5fe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:40.418477 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe4b4d-5eb4-4e87-8909-a55561b5fe5d None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:41:40.448115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:40.494964 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f722aa-f64c-4e24-9925-0b4050aeba80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:41:40.495749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f722aa-f64c-4e24-9925-0b4050aeba80 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:40.496090 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f722aa-f64c-4e24-9925-0b4050aeba80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:40.496769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f722aa-f64c-4e24-9925-0b4050aeba80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:40.498381 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b8f722aa-f64c-4e24-9925-0b4050aeba80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:40.612055 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f722aa-f64c-4e24-9925-0b4050aeba80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:41:40.613455 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f722aa-f64c-4e24-9925-0b4050aeba80 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:41:40.633082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 666/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:41:43.581006 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf399295-ed6b-4aaf-a3d4-0d77a3397fe4 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:43.581585 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf399295-ed6b-4aaf-a3d4-0d77a3397fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:43.581585 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf399295-ed6b-4aaf-a3d4-0d77a3397fe4 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:43.582868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 672/1338] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:41:43.588678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63618e-1de0-449d-b705-3e2f40cf2e79 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:43.589133 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63618e-1de0-449d-b705-3e2f40cf2e79 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:43.589228 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63618e-1de0-449d-b705-3e2f40cf2e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:43.657365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-2f63618e-1de0-449d-b705-3e2f40cf2e79 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:41:43.658186 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2f63618e-1de0-449d-b705-3e2f40cf2e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:43.667818 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:43.759218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 667/1339] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:41:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:41:44.041368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf399295-ed6b-4aaf-a3d4-0d77a3397fe4 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:41:44.042907 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-bf399295-ed6b-4aaf-a3d4-0d77a3397fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:44.161653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf399295-ed6b-4aaf-a3d4-0d77a3397fe4 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:41:44.241951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fb721-9415-47ef-97ed-c940949053d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:41:44.242558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fb721-9415-47ef-97ed-c940949053d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:44.243337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fb721-9415-47ef-97ed-c940949053d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:44.244210 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fb721-9415-47ef-97ed-c940949053d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:44.245871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2b0fb721-9415-47ef-97ed-c940949053d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:44.283871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:44.363929 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fb721-9415-47ef-97ed-c940949053d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:41:44.365365 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fb721-9415-47ef-97ed-c940949053d2 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:41:44.389822 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 673/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:41:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:41:49.130837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c61d-17b8-48ce-8cd8-4fc95c4e107f None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:49.131343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c61d-17b8-48ce-8cd8-4fc95c4e107f None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:49.131422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c61d-17b8-48ce-8cd8-4fc95c4e107f None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:49.132834 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 668/1341] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:41:49.139101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64a576-6417-4b90-bf80-8cca8c17224b None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:49.141758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64a576-6417-4b90-bf80-8cca8c17224b None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:49.141758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64a576-6417-4b90-bf80-8cca8c17224b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:49.217483 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-1c64a576-6417-4b90-bf80-8cca8c17224b None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:41:49.218686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1c64a576-6417-4b90-bf80-8cca8c17224b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:49.314198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:49.337659 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 674/1342] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:41:49.645428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481c61d-17b8-48ce-8cd8-4fc95c4e107f None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:41:49.647860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c481c61d-17b8-48ce-8cd8-4fc95c4e107f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:49.786609 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481c61d-17b8-48ce-8cd8-4fc95c4e107f None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:41:49.836528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:49.875238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadd61d-ebda-4c5e-ba98-985f74b46a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:41:49.875785 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadd61d-ebda-4c5e-ba98-985f74b46a9e service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:49.876064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadd61d-ebda-4c5e-ba98-985f74b46a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:49.876344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadd61d-ebda-4c5e-ba98-985f74b46a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:49.877979 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0cadd61d-ebda-4c5e-ba98-985f74b46a9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:50.012512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadd61d-ebda-4c5e-ba98-985f74b46a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:41:50.013968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadd61d-ebda-4c5e-ba98-985f74b46a9e service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:41:50.034615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 669/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:41:53.537997 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327f4c-87b7-47c0-bb6e-cde35ebacfda None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:53.538588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327f4c-87b7-47c0-bb6e-cde35ebacfda None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:53.538588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327f4c-87b7-47c0-bb6e-cde35ebacfda None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:53.539974 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 675/1344] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:41:53.546261 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4195e-3a5c-4074-bfe3-e256651c69df None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:53.546826 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4195e-3a5c-4074-bfe3-e256651c69df None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:53.546826 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4195e-3a5c-4074-bfe3-e256651c69df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:53.624508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-d8e4195e-3a5c-4074-bfe3-e256651c69df None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:41:53.625734 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d8e4195e-3a5c-4074-bfe3-e256651c69df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:53.646077 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:53.770987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 670/1345] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:41:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:41:54.065274 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96327f4c-87b7-47c0-bb6e-cde35ebacfda None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:41:54.067513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-96327f4c-87b7-47c0-bb6e-cde35ebacfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:54.217758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96327f4c-87b7-47c0-bb6e-cde35ebacfda None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:41:54.311417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a269186-c9f4-48c6-9556-9d412c377134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:41:54.312126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a269186-c9f4-48c6-9556-9d412c377134 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:54.312404 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a269186-c9f4-48c6-9556-9d412c377134 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:54.315178 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a269186-c9f4-48c6-9556-9d412c377134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:54.315178 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9a269186-c9f4-48c6-9556-9d412c377134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:54.369073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:54.459445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a269186-c9f4-48c6-9556-9d412c377134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:41:54.461556 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a269186-c9f4-48c6-9556-9d412c377134 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:41:54.495442 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 676/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:41:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:41:59.486671 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d169-2d9c-411a-8ec6-39b5cdb44e45 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:59.487238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d169-2d9c-411a-8ec6-39b5cdb44e45 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:59.487816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d169-2d9c-411a-8ec6-39b5cdb44e45 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:59.490090 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 671/1347] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:41:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:41:59.497508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3022f85-f556-460c-8f7a-5efca762cd1e None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:41:59.498223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3022f85-f556-460c-8f7a-5efca762cd1e None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:41:59.498223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3022f85-f556-460c-8f7a-5efca762cd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:41:59.605708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-a3022f85-f556-460c-8f7a-5efca762cd1e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:41:59.607560 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a3022f85-f556-460c-8f7a-5efca762cd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:41:59.732629 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:41:59.736477 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 677/1348] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:42:00.087859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d169-2d9c-411a-8ec6-39b5cdb44e45 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:42:00.089537 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b935d169-2d9c-411a-8ec6-39b5cdb44e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:00.208689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d169-2d9c-411a-8ec6-39b5cdb44e45 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:42:00.263176 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:00.293970 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539af92b-f288-4e18-bcf6-41c8bb2fee76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:42:00.294589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539af92b-f288-4e18-bcf6-41c8bb2fee76 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:00.294866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539af92b-f288-4e18-bcf6-41c8bb2fee76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:00.295188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539af92b-f288-4e18-bcf6-41c8bb2fee76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:00.296880 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-539af92b-f288-4e18-bcf6-41c8bb2fee76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:00.427332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539af92b-f288-4e18-bcf6-41c8bb2fee76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:42:00.428950 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539af92b-f288-4e18-bcf6-41c8bb2fee76 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:42:00.453883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 672/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:42:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:42:06.193460 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41c11-a335-4ebb-9f60-a26521c96e5f None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:06.199891 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41c11-a335-4ebb-9f60-a26521c96e5f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:06.199891 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41c11-a335-4ebb-9f60-a26521c96e5f None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:06.199891 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 678/1350] 10.222.0.25 () {54 vars in 921 bytes} [Wed Sep 7 16:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:06.201683 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1b9e2-7cb3-4fd3-b305-7fea50e95253 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:06.202078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1b9e2-7cb3-4fd3-b305-7fea50e95253 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:06.202251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1b9e2-7cb3-4fd3-b305-7fea50e95253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:06.314412 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-bdd1b9e2-7cb3-4fd3-b305-7fea50e95253 None None] MFA Rules not processed for user `256e8478e5fb4c01acde0d597bae0b53`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:06.316209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-bdd1b9e2-7cb3-4fd3-b305-7fea50e95253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:06.343979 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:06.468219 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 673/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Sep 7 16:42:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:42:11.551067 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259a838-cdcb-4a3f-ba35-71d995588287 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:11.551962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259a838-cdcb-4a3f-ba35-71d995588287 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:11.551962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259a838-cdcb-4a3f-ba35-71d995588287 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:11.553275 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 679/1352] 10.222.0.25 () {54 vars in 921 bytes} [Wed Sep 7 16:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:11.562304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c36550-9f0c-43a6-a2cb-a79d9e84e93f None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:11.563246 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c36550-9f0c-43a6-a2cb-a79d9e84e93f None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:11.563857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c36550-9f0c-43a6-a2cb-a79d9e84e93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:11.656021 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-26c36550-9f0c-43a6-a2cb-a79d9e84e93f None None] MFA Rules not processed for user `256e8478e5fb4c01acde0d597bae0b53`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:11.657533 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-26c36550-9f0c-43a6-a2cb-a79d9e84e93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:11.744375 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:11.790180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 674/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Sep 7 16:42:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:42:13.766689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c56f7a-232e-4950-b769-2e95fc5cba71 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:13.767236 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c56f7a-232e-4950-b769-2e95fc5cba71 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:13.767636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c56f7a-232e-4950-b769-2e95fc5cba71 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:13.770069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 680/1354] 10.222.0.25 () {54 vars in 921 bytes} [Wed Sep 7 16:42:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:13.776368 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8102f-57a3-4353-acb6-e04a844be64e None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:13.776941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8102f-57a3-4353-acb6-e04a844be64e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:13.776941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8102f-57a3-4353-acb6-e04a844be64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:13.873736 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-8fa8102f-57a3-4353-acb6-e04a844be64e None None] MFA Rules not processed for user `256e8478e5fb4c01acde0d597bae0b53`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:13.875107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-8fa8102f-57a3-4353-acb6-e04a844be64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:14.027368 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 675/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Sep 7 16:42:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:42:17.609676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c770b-5d9b-46d4-92c9-e6633ca05ac0 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:17.610235 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c770b-5d9b-46d4-92c9-e6633ca05ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:17.610235 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c770b-5d9b-46d4-92c9-e6633ca05ac0 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:17.618191 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 681/1356] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:42:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:17.620458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea0e1f-263b-409b-baaf-ef05e6d134cd None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:17.621354 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea0e1f-263b-409b-baaf-ef05e6d134cd None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:17.621839 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea0e1f-263b-409b-baaf-ef05e6d134cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:17.674817 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:17.727152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-0bea0e1f-263b-409b-baaf-ef05e6d134cd None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:17.727152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0bea0e1f-263b-409b-baaf-ef05e6d134cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:17.899268 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 676/1357] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:42:18.214617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be145-75d0-4fdb-ad7c-57ee2a4c9619 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:18.214905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be145-75d0-4fdb-ad7c-57ee2a4c9619 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:18.215183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be145-75d0-4fdb-ad7c-57ee2a4c9619 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:18.216804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 682/1358] 10.222.0.25 () {54 vars in 962 bytes} [Wed Sep 7 16:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:18.226590 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cd2de-5a3c-4304-81a6-3533f324e7d0 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:18.227210 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cd2de-5a3c-4304-81a6-3533f324e7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:18.227847 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cd2de-5a3c-4304-81a6-3533f324e7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:18.325496 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-b80cd2de-5a3c-4304-81a6-3533f324e7d0 None None] MFA Rules not processed for user `cf48978c20f04173b114e15e1ce2157c`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:18.326705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b80cd2de-5a3c-4304-81a6-3533f324e7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:18.408579 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:18.529282 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 677/1359] 10.222.0.25 () {58 vars in 1059 bytes} [Wed Sep 7 16:42:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:42:18.537051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197be145-75d0-4fdb-ad7c-57ee2a4c9619 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:42:18.539856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-197be145-75d0-4fdb-ad7c-57ee2a4c9619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:18.704590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197be145-75d0-4fdb-ad7c-57ee2a4c9619 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:42:18.788814 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:18.836745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949494c-fb47-4b63-bc16-498a80433197 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:42:18.837375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949494c-fb47-4b63-bc16-498a80433197 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:18.837658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949494c-fb47-4b63-bc16-498a80433197 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:18.837934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949494c-fb47-4b63-bc16-498a80433197 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:18.839724 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-d949494c-fb47-4b63-bc16-498a80433197 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:18.947945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949494c-fb47-4b63-bc16-498a80433197 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:42:18.949555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949494c-fb47-4b63-bc16-498a80433197 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:42:18.969940 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 683/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:42:21.698890 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc0911-fd42-4f15-8b1c-1b67022934bb None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:21.699707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc0911-fd42-4f15-8b1c-1b67022934bb None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:21.699707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc0911-fd42-4f15-8b1c-1b67022934bb None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:21.700824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 678/1361] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:21.707165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac1da-c528-42fc-8e6e-f24b36bc5273 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:21.707165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac1da-c528-42fc-8e6e-f24b36bc5273 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:21.707165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac1da-c528-42fc-8e6e-f24b36bc5273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:21.787960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-4d8ac1da-c528-42fc-8e6e-f24b36bc5273 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:21.788720 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-4d8ac1da-c528-42fc-8e6e-f24b36bc5273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:21.859341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:21.999582 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 684/1362] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:42:22.314977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc0911-fd42-4f15-8b1c-1b67022934bb None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:42:22.317938 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-eefc0911-fd42-4f15-8b1c-1b67022934bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:22.656357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc0911-fd42-4f15-8b1c-1b67022934bb None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:42:22.669544 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:22.817751 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837c785-d633-4fb6-a364-d7ecb64b48b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:42:22.818805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837c785-d633-4fb6-a364-d7ecb64b48b8 service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:22.818805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837c785-d633-4fb6-a364-d7ecb64b48b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:22.818805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837c785-d633-4fb6-a364-d7ecb64b48b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:22.820604 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a837c785-d633-4fb6-a364-d7ecb64b48b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:22.936836 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837c785-d633-4fb6-a364-d7ecb64b48b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:42:22.940102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837c785-d633-4fb6-a364-d7ecb64b48b8 service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:42:22.976010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 679/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:42:25.728580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55852f71-9d2b-453b-9dd6-dcb4d6296f24 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:25.729168 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55852f71-9d2b-453b-9dd6-dcb4d6296f24 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:25.729168 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55852f71-9d2b-453b-9dd6-dcb4d6296f24 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:25.730472 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 685/1364] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:25.736335 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bb07c-d3f8-4991-a0a0-cbc7b2b0c84e None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:25.737249 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bb07c-d3f8-4991-a0a0-cbc7b2b0c84e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:25.737707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bb07c-d3f8-4991-a0a0-cbc7b2b0c84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:25.754890 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:25.822714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-9c5bb07c-d3f8-4991-a0a0-cbc7b2b0c84e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:25.824722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-9c5bb07c-d3f8-4991-a0a0-cbc7b2b0c84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:25.953797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 680/1365] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:42:26.267061 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90b44-29f6-4ea2-ac24-8c5873819688 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:26.267646 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90b44-29f6-4ea2-ac24-8c5873819688 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:26.268107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90b44-29f6-4ea2-ac24-8c5873819688 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:26.269874 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 686/1366] 10.222.0.25 () {54 vars in 962 bytes} [Wed Sep 7 16:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:26.276432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59a1c8-22eb-481c-874d-5e5eecd0ab3b None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:26.277172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59a1c8-22eb-481c-874d-5e5eecd0ab3b None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:26.277437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59a1c8-22eb-481c-874d-5e5eecd0ab3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:26.373765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-1d59a1c8-22eb-481c-874d-5e5eecd0ab3b None None] MFA Rules not processed for user `cf48978c20f04173b114e15e1ce2157c`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:26.374994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1d59a1c8-22eb-481c-874d-5e5eecd0ab3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:26.417784 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:26.539524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 681/1367] 10.222.0.25 () {58 vars in 1059 bytes} [Wed Sep 7 16:42:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:42:26.553111 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90b44-29f6-4ea2-ac24-8c5873819688 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:42:26.554686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-4ef90b44-29f6-4ea2-ac24-8c5873819688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:26.739921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90b44-29f6-4ea2-ac24-8c5873819688 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:42:26.763198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:26.821740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0086d-6c3e-4c41-a0ce-3826dd8cc730 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:26.822291 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0086d-6c3e-4c41-a0ce-3826dd8cc730 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:26.822291 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0086d-6c3e-4c41-a0ce-3826dd8cc730 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:26.823742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 682/1368] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:42:26.829696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5567d0-b904-4754-a1a7-ead0100884ba None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:26.830095 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5567d0-b904-4754-a1a7-ead0100884ba None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:26.831063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5567d0-b904-4754-a1a7-ead0100884ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:26.869555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6e439-c1aa-46f1-8051-16f3b6855303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:42:26.870158 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6e439-c1aa-46f1-8051-16f3b6855303 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:26.870378 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6e439-c1aa-46f1-8051-16f3b6855303 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:26.870652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6e439-c1aa-46f1-8051-16f3b6855303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:26.872320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e9e6e439-c1aa-46f1-8051-16f3b6855303 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:26.912419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-2e5567d0-b904-4754-a1a7-ead0100884ba None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:26.914193 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2e5567d0-b904-4754-a1a7-ead0100884ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:26.980402 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6e439-c1aa-46f1-8051-16f3b6855303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:42:26.982117 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6e439-c1aa-46f1-8051-16f3b6855303 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:42:27.001640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 687/1369] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:42:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:42:27.024085 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:27.035568 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 683/1370] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:42:27.341913 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0378408-9717-4f68-acf4-e9327081428f None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:27.342239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0378408-9717-4f68-acf4-e9327081428f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:27.342609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0378408-9717-4f68-acf4-e9327081428f None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:27.344367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 688/1371] 10.222.0.25 () {54 vars in 964 bytes} [Wed Sep 7 16:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:27.350817 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd1d4-747a-4feb-b096-c71719372511 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:27.351137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd1d4-747a-4feb-b096-c71719372511 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:27.351359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd1d4-747a-4feb-b096-c71719372511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:27.484916 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-7ddfd1d4-747a-4feb-b096-c71719372511 None None] MFA Rules not processed for user `73216eee250744bb9d9b81dd983376ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:27.486182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-7ddfd1d4-747a-4feb-b096-c71719372511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:27.614402 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 684/1372] 10.222.0.25 () {58 vars in 1061 bytes} [Wed Sep 7 16:42:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:42:27.631777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0378408-9717-4f68-acf4-e9327081428f None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:42:27.635354 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b0378408-9717-4f68-acf4-e9327081428f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:27.704128 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:27.820343 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0378408-9717-4f68-acf4-e9327081428f None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:42:27.907139 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85071a7-4621-4fbe-9295-96203ce39d39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:42:27.907827 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85071a7-4621-4fbe-9295-96203ce39d39 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:27.908132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85071a7-4621-4fbe-9295-96203ce39d39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:27.908328 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85071a7-4621-4fbe-9295-96203ce39d39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:27.909966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a85071a7-4621-4fbe-9295-96203ce39d39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:28.021739 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:28.076049 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85071a7-4621-4fbe-9295-96203ce39d39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:42:28.079295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85071a7-4621-4fbe-9295-96203ce39d39 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:42:28.119465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 689/1373] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:42:29.765190 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a576fe-525b-46a9-a5d6-5c0ab3eed208 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:29.765867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a576fe-525b-46a9-a5d6-5c0ab3eed208 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:29.766066 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a576fe-525b-46a9-a5d6-5c0ab3eed208 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:29.768705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 685/1374] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:42:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:29.776808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a06974-e5bb-4db4-9fcb-b035c1599db1 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:29.777496 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a06974-e5bb-4db4-9fcb-b035c1599db1 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:29.777860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a06974-e5bb-4db4-9fcb-b035c1599db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:29.884647 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f7a06974-e5bb-4db4-9fcb-b035c1599db1 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:29.885962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f7a06974-e5bb-4db4-9fcb-b035c1599db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:30.003819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 690/1375] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:42:30.309430 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a576fe-525b-46a9-a5d6-5c0ab3eed208 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:42:30.310981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c2a576fe-525b-46a9-a5d6-5c0ab3eed208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:30.416257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:30.516306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a576fe-525b-46a9-a5d6-5c0ab3eed208 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:42:30.666964 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19812120-2c72-4001-a4e4-ee7fce19d1fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:42:30.667695 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19812120-2c72-4001-a4e4-ee7fce19d1fc service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:30.668086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19812120-2c72-4001-a4e4-ee7fce19d1fc service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:30.668563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19812120-2c72-4001-a4e4-ee7fce19d1fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:30.670305 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-19812120-2c72-4001-a4e4-ee7fce19d1fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:30.737482 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:30.791096 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19812120-2c72-4001-a4e4-ee7fce19d1fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:42:30.792855 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19812120-2c72-4001-a4e4-ee7fce19d1fc service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:42:30.820568 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 686/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:42:33.322761 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94270028-1c45-40c0-93f2-6f0f53165040 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:33.323337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94270028-1c45-40c0-93f2-6f0f53165040 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:33.323881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94270028-1c45-40c0-93f2-6f0f53165040 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:33.326022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 691/1377] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:42:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:33.332784 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f16d9b-d124-4ba2-b4d8-304a1ccc328e None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:33.333372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f16d9b-d124-4ba2-b4d8-304a1ccc328e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:33.333710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f16d9b-d124-4ba2-b4d8-304a1ccc328e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:33.410659 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-80f16d9b-d124-4ba2-b4d8-304a1ccc328e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:33.413389 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-80f16d9b-d124-4ba2-b4d8-304a1ccc328e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:33.531295 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 687/1378] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:42:33.835019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94270028-1c45-40c0-93f2-6f0f53165040 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:42:33.836873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-94270028-1c45-40c0-93f2-6f0f53165040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:33.882710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:34.019238 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94270028-1c45-40c0-93f2-6f0f53165040 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:42:34.153738 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:34.158973 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c3bba-a915-421f-ab57-8bcc97f45289 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:42:34.159752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c3bba-a915-421f-ab57-8bcc97f45289 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:34.160127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c3bba-a915-421f-ab57-8bcc97f45289 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:34.160500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c3bba-a915-421f-ab57-8bcc97f45289 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:34.162263 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5f7c3bba-a915-421f-ab57-8bcc97f45289 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:34.294893 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c3bba-a915-421f-ab57-8bcc97f45289 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:42:34.296859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c3bba-a915-421f-ab57-8bcc97f45289 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:42:34.324406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 692/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:42:36.976989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb372-7fa7-4aa6-954f-2f9fe74d00a9 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:36.977644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb372-7fa7-4aa6-954f-2f9fe74d00a9 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:36.977644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb372-7fa7-4aa6-954f-2f9fe74d00a9 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:36.978984 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 688/1380] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:36.984989 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bfc8e-9259-4509-a965-7dc851059ac1 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:36.985897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bfc8e-9259-4509-a965-7dc851059ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:36.986200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bfc8e-9259-4509-a965-7dc851059ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:37.089639 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-125bfc8e-9259-4509-a965-7dc851059ac1 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:37.091975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-125bfc8e-9259-4509-a965-7dc851059ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:37.187824 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:37.225461 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 693/1381] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:42:37.575710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cb372-7fa7-4aa6-954f-2f9fe74d00a9 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:42:37.577300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f99cb372-7fa7-4aa6-954f-2f9fe74d00a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:37.616099 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:37.768957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cb372-7fa7-4aa6-954f-2f9fe74d00a9 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:42:37.881473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:37.899793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d8a55-3cee-4d61-82ad-73a03a2ef331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:42:37.900406 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d8a55-3cee-4d61-82ad-73a03a2ef331 service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:37.900675 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d8a55-3cee-4d61-82ad-73a03a2ef331 service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:37.900945 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d8a55-3cee-4d61-82ad-73a03a2ef331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:37.902589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-786d8a55-3cee-4d61-82ad-73a03a2ef331 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:38.000960 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d8a55-3cee-4d61-82ad-73a03a2ef331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:42:38.007445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d8a55-3cee-4d61-82ad-73a03a2ef331 service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:42:38.022951 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 689/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:42:40.472466 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf740f8-72cb-4e71-9b4c-bd94adcb5dbb None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:40.473141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf740f8-72cb-4e71-9b4c-bd94adcb5dbb None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:40.473141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf740f8-72cb-4e71-9b4c-bd94adcb5dbb None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:40.474373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 694/1383] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:40.480679 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864c958-84fc-41f2-bf43-43ef08c26fa6 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:40.481249 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864c958-84fc-41f2-bf43-43ef08c26fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:40.481249 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864c958-84fc-41f2-bf43-43ef08c26fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:40.560048 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-0864c958-84fc-41f2-bf43-43ef08c26fa6 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:40.561473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0864c958-84fc-41f2-bf43-43ef08c26fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:40.637113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:40.682760 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 690/1384] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:42:40.988856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf740f8-72cb-4e71-9b4c-bd94adcb5dbb None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:42:40.991308 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8bf740f8-72cb-4e71-9b4c-bd94adcb5dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:41.178433 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf740f8-72cb-4e71-9b4c-bd94adcb5dbb None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:42:41.238101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:41.325291 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4bdd6-0a27-414c-8f29-0ef554b977a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:42:41.325935 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4bdd6-0a27-414c-8f29-0ef554b977a8 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:41.326225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4bdd6-0a27-414c-8f29-0ef554b977a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:41.326506 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4bdd6-0a27-414c-8f29-0ef554b977a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:41.328215 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3ff4bdd6-0a27-414c-8f29-0ef554b977a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:41.444944 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4bdd6-0a27-414c-8f29-0ef554b977a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:42:41.448256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4bdd6-0a27-414c-8f29-0ef554b977a8 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:42:41.482892 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 695/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:42:43.821831 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fae4a-52ff-4de3-8fe2-bbedecd09c0a None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:43.822459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fae4a-52ff-4de3-8fe2-bbedecd09c0a None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:43.822772 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fae4a-52ff-4de3-8fe2-bbedecd09c0a None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:43.825410 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 691/1386] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:42:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:43.834162 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5b270-0d68-406d-80d7-98138703190e None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:43.834894 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5b270-0d68-406d-80d7-98138703190e None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:43.834894 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5b270-0d68-406d-80d7-98138703190e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:43.925089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-89f5b270-0d68-406d-80d7-98138703190e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:43.927261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-89f5b270-0d68-406d-80d7-98138703190e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:43.943657 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:44.085294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 696/1387] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:42:44.376413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fae4a-52ff-4de3-8fe2-bbedecd09c0a None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:42:44.377928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-618fae4a-52ff-4de3-8fe2-bbedecd09c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:44.561836 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fae4a-52ff-4de3-8fe2-bbedecd09c0a None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:42:44.623575 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:44.709699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a188c60-1c93-43b4-8f21-aca332bdf41d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:42:44.710592 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a188c60-1c93-43b4-8f21-aca332bdf41d service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:44.710885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a188c60-1c93-43b4-8f21-aca332bdf41d service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:44.711366 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a188c60-1c93-43b4-8f21-aca332bdf41d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:44.714514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4a188c60-1c93-43b4-8f21-aca332bdf41d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:44.844047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a188c60-1c93-43b4-8f21-aca332bdf41d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:42:44.845667 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a188c60-1c93-43b4-8f21-aca332bdf41d service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:42:44.867761 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 692/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:42:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:42:45.233113 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab0174-2e2c-4892-b17a-7534e48048aa None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:45.233659 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab0174-2e2c-4892-b17a-7534e48048aa None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:45.233961 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab0174-2e2c-4892-b17a-7534e48048aa None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:45.236742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 697/1389] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:42:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:45.244017 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b0ab8-4b41-4744-afe6-18739ac8da88 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:45.244322 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b0ab8-4b41-4744-afe6-18739ac8da88 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:45.244632 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b0ab8-4b41-4744-afe6-18739ac8da88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:45.315629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:45.320680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-cc9b0ab8-4b41-4744-afe6-18739ac8da88 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:45.321915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-cc9b0ab8-4b41-4744-afe6-18739ac8da88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:45.479188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 693/1390] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:42:45.945014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4c52d-c400-4c95-83cc-7cf056c0b49e None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:45.945515 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4c52d-c400-4c95-83cc-7cf056c0b49e None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:45.945857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4c52d-c400-4c95-83cc-7cf056c0b49e None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:45.948605 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 698/1391] 10.222.0.25 () {54 vars in 961 bytes} [Wed Sep 7 16:42:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:45.956024 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a6434-756e-4487-a9ba-fd6215871f74 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:45.956598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a6434-756e-4487-a9ba-fd6215871f74 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:45.957460 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a6434-756e-4487-a9ba-fd6215871f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:46.068167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-4f1a6434-756e-4487-a9ba-fd6215871f74 None None] MFA Rules not processed for user `52705fc64cd54b1985ef2cb02f6c47fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:46.069398 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4f1a6434-756e-4487-a9ba-fd6215871f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:46.171499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:46.179797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 694/1392] 10.222.0.25 () {58 vars in 1058 bytes} [Wed Sep 7 16:42:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:42:46.196548 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4c52d-c400-4c95-83cc-7cf056c0b49e None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:42:46.198653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-afa4c52d-c400-4c95-83cc-7cf056c0b49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:46.328983 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4c52d-c400-4c95-83cc-7cf056c0b49e None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:42:46.387770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:46.441479 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d265cd1-1900-4104-9a16-9095bf93ffaf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52705fc64cd54b1985ef2cb02f6c47fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:42:46.442991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d265cd1-1900-4104-9a16-9095bf93ffaf service glance] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:46.443449 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d265cd1-1900-4104-9a16-9095bf93ffaf service glance] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:46.443841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d265cd1-1900-4104-9a16-9095bf93ffaf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:46.446363 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1d265cd1-1900-4104-9a16-9095bf93ffaf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:46.606991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d265cd1-1900-4104-9a16-9095bf93ffaf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:42:46.608491 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d265cd1-1900-4104-9a16-9095bf93ffaf service glance] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:42:46.635220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 699/1393] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:42:47.307889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e882b9-4ef5-41c1-87aa-77fb2affc5a9 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:47.308473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e882b9-4ef5-41c1-87aa-77fb2affc5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:47.308473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e882b9-4ef5-41c1-87aa-77fb2affc5a9 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:47.309995 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 695/1394] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:47.316748 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed7a62-48a6-48dd-886d-cd9365a2bb25 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:47.316748 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed7a62-48a6-48dd-886d-cd9365a2bb25 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:47.318100 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed7a62-48a6-48dd-886d-cd9365a2bb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:47.401151 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-d7ed7a62-48a6-48dd-886d-cd9365a2bb25 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:47.404056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-d7ed7a62-48a6-48dd-886d-cd9365a2bb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:47.431918 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:47.564844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 700/1395] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:42:47.871892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e882b9-4ef5-41c1-87aa-77fb2affc5a9 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:42:47.873546 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c4e882b9-4ef5-41c1-87aa-77fb2affc5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:47.956870 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508acfb-3f0d-4949-8f8f-44b2fac4b631 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:47.957133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508acfb-3f0d-4949-8f8f-44b2fac4b631 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:47.958823 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508acfb-3f0d-4949-8f8f-44b2fac4b631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:48.046542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f508acfb-3f0d-4949-8f8f-44b2fac4b631 None None] MFA Rules not processed for user `87ba67fc171b4258b6fda72094ed11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:48.047800 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f508acfb-3f0d-4949-8f8f-44b2fac4b631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:48.069825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e882b9-4ef5-41c1-87aa-77fb2affc5a9 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:42:48.151501 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 701/1396] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Sep 7 16:42:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:42:48.163340 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:48.206932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24529a6a-c83e-4c81-94ec-51dcb142071b None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:48.208018 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24529a6a-c83e-4c81-94ec-51dcb142071b None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:48.208506 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24529a6a-c83e-4c81-94ec-51dcb142071b None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:48.211158 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 702/1397] 10.222.0.25 () {54 vars in 943 bytes} [Wed Sep 7 16:42:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:48.219918 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723c2c3-bf24-42d7-8006-f45132c72bb9 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:48.220440 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723c2c3-bf24-42d7-8006-f45132c72bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:48.220957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723c2c3-bf24-42d7-8006-f45132c72bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:48.224270 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e1e50-3c30-414f-8995-21551d1ab349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:42:48.224885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e1e50-3c30-414f-8995-21551d1ab349 service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:48.225164 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e1e50-3c30-414f-8995-21551d1ab349 service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:48.225434 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e1e50-3c30-414f-8995-21551d1ab349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:48.227063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-da2e1e50-3c30-414f-8995-21551d1ab349 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:48.242537 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:48.323574 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8723c2c3-bf24-42d7-8006-f45132c72bb9 None None] MFA Rules not processed for user `56cd868e866d436aa1d601f7791e812c`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:48.324795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8723c2c3-bf24-42d7-8006-f45132c72bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:48.329982 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e1e50-3c30-414f-8995-21551d1ab349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:42:48.333180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e1e50-3c30-414f-8995-21551d1ab349 service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:42:48.360496 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 696/1398] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:42:48.448685 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 703/1399] 10.222.0.25 () {58 vars in 1040 bytes} [Wed Sep 7 16:42:48 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:42:48.458979 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e1e50-3c30-414f-8995-21551d1ab349 service nova] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:42:48.461349 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-da2e1e50-3c30-414f-8995-21551d1ab349 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:48.562272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:48.566725 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e1e50-3c30-414f-8995-21551d1ab349 service nova] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:42:48.710026 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0985b-cdd2-4448-8336-4a61ba355339 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56cd868e866d436aa1d601f7791e812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:42:48.710565 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0985b-cdd2-4448-8336-4a61ba355339 service swift] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:48.710847 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0985b-cdd2-4448-8336-4a61ba355339 service swift] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:48.711122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0985b-cdd2-4448-8336-4a61ba355339 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:48.712926 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-fbc0985b-cdd2-4448-8336-4a61ba355339 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:48.834876 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0985b-cdd2-4448-8336-4a61ba355339 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:42:48.836527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0985b-cdd2-4448-8336-4a61ba355339 service swift] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:42:48.845457 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 697/1400] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Sep 7 16:42:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:42:51.055639 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fe6f1-dc99-4b64-ac9d-ef940cef535c None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:51.056292 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fe6f1-dc99-4b64-ac9d-ef940cef535c None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:51.056292 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fe6f1-dc99-4b64-ac9d-ef940cef535c None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:51.057529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 704/1401] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:51.063229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8c0b9-271a-4022-a881-ea2a3d589a14 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:51.063793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8c0b9-271a-4022-a881-ea2a3d589a14 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:51.063793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8c0b9-271a-4022-a881-ea2a3d589a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:51.111779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:51.146084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-c8f8c0b9-271a-4022-a881-ea2a3d589a14 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:51.147308 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c8f8c0b9-271a-4022-a881-ea2a3d589a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:51.277787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 698/1402] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:42:51.575826 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fe6f1-dc99-4b64-ac9d-ef940cef535c None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:42:51.577639 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-114fe6f1-dc99-4b64-ac9d-ef940cef535c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:51.694406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:51.839990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fe6f1-dc99-4b64-ac9d-ef940cef535c None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:42:52.016790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ca7ac-6c65-481e-9837-e7a2461a11a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:42:52.017421 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ca7ac-6c65-481e-9837-e7a2461a11a8 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:52.017697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ca7ac-6c65-481e-9837-e7a2461a11a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:52.017972 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ca7ac-6c65-481e-9837-e7a2461a11a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:52.020397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2c5ca7ac-6c65-481e-9837-e7a2461a11a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:52.080199 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:52.167096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ca7ac-6c65-481e-9837-e7a2461a11a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:42:52.167096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ca7ac-6c65-481e-9837-e7a2461a11a8 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:42:52.186732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 705/1403] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:42:55.382943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a1755-ff35-4cb2-a736-3a9c4dba1f84 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:55.383537 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a1755-ff35-4cb2-a736-3a9c4dba1f84 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:55.383932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a1755-ff35-4cb2-a736-3a9c4dba1f84 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:55.386717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 699/1404] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:42:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:42:55.396601 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4d673-9d54-4013-9626-562ae01c768f None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:55.397836 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4d673-9d54-4013-9626-562ae01c768f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:55.398638 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4d673-9d54-4013-9626-562ae01c768f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:55.512472 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-1fc4d673-9d54-4013-9626-562ae01c768f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:55.513743 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1fc4d673-9d54-4013-9626-562ae01c768f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:55.671433 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 706/1405] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:42:55.985576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a1755-ff35-4cb2-a736-3a9c4dba1f84 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:42:55.987149 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-551a1755-ff35-4cb2-a736-3a9c4dba1f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:56.163230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:56.258304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a1755-ff35-4cb2-a736-3a9c4dba1f84 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:42:56.402491 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910abcb-3b3d-4e17-bc71-fd6d94839d30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:42:56.403318 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910abcb-3b3d-4e17-bc71-fd6d94839d30 service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:56.403318 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910abcb-3b3d-4e17-bc71-fd6d94839d30 service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:56.403318 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910abcb-3b3d-4e17-bc71-fd6d94839d30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:56.406757 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1910abcb-3b3d-4e17-bc71-fd6d94839d30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:56.528343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910abcb-3b3d-4e17-bc71-fd6d94839d30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:42:56.529902 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910abcb-3b3d-4e17-bc71-fd6d94839d30 service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:42:56.549536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:56.553868 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 700/1406] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:42:59.149449 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d369609-c91f-4cb7-8d36-5454bb78d7d5 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:59.150051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d369609-c91f-4cb7-8d36-5454bb78d7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:59.150051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d369609-c91f-4cb7-8d36-5454bb78d7d5 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:59.151314 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 707/1407] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:42:59.156995 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56b267-6f3a-4c49-bdb7-3552e04215f8 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:42:59.157436 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56b267-6f3a-4c49-bdb7-3552e04215f8 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:42:59.157584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56b267-6f3a-4c49-bdb7-3552e04215f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:42:59.249571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-0a56b267-6f3a-4c49-bdb7-3552e04215f8 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:42:59.250916 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0a56b267-6f3a-4c49-bdb7-3552e04215f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:59.378021 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 701/1408] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:42:59.707585 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d369609-c91f-4cb7-8d36-5454bb78d7d5 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:42:59.709898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-0d369609-c91f-4cb7-8d36-5454bb78d7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:42:59.723991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:42:59.909415 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d369609-c91f-4cb7-8d36-5454bb78d7d5 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:00.012829 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:00.063893 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced000f-a322-40d7-af14-4fdbea6091a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:00.065339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced000f-a322-40d7-af14-4fdbea6091a7 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:00.065612 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced000f-a322-40d7-af14-4fdbea6091a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:00.065934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced000f-a322-40d7-af14-4fdbea6091a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:00.067861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9ced000f-a322-40d7-af14-4fdbea6091a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:00.188145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced000f-a322-40d7-af14-4fdbea6091a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:00.190818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced000f-a322-40d7-af14-4fdbea6091a7 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:00.211548 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 708/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:42:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:43:09.375935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=79 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:10.208905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=58 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:14.461718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4804ca-187c-4f16-ab14-2a4f9213b177 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:14.462330 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4804ca-187c-4f16-ab14-2a4f9213b177 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:14.462330 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4804ca-187c-4f16-ab14-2a4f9213b177 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:14.463640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 702/1410] 10.222.0.25 () {54 vars in 918 bytes} [Wed Sep 7 16:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:43:14.469052 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ad203-d6ca-4441-89c1-c6037c4d82cc None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:14.469534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ad203-d6ca-4441-89c1-c6037c4d82cc None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:14.469648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ad203-d6ca-4441-89c1-c6037c4d82cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:14.552587 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f57ad203-d6ca-4441-89c1-c6037c4d82cc None None] MFA Rules not processed for user `256e8478e5fb4c01acde0d597bae0b53`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:14.553862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f57ad203-d6ca-4441-89c1-c6037c4d82cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:14.665751 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 709/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Sep 7 16:43:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:43:14.680889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617ca6c-def3-42a9-99ec-af777fd65a87 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:14.681167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617ca6c-def3-42a9-99ec-af777fd65a87 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:14.681483 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617ca6c-def3-42a9-99ec-af777fd65a87 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:14.682804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 703/1412] 10.222.0.25 () {54 vars in 918 bytes} [Wed Sep 7 16:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:14.688593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1081ea4-0318-4f07-b1e6-8eba3022ba63 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:14.688885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1081ea4-0318-4f07-b1e6-8eba3022ba63 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:14.689409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1081ea4-0318-4f07-b1e6-8eba3022ba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:14.770698 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:14.773468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-d1081ea4-0318-4f07-b1e6-8eba3022ba63 None None] MFA Rules not processed for user `cf48978c20f04173b114e15e1ce2157c`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:14.774688 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-d1081ea4-0318-4f07-b1e6-8eba3022ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:14.899057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 710/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Sep 7 16:43:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:17.534895 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101a7b4-7712-4423-988c-239db36d264e None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:17.535505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101a7b4-7712-4423-988c-239db36d264e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:17.535505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101a7b4-7712-4423-988c-239db36d264e None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:17.536785 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:17.542234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76d34c-8f75-4499-b86c-d74a1c6b013c None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:17.542673 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76d34c-8f75-4499-b86c-d74a1c6b013c None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:17.542786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76d34c-8f75-4499-b86c-d74a1c6b013c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:17.615727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8f76d34c-8f75-4499-b86c-d74a1c6b013c None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:17.616925 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8f76d34c-8f75-4499-b86c-d74a1c6b013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:17.672568 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:17.715463 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:18.010996 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101a7b4-7712-4423-988c-239db36d264e None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:43:18.012586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-9101a7b4-7712-4423-988c-239db36d264e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:18.164556 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101a7b4-7712-4423-988c-239db36d264e None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:18.242406 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:18.285463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfe186-b358-4434-b004-345d68018632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:18.286056 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfe186-b358-4434-b004-345d68018632 service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:18.286338 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfe186-b358-4434-b004-345d68018632 service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:18.286611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfe186-b358-4434-b004-345d68018632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:18.288279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4bcfe186-b358-4434-b004-345d68018632 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:18.379841 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfe186-b358-4434-b004-345d68018632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:18.381515 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfe186-b358-4434-b004-345d68018632 service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:18.401418 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 705/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:43:19.580664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00b65-3354-451a-88ce-1b275b86486c None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:19.581294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00b65-3354-451a-88ce-1b275b86486c None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:19.581294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00b65-3354-451a-88ce-1b275b86486c None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:19.582618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:19.589161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f5566-69e9-4201-9eaf-46947074499c None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:19.589657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f5566-69e9-4201-9eaf-46947074499c None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:19.589766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f5566-69e9-4201-9eaf-46947074499c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:19.672242 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-2b8f5566-69e9-4201-9eaf-46947074499c None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:19.673471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2b8f5566-69e9-4201-9eaf-46947074499c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:19.702773 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:19.777377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:19.931403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc00b65-3354-451a-88ce-1b275b86486c None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:43:19.932885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9cc00b65-3354-451a-88ce-1b275b86486c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:20.084309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc00b65-3354-451a-88ce-1b275b86486c None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:20.126270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:20.201848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237fb59-d15e-4b42-8af0-338ed00cbcc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:20.202371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237fb59-d15e-4b42-8af0-338ed00cbcc0 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:20.202649 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237fb59-d15e-4b42-8af0-338ed00cbcc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:20.202922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237fb59-d15e-4b42-8af0-338ed00cbcc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:20.204641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2237fb59-d15e-4b42-8af0-338ed00cbcc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:20.298316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237fb59-d15e-4b42-8af0-338ed00cbcc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:20.300961 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237fb59-d15e-4b42-8af0-338ed00cbcc0 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:20.320608 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 713/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:43:21.492886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f542a0f-a56e-4c6e-b810-f29274ed31a3 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:21.493427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f542a0f-a56e-4c6e-b810-f29274ed31a3 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:21.493427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f542a0f-a56e-4c6e-b810-f29274ed31a3 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:21.494762 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:21.501275 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92d486-1b55-4ee1-b339-66908cf16158 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:21.501835 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92d486-1b55-4ee1-b339-66908cf16158 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:21.501934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92d486-1b55-4ee1-b339-66908cf16158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:21.557995 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:21.581396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-4b92d486-1b55-4ee1-b339-66908cf16158 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:21.582672 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-4b92d486-1b55-4ee1-b339-66908cf16158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:21.687198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:21.849598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f542a0f-a56e-4c6e-b810-f29274ed31a3 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:43:21.851038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-7f542a0f-a56e-4c6e-b810-f29274ed31a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:22.002164 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f542a0f-a56e-4c6e-b810-f29274ed31a3 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:22.014599 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:22.124299 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2594a0e-759e-4a01-947c-4764c9e901bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:22.124829 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2594a0e-759e-4a01-947c-4764c9e901bd service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:22.125109 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2594a0e-759e-4a01-947c-4764c9e901bd service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:22.125378 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2594a0e-759e-4a01-947c-4764c9e901bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:22.128107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b2594a0e-759e-4a01-947c-4764c9e901bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:22.226194 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2594a0e-759e-4a01-947c-4764c9e901bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:22.227815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2594a0e-759e-4a01-947c-4764c9e901bd service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:22.245639 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 708/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:43:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:43:23.381120 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b824b39-5c13-4da3-a486-9d8643c9c413 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:23.382001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b824b39-5c13-4da3-a486-9d8643c9c413 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:23.382168 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b824b39-5c13-4da3-a486-9d8643c9c413 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:23.383590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:43:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:23.390070 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cf032-20bf-412d-9548-14efaf9fb1aa None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:23.390600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cf032-20bf-412d-9548-14efaf9fb1aa None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:23.390600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cf032-20bf-412d-9548-14efaf9fb1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:23.411966 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:23.474410 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-7e9cf032-20bf-412d-9548-14efaf9fb1aa None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:23.475627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-7e9cf032-20bf-412d-9548-14efaf9fb1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:23.579310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:23.732967 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b824b39-5c13-4da3-a486-9d8643c9c413 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:43:23.734360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3b824b39-5c13-4da3-a486-9d8643c9c413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:23.848357 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:23.886813 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b824b39-5c13-4da3-a486-9d8643c9c413 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:24.006947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7b026-9ead-46e3-b6cc-2fdf81f41c10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:24.007579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7b026-9ead-46e3-b6cc-2fdf81f41c10 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:24.007896 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7b026-9ead-46e3-b6cc-2fdf81f41c10 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:24.008128 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7b026-9ead-46e3-b6cc-2fdf81f41c10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:24.009732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-feb7b026-9ead-46e3-b6cc-2fdf81f41c10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:24.089967 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:24.103827 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7b026-9ead-46e3-b6cc-2fdf81f41c10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:24.105418 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7b026-9ead-46e3-b6cc-2fdf81f41c10 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:24.124333 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 716/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:43:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:43:25.281657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc18d5-5b53-4f20-8372-04ba182be99b None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:25.282208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc18d5-5b53-4f20-8372-04ba182be99b None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:25.282208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc18d5-5b53-4f20-8372-04ba182be99b None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:25.284416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:25.290810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de7620-e192-4f82-b76d-c5871f8f3fed None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:25.291291 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de7620-e192-4f82-b76d-c5871f8f3fed None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:25.291415 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de7620-e192-4f82-b76d-c5871f8f3fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:25.370607 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-c5de7620-e192-4f82-b76d-c5871f8f3fed None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:25.371883 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c5de7620-e192-4f82-b76d-c5871f8f3fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:25.473469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:25.625941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc18d5-5b53-4f20-8372-04ba182be99b None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:43:25.627497 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-92fc18d5-5b53-4f20-8372-04ba182be99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:25.716398 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:25.779717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc18d5-5b53-4f20-8372-04ba182be99b None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:25.897356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad18c17-082d-4709-b717-b5fef5354817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:25.897966 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad18c17-082d-4709-b717-b5fef5354817 service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:25.898242 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad18c17-082d-4709-b717-b5fef5354817 service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:25.898512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad18c17-082d-4709-b717-b5fef5354817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:25.900227 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-bad18c17-082d-4709-b717-b5fef5354817 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:25.952448 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:25.994520 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad18c17-082d-4709-b717-b5fef5354817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:25.996194 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad18c17-082d-4709-b717-b5fef5354817 service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:26.015762 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 711/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:43:27.213710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d970e-003e-4c73-a4be-eb7b6899de67 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:27.214209 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d970e-003e-4c73-a4be-eb7b6899de67 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:27.214329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d970e-003e-4c73-a4be-eb7b6899de67 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:27.215661 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:27.222074 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a43fb-7706-469d-bf91-ff3feb212796 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:27.222591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a43fb-7706-469d-bf91-ff3feb212796 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:27.222591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a43fb-7706-469d-bf91-ff3feb212796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:27.299226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-441a43fb-7706-469d-bf91-ff3feb212796 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:27.300464 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-441a43fb-7706-469d-bf91-ff3feb212796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:27.398727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:27.552810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d970e-003e-4c73-a4be-eb7b6899de67 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:43:27.554364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-030d970e-003e-4c73-a4be-eb7b6899de67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:27.604643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:27.706629 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d970e-003e-4c73-a4be-eb7b6899de67 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:27.820627 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e57461-e70c-40e5-a8fc-ffdcc42d5e7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:27.821161 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e57461-e70c-40e5-a8fc-ffdcc42d5e7f service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:27.821434 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e57461-e70c-40e5-a8fc-ffdcc42d5e7f service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:27.821702 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e57461-e70c-40e5-a8fc-ffdcc42d5e7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:27.823401 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c3e57461-e70c-40e5-a8fc-ffdcc42d5e7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:27.831484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:27.916319 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e57461-e70c-40e5-a8fc-ffdcc42d5e7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:27.917922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e57461-e70c-40e5-a8fc-ffdcc42d5e7f service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:27.936848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 719/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:43:29.106063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f64ea-8b3e-4196-9be4-ed01645b6b1c None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:29.106671 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f64ea-8b3e-4196-9be4-ed01645b6b1c None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:29.106671 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f64ea-8b3e-4196-9be4-ed01645b6b1c None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:29.107968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:29.114555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff367ab-ed12-406f-9095-b9545703370b None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:29.115120 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff367ab-ed12-406f-9095-b9545703370b None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:29.115120 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff367ab-ed12-406f-9095-b9545703370b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:29.195572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-0ff367ab-ed12-406f-9095-b9545703370b None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:29.196828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-0ff367ab-ed12-406f-9095-b9545703370b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:29.266547 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:29.297148 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:29.449593 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f64ea-8b3e-4196-9be4-ed01645b6b1c None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:43:29.451052 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-352f64ea-8b3e-4196-9be4-ed01645b6b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:29.469575 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:29.607630 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f64ea-8b3e-4196-9be4-ed01645b6b1c None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:29.703981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:29.731150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed139c7-c266-44c3-a02e-f60c923ad2ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:29.731786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed139c7-c266-44c3-a02e-f60c923ad2ac service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:29.732108 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed139c7-c266-44c3-a02e-f60c923ad2ac service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:29.732627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed139c7-c266-44c3-a02e-f60c923ad2ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:29.734689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-fed139c7-c266-44c3-a02e-f60c923ad2ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:29.828594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed139c7-c266-44c3-a02e-f60c923ad2ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:29.830910 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed139c7-c266-44c3-a02e-f60c923ad2ac service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:29.851507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 714/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:43:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:43:31.006440 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2a6be-6120-438e-94f9-2a9402ce6374 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:31.007023 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2a6be-6120-438e-94f9-2a9402ce6374 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:31.007023 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2a6be-6120-438e-94f9-2a9402ce6374 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:31.008367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:31.014752 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390163bb-0e38-4830-945e-deee83b2c09b None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:31.018891 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390163bb-0e38-4830-945e-deee83b2c09b None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:31.018891 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390163bb-0e38-4830-945e-deee83b2c09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:31.092007 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-390163bb-0e38-4830-945e-deee83b2c09b None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:31.093209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-390163bb-0e38-4830-945e-deee83b2c09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:31.135669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:31.191761 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:31.342979 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2a6be-6120-438e-94f9-2a9402ce6374 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:43:31.344451 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-fda2a6be-6120-438e-94f9-2a9402ce6374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:31.494756 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2a6be-6120-438e-94f9-2a9402ce6374 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:31.551159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:31.616463 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d705663-831e-4037-99c1-aae04771a0d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:31.616976 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d705663-831e-4037-99c1-aae04771a0d4 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:31.617258 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d705663-831e-4037-99c1-aae04771a0d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:31.617532 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d705663-831e-4037-99c1-aae04771a0d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:31.619172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9d705663-831e-4037-99c1-aae04771a0d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:31.713543 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d705663-831e-4037-99c1-aae04771a0d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:31.715164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d705663-831e-4037-99c1-aae04771a0d4 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:31.734353 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 722/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:43:32.910785 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352498c-b4f6-456d-aba2-ce64b274f6b6 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:32.911315 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352498c-b4f6-456d-aba2-ce64b274f6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:32.911315 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352498c-b4f6-456d-aba2-ce64b274f6b6 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:32.912646 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:32.919197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f4583-0e7e-4eae-bcc4-cdabbea5ae59 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:32.919709 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f4583-0e7e-4eae-bcc4-cdabbea5ae59 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:32.919804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f4583-0e7e-4eae-bcc4-cdabbea5ae59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:33.116666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8f7f4583-0e7e-4eae-bcc4-cdabbea5ae59 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:33.117863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8f7f4583-0e7e-4eae-bcc4-cdabbea5ae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:33.119912 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:33.215231 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:33.370986 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352498c-b4f6-456d-aba2-ce64b274f6b6 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:43:33.372548 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a352498c-b4f6-456d-aba2-ce64b274f6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:33.526561 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352498c-b4f6-456d-aba2-ce64b274f6b6 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:33.555770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:33.644676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd0052-1292-430e-901b-d8332fa70997 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:33.645282 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd0052-1292-430e-901b-d8332fa70997 service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:33.645559 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd0052-1292-430e-901b-d8332fa70997 service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:33.645887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd0052-1292-430e-901b-d8332fa70997 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:33.647539 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-93cd0052-1292-430e-901b-d8332fa70997 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:33.740178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd0052-1292-430e-901b-d8332fa70997 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:33.741774 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd0052-1292-430e-901b-d8332fa70997 service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:33.760115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 717/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:43:35.953773 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a940e40-ef82-4568-bd06-388aa0086e9a None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:35.954946 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a940e40-ef82-4568-bd06-388aa0086e9a None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:35.955337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a940e40-ef82-4568-bd06-388aa0086e9a None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:35.956732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:35.962662 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6c889-9963-4d91-9819-35e7c6802646 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:35.963195 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6c889-9963-4d91-9819-35e7c6802646 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:35.963339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6c889-9963-4d91-9819-35e7c6802646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:36.007290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:36.033871 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-6ad6c889-9963-4d91-9819-35e7c6802646 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:36.035271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-6ad6c889-9963-4d91-9819-35e7c6802646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:36.137304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:36.425119 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a940e40-ef82-4568-bd06-388aa0086e9a None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:43:36.426640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-0a940e40-ef82-4568-bd06-388aa0086e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:36.533699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a940e40-ef82-4568-bd06-388aa0086e9a None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:36.569138 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:36.613641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92476e1-d8ab-41cd-a5b0-4801102dae82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:36.614244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92476e1-d8ab-41cd-a5b0-4801102dae82 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:36.614524 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92476e1-d8ab-41cd-a5b0-4801102dae82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:36.614790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92476e1-d8ab-41cd-a5b0-4801102dae82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:36.616483 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b92476e1-d8ab-41cd-a5b0-4801102dae82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:36.730930 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92476e1-d8ab-41cd-a5b0-4801102dae82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:36.732414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92476e1-d8ab-41cd-a5b0-4801102dae82 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:36.752316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 725/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:43:39.145022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2530a-235c-47a4-93f4-bc1ce8e040d5 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:39.145676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2530a-235c-47a4-93f4-bc1ce8e040d5 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:39.145676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2530a-235c-47a4-93f4-bc1ce8e040d5 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:39.146968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:39.152429 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776168a1-51d4-45a7-b8b1-c6ef848dc49d None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:39.152897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776168a1-51d4-45a7-b8b1-c6ef848dc49d None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:39.153006 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776168a1-51d4-45a7-b8b1-c6ef848dc49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:39.221171 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-776168a1-51d4-45a7-b8b1-c6ef848dc49d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:39.222366 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-776168a1-51d4-45a7-b8b1-c6ef848dc49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:39.235184 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:39.319195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:39.621997 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2530a-235c-47a4-93f4-bc1ce8e040d5 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:43:39.623630 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-98a2530a-235c-47a4-93f4-bc1ce8e040d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:39.733326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2530a-235c-47a4-93f4-bc1ce8e040d5 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:39.746481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:39.814170 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6647b-5310-4eff-bf44-796c2d96301f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:39.814852 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6647b-5310-4eff-bf44-796c2d96301f service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:39.815046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6647b-5310-4eff-bf44-796c2d96301f service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:39.815306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6647b-5310-4eff-bf44-796c2d96301f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:39.816937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-69d6647b-5310-4eff-bf44-796c2d96301f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:39.932443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6647b-5310-4eff-bf44-796c2d96301f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:39.933888 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6647b-5310-4eff-bf44-796c2d96301f service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:39.952175 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 720/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:43:42.509054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727a7e9-d3c4-4cb1-8638-4f72269249c9 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:42.509543 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727a7e9-d3c4-4cb1-8638-4f72269249c9 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:42.509710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727a7e9-d3c4-4cb1-8638-4f72269249c9 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:42.511144 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:42.516806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b774ca-7ca1-462e-b3ee-2abc3d267f60 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:42.517259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b774ca-7ca1-462e-b3ee-2abc3d267f60 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:42.517395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b774ca-7ca1-462e-b3ee-2abc3d267f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:42.565757 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:42.588207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-56b774ca-7ca1-462e-b3ee-2abc3d267f60 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:42.589523 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-56b774ca-7ca1-462e-b3ee-2abc3d267f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:42.696831 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:42.982979 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727a7e9-d3c4-4cb1-8638-4f72269249c9 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:43:42.985041 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e727a7e9-d3c4-4cb1-8638-4f72269249c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:43.088990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727a7e9-d3c4-4cb1-8638-4f72269249c9 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:43.129306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:43.163030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a9ee5-1715-4674-b703-175a046c6023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:43.163659 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a9ee5-1715-4674-b703-175a046c6023 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:43.163931 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a9ee5-1715-4674-b703-175a046c6023 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:43.164198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a9ee5-1715-4674-b703-175a046c6023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:43.165779 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-483a9ee5-1715-4674-b703-175a046c6023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:43.276887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a9ee5-1715-4674-b703-175a046c6023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:43.278347 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a9ee5-1715-4674-b703-175a046c6023 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:43.298187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 728/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:43:45.709994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121f24b-eb26-4938-be4e-497c174c4090 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:45.710546 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121f24b-eb26-4938-be4e-497c174c4090 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:45.710546 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121f24b-eb26-4938-be4e-497c174c4090 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:45.711932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:45.717327 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639892f6-0aa9-4623-b6b6-162aaad41fb9 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:45.717781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639892f6-0aa9-4623-b6b6-162aaad41fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:45.717897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639892f6-0aa9-4623-b6b6-162aaad41fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:45.788078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-639892f6-0aa9-4623-b6b6-162aaad41fb9 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:45.789252 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-639892f6-0aa9-4623-b6b6-162aaad41fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:45.810533 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:45.890185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:46.178883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121f24b-eb26-4938-be4e-497c174c4090 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:43:46.180467 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3121f24b-eb26-4938-be4e-497c174c4090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:46.290951 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121f24b-eb26-4938-be4e-497c174c4090 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:46.311458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:46.367259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe73315-0061-498c-b021-21aeb767e3fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:46.367936 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe73315-0061-498c-b021-21aeb767e3fd service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:46.368207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe73315-0061-498c-b021-21aeb767e3fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:46.368476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe73315-0061-498c-b021-21aeb767e3fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:46.370081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-abe73315-0061-498c-b021-21aeb767e3fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:46.486550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe73315-0061-498c-b021-21aeb767e3fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:46.487944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe73315-0061-498c-b021-21aeb767e3fd service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:46.507704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 723/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:43:48.798625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b90d6-ad76-49f7-b896-6a67f716da70 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:48.799225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b90d6-ad76-49f7-b896-6a67f716da70 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:48.799225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b90d6-ad76-49f7-b896-6a67f716da70 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:48.800581 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:48.806087 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406acc3-8283-43b7-8d11-5189b3b80837 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:48.806522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406acc3-8283-43b7-8d11-5189b3b80837 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:48.806634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406acc3-8283-43b7-8d11-5189b3b80837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:48.871925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:48.874663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-4406acc3-8283-43b7-8d11-5189b3b80837 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:48.876174 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4406acc3-8283-43b7-8d11-5189b3b80837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:48.991190 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:49.276729 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b90d6-ad76-49f7-b896-6a67f716da70 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:43:49.278267 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-617b90d6-ad76-49f7-b896-6a67f716da70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:49.384060 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b90d6-ad76-49f7-b896-6a67f716da70 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:49.438554 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:49.464297 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb68d67-58af-467d-bfce-24d8432cb6cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:49.464897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb68d67-58af-467d-bfce-24d8432cb6cd service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:49.465166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb68d67-58af-467d-bfce-24d8432cb6cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:49.465533 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb68d67-58af-467d-bfce-24d8432cb6cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:49.467013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9eb68d67-58af-467d-bfce-24d8432cb6cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:49.580478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb68d67-58af-467d-bfce-24d8432cb6cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:49.581841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb68d67-58af-467d-bfce-24d8432cb6cd service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:49.601315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 731/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:43:51.842907 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200529-9bc1-4261-b13f-9da5043abbc9 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:51.843559 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200529-9bc1-4261-b13f-9da5043abbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:51.843559 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78200529-9bc1-4261-b13f-9da5043abbc9 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:51.845507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:51.850979 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c923f-3710-4a1e-a8c9-878327b7e8de None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:51.851456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c923f-3710-4a1e-a8c9-878327b7e8de None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:51.851585 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c923f-3710-4a1e-a8c9-878327b7e8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:51.918881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-6a2c923f-3710-4a1e-a8c9-878327b7e8de None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:51.920056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-6a2c923f-3710-4a1e-a8c9-878327b7e8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:51.949652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:52.019581 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:52.308925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78200529-9bc1-4261-b13f-9da5043abbc9 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:43:52.310463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-78200529-9bc1-4261-b13f-9da5043abbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:52.432102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78200529-9bc1-4261-b13f-9da5043abbc9 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:52.465812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:52.517175 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3786d-00b7-48a1-8744-03655cd82328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:52.517795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3786d-00b7-48a1-8744-03655cd82328 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:52.518076 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3786d-00b7-48a1-8744-03655cd82328 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:52.518351 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3786d-00b7-48a1-8744-03655cd82328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:52.520032 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-44f3786d-00b7-48a1-8744-03655cd82328 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:52.634859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3786d-00b7-48a1-8744-03655cd82328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:52.636243 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3786d-00b7-48a1-8744-03655cd82328 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:52.655663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 726/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:43:54.916919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affe364-5f46-4ca7-8df9-88db7aed2539 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:54.917502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affe364-5f46-4ca7-8df9-88db7aed2539 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:54.917502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affe364-5f46-4ca7-8df9-88db7aed2539 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:54.918734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:54.924769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a958f69-eb86-4d6a-bed8-e5779464f158 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:54.925229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a958f69-eb86-4d6a-bed8-e5779464f158 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:54.925341 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a958f69-eb86-4d6a-bed8-e5779464f158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:54.993200 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-0a958f69-eb86-4d6a-bed8-e5779464f158 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:54.994425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0a958f69-eb86-4d6a-bed8-e5779464f158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:55.004213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:55.102224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:55.399966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affe364-5f46-4ca7-8df9-88db7aed2539 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:43:55.401516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-6affe364-5f46-4ca7-8df9-88db7aed2539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:55.509502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affe364-5f46-4ca7-8df9-88db7aed2539 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:55.565160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:55.585565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f971de-e9fd-4974-8fba-3b8822ca21fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:55.586175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f971de-e9fd-4974-8fba-3b8822ca21fb service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:55.586452 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f971de-e9fd-4974-8fba-3b8822ca21fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:55.586720 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f971de-e9fd-4974-8fba-3b8822ca21fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:55.588356 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-20f971de-e9fd-4974-8fba-3b8822ca21fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:55.704466 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f971de-e9fd-4974-8fba-3b8822ca21fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:55.705890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f971de-e9fd-4974-8fba-3b8822ca21fb service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:55.725474 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 734/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:43:57.990938 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc94971-370d-4863-bc3a-6c83e3705c28 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:57.991535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc94971-370d-4863-bc3a-6c83e3705c28 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:57.991535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc94971-370d-4863-bc3a-6c83e3705c28 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:57.992904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:43:57.998418 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f97773-ca81-445a-bc9d-3e049eed9e08 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:57.998873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f97773-ca81-445a-bc9d-3e049eed9e08 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:57.999009 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f97773-ca81-445a-bc9d-3e049eed9e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:58.070789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-75f97773-ca81-445a-bc9d-3e049eed9e08 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:43:58.072035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-75f97773-ca81-445a-bc9d-3e049eed9e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:58.112173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:58.169890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:43:58.456892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc94971-370d-4863-bc3a-6c83e3705c28 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:43:58.458523 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0cc94971-370d-4863-bc3a-6c83e3705c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:58.566231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc94971-370d-4863-bc3a-6c83e3705c28 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:43:58.604908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:43:58.641799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0534290-5917-4bd6-a24f-0b3cbbf893fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:43:58.642409 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0534290-5917-4bd6-a24f-0b3cbbf893fe service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:43:58.642683 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0534290-5917-4bd6-a24f-0b3cbbf893fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:43:58.642950 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0534290-5917-4bd6-a24f-0b3cbbf893fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:43:58.644597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-e0534290-5917-4bd6-a24f-0b3cbbf893fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:43:58.758247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0534290-5917-4bd6-a24f-0b3cbbf893fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:43:58.759740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0534290-5917-4bd6-a24f-0b3cbbf893fe service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:43:58.779130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 729/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:43:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:44:01.169402 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95835a0-c3aa-4bce-a90e-4353058092a4 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:01.169996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95835a0-c3aa-4bce-a90e-4353058092a4 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:01.169996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95835a0-c3aa-4bce-a90e-4353058092a4 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:01.171519 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:44:01.177077 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b58282-4721-47b3-ad29-46b183cd834c None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:01.177532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b58282-4721-47b3-ad29-46b183cd834c None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:01.177666 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b58282-4721-47b3-ad29-46b183cd834c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:01.244766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-83b58282-4721-47b3-ad29-46b183cd834c None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:44:01.245972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-83b58282-4721-47b3-ad29-46b183cd834c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:01.273892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:01.353219 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:44:01.647543 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95835a0-c3aa-4bce-a90e-4353058092a4 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:44:01.649082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a95835a0-c3aa-4bce-a90e-4353058092a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:01.759342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95835a0-c3aa-4bce-a90e-4353058092a4 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:44:01.830068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:01.837011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d391f-d75a-4c51-b45d-670c966fab7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:44:01.837614 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d391f-d75a-4c51-b45d-670c966fab7f service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:01.837896 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d391f-d75a-4c51-b45d-670c966fab7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:01.838167 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d391f-d75a-4c51-b45d-670c966fab7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:01.839793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-fe1d391f-d75a-4c51-b45d-670c966fab7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:01.951169 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d391f-d75a-4c51-b45d-670c966fab7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:44:01.953353 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d391f-d75a-4c51-b45d-670c966fab7f service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:44:01.972249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 737/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:44:04.260460 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6f61-a0f4-4005-a91b-2dbba6eb4f4a None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:04.261017 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6f61-a0f4-4005-a91b-2dbba6eb4f4a None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:04.261017 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6f61-a0f4-4005-a91b-2dbba6eb4f4a None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:04.262328 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:44:04.268769 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3cfbe-c540-49c5-8520-26c5b7cbe18d None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:04.269329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3cfbe-c540-49c5-8520-26c5b7cbe18d None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:04.269329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3cfbe-c540-49c5-8520-26c5b7cbe18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:04.345054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-6eb3cfbe-c540-49c5-8520-26c5b7cbe18d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:44:04.346293 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-6eb3cfbe-c540-49c5-8520-26c5b7cbe18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:04.398347 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:04.453408 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:44:04.736528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6f61-a0f4-4005-a91b-2dbba6eb4f4a None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:44:04.738097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-863b6f61-a0f4-4005-a91b-2dbba6eb4f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:04.845901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6f61-a0f4-4005-a91b-2dbba6eb4f4a None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:44:04.895291 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:04.922780 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7860a-03e2-4c1a-bffe-4847dbafa681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:44:04.923631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7860a-03e2-4c1a-bffe-4847dbafa681 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:04.923915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7860a-03e2-4c1a-bffe-4847dbafa681 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:04.924190 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7860a-03e2-4c1a-bffe-4847dbafa681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:04.925832 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-afe7860a-03e2-4c1a-bffe-4847dbafa681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:05.043488 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7860a-03e2-4c1a-bffe-4847dbafa681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:44:05.044980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7860a-03e2-4c1a-bffe-4847dbafa681 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:44:05.064897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 732/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:44:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:44:14.450932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=22 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:15.062407 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=66 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:25.525563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e90a65-070f-4006-9434-e4ba2fb5dc2b None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:25.526167 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e90a65-070f-4006-9434-e4ba2fb5dc2b None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:25.526167 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e90a65-070f-4006-9434-e4ba2fb5dc2b None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:25.527435 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 739/1471] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:44:25.534314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76de79-0559-4433-aa98-209a2ff7ba26 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:25.534795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76de79-0559-4433-aa98-209a2ff7ba26 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:25.534900 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76de79-0559-4433-aa98-209a2ff7ba26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:25.603868 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-0a76de79-0559-4433-aa98-209a2ff7ba26 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:44:25.605098 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0a76de79-0559-4433-aa98-209a2ff7ba26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:25.708128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 733/1472] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:44:26.018602 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb645d-9f59-4f6d-96e1-abcc2c2e0bbd None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:26.018878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb645d-9f59-4f6d-96e1-abcc2c2e0bbd None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:26.019146 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb645d-9f59-4f6d-96e1-abcc2c2e0bbd None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:26.020508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 740/1473] 10.222.0.25 () {54 vars in 961 bytes} [Wed Sep 7 16:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:44:26.025756 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3668f7-455b-422a-8039-e7153eddbd96 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:26.026041 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3668f7-455b-422a-8039-e7153eddbd96 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:26.026347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3668f7-455b-422a-8039-e7153eddbd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:26.106064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-df3668f7-455b-422a-8039-e7153eddbd96 None None] MFA Rules not processed for user `52705fc64cd54b1985ef2cb02f6c47fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:44:26.108018 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-df3668f7-455b-422a-8039-e7153eddbd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:26.129720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:26.189362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 734/1474] 10.222.0.25 () {58 vars in 1058 bytes} [Wed Sep 7 16:44:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:44:26.197397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb645d-9f59-4f6d-96e1-abcc2c2e0bbd None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:44:26.198945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a2fb645d-9f59-4f6d-96e1-abcc2c2e0bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:26.306628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb645d-9f59-4f6d-96e1-abcc2c2e0bbd None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:44:26.382019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f3c7b-d9cf-4971-b30a-a9333439099d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52705fc64cd54b1985ef2cb02f6c47fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:44:26.382618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f3c7b-d9cf-4971-b30a-a9333439099d service glance] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:26.382888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f3c7b-d9cf-4971-b30a-a9333439099d service glance] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:26.383156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f3c7b-d9cf-4971-b30a-a9333439099d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:26.384770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7e4f3c7b-d9cf-4971-b30a-a9333439099d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:26.443429 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:26.504782 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f3c7b-d9cf-4971-b30a-a9333439099d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:44:26.506211 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f3c7b-d9cf-4971-b30a-a9333439099d service glance] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:44:26.525927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 741/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:44:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:44:28.811104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269fa00-3370-49b6-92e8-9b555b9a9518 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:28.811809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269fa00-3370-49b6-92e8-9b555b9a9518 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:28.811809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269fa00-3370-49b6-92e8-9b555b9a9518 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:28.813120 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 735/1476] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:44:28.819073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a434db1-3156-4b39-aa19-c666c5e019b7 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:28.819582 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a434db1-3156-4b39-aa19-c666c5e019b7 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:28.819692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a434db1-3156-4b39-aa19-c666c5e019b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:28.884985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-5a434db1-3156-4b39-aa19-c666c5e019b7 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:44:28.886185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5a434db1-3156-4b39-aa19-c666c5e019b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:28.982643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 742/1477] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:44:29.253633 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269fa00-3370-49b6-92e8-9b555b9a9518 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:44:29.255168 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4269fa00-3370-49b6-92e8-9b555b9a9518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:29.381361 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269fa00-3370-49b6-92e8-9b555b9a9518 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:44:29.439243 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:29.484941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9f891-6ce8-421a-b8f3-b2ae0915fcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:44:29.485547 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9f891-6ce8-421a-b8f3-b2ae0915fcde admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:29.485821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9f891-6ce8-421a-b8f3-b2ae0915fcde admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:29.486089 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9f891-6ce8-421a-b8f3-b2ae0915fcde admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:29.486717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9f891-6ce8-421a-b8f3-b2ae0915fcde admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:44:29.488539 dv-cinder-847732-5-smb devstack@keystone.service[81877]: WARNING py.warnings [None req-2dd9f891-6ce8-421a-b8f3-b2ae0915fcde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:44:29.488539 dv-cinder-847732-5-smb devstack@keystone.service[81877]: warnings.warn(msg) Sep 07 16:44:29.488539 dv-cinder-847732-5-smb devstack@keystone.service[81877]: Sep 07 16:44:29.489677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9f891-6ce8-421a-b8f3-b2ae0915fcde admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:44:29.510283 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 736/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Sep 7 16:44:29 2022] GET /identity/v3/projects => generated 2553 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:44:31.749373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4605b7-545f-4f0a-b546-4b9cd983fbd0 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:31.750145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4605b7-545f-4f0a-b546-4b9cd983fbd0 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:31.750145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4605b7-545f-4f0a-b546-4b9cd983fbd0 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:31.751250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 743/1479] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:44:31.756695 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec25ed-4700-413c-83d5-64e3305a9eb2 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:31.757188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec25ed-4700-413c-83d5-64e3305a9eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:31.757290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec25ed-4700-413c-83d5-64e3305a9eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:31.829244 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-1eec25ed-4700-413c-83d5-64e3305a9eb2 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:44:31.830508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1eec25ed-4700-413c-83d5-64e3305a9eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:31.931303 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 737/1480] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:44:32.239230 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4605b7-545f-4f0a-b546-4b9cd983fbd0 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:44:32.240798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-dc4605b7-545f-4f0a-b546-4b9cd983fbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:32.250820 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:32.398483 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4605b7-545f-4f0a-b546-4b9cd983fbd0 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:44:32.513439 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:32.547369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5dab3-f29c-4524-8d09-ec53cd7ec750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:44:32.548002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5dab3-f29c-4524-8d09-ec53cd7ec750 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:32.548274 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5dab3-f29c-4524-8d09-ec53cd7ec750 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:32.548539 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5dab3-f29c-4524-8d09-ec53cd7ec750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:32.550129 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f7f5dab3-f29c-4524-8d09-ec53cd7ec750 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:32.646151 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5dab3-f29c-4524-8d09-ec53cd7ec750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:44:32.647780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5dab3-f29c-4524-8d09-ec53cd7ec750 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:44:32.668609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 744/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:44:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:44:35.064772 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbb38a-76d9-4cf9-892d-5b5c8178cbf4 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:35.065324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbb38a-76d9-4cf9-892d-5b5c8178cbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:35.065324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbb38a-76d9-4cf9-892d-5b5c8178cbf4 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:35.066686 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 738/1482] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:44:35.071980 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fcb48-b01b-46e9-8ed9-4a33f145e833 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:35.072410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fcb48-b01b-46e9-8ed9-4a33f145e833 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:35.072506 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fcb48-b01b-46e9-8ed9-4a33f145e833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:35.141778 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-798fcb48-b01b-46e9-8ed9-4a33f145e833 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:44:35.143000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-798fcb48-b01b-46e9-8ed9-4a33f145e833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:35.190205 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:35.242026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 745/1483] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:44:35.534033 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbb38a-76d9-4cf9-892d-5b5c8178cbf4 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:44:35.535603 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-8dcbb38a-76d9-4cf9-892d-5b5c8178cbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:35.560977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:35.648056 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbb38a-76d9-4cf9-892d-5b5c8178cbf4 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:44:35.730117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523bc10-358d-4ec6-aaea-80802b85cc5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:44:35.730740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523bc10-358d-4ec6-aaea-80802b85cc5b service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:35.731013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523bc10-358d-4ec6-aaea-80802b85cc5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:35.731276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523bc10-358d-4ec6-aaea-80802b85cc5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:35.733139 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-7523bc10-358d-4ec6-aaea-80802b85cc5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:35.811568 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:35.851429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523bc10-358d-4ec6-aaea-80802b85cc5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:44:35.852981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523bc10-358d-4ec6-aaea-80802b85cc5b service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:44:35.872388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 739/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:44:38.129271 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6afb1-66fe-4e38-b2c8-f18cf7daba09 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:38.129849 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6afb1-66fe-4e38-b2c8-f18cf7daba09 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:38.129849 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6afb1-66fe-4e38-b2c8-f18cf7daba09 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:38.131166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 746/1485] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:44:38.136730 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e5efb-96f6-45d4-afd4-e2b14007090b None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:38.137802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e5efb-96f6-45d4-afd4-e2b14007090b None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:38.137979 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e5efb-96f6-45d4-afd4-e2b14007090b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:38.204205 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-251e5efb-96f6-45d4-afd4-e2b14007090b None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:44:38.205408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-251e5efb-96f6-45d4-afd4-e2b14007090b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:38.302290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 740/1486] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:44:38.592687 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6afb1-66fe-4e38-b2c8-f18cf7daba09 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:44:38.594216 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9ca6afb1-66fe-4e38-b2c8-f18cf7daba09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:38.700485 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6afb1-66fe-4e38-b2c8-f18cf7daba09 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:44:38.774436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:38.776309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6983f3-7c93-4879-a3f1-5bae33d82d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:44:38.776922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6983f3-7c93-4879-a3f1-5bae33d82d07 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:38.777217 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6983f3-7c93-4879-a3f1-5bae33d82d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:38.777994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6983f3-7c93-4879-a3f1-5bae33d82d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:38.779775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3b6983f3-7c93-4879-a3f1-5bae33d82d07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:38.891939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6983f3-7c93-4879-a3f1-5bae33d82d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:44:38.893290 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6983f3-7c93-4879-a3f1-5bae33d82d07 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:44:38.912088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 747/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:44:41.207366 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71756d5a-2525-4307-87e4-a23109a42196 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:41.208111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71756d5a-2525-4307-87e4-a23109a42196 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:41.208111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71756d5a-2525-4307-87e4-a23109a42196 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:41.209445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 741/1488] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:44:41.216397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8031be8-6d04-4e2f-aef5-53adcad4c87c None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:41.216898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8031be8-6d04-4e2f-aef5-53adcad4c87c None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:41.217019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8031be8-6d04-4e2f-aef5-53adcad4c87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:41.304186 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-b8031be8-6d04-4e2f-aef5-53adcad4c87c None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:44:41.305437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b8031be8-6d04-4e2f-aef5-53adcad4c87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:41.365969 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:41.413271 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 748/1489] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:44:41.710128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71756d5a-2525-4307-87e4-a23109a42196 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:44:41.711824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-71756d5a-2525-4307-87e4-a23109a42196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:41.752633 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:41.831959 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71756d5a-2525-4307-87e4-a23109a42196 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:44:41.916455 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75e9d0-728d-4de6-ba2c-3507dd882206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:44:41.917071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75e9d0-728d-4de6-ba2c-3507dd882206 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:41.917349 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75e9d0-728d-4de6-ba2c-3507dd882206 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:41.917621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75e9d0-728d-4de6-ba2c-3507dd882206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:41.919409 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-af75e9d0-728d-4de6-ba2c-3507dd882206 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:42.014332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:42.049012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75e9d0-728d-4de6-ba2c-3507dd882206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:44:42.050476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75e9d0-728d-4de6-ba2c-3507dd882206 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:44:42.073097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 742/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:44:44.831086 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51617a3-5367-4de3-99db-a91c1d41e896 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:44.831710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51617a3-5367-4de3-99db-a91c1d41e896 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:44.831710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51617a3-5367-4de3-99db-a91c1d41e896 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:44.832981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 749/1491] 10.222.0.25 () {54 vars in 927 bytes} [Wed Sep 7 16:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:44:44.838395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a49b7f-e0c1-4275-acb1-fe5074e4807e None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:44.838819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a49b7f-e0c1-4275-acb1-fe5074e4807e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:44.838933 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a49b7f-e0c1-4275-acb1-fe5074e4807e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:44.908759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-c6a49b7f-e0c1-4275-acb1-fe5074e4807e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:44:44.909898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c6a49b7f-e0c1-4275-acb1-fe5074e4807e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:45.010330 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 743/1492] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Sep 7 16:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:44:45.320767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51617a3-5367-4de3-99db-a91c1d41e896 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:44:45.322309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e51617a3-5367-4de3-99db-a91c1d41e896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:45.432002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51617a3-5367-4de3-99db-a91c1d41e896 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:44:45.511244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7e912-6f9f-4a30-a1c7-2fe9aa749a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:44:45.519196 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7e912-6f9f-4a30-a1c7-2fe9aa749a69 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:44:45.519196 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7e912-6f9f-4a30-a1c7-2fe9aa749a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:44:45.519196 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7e912-6f9f-4a30-a1c7-2fe9aa749a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:44:45.519196 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-dde7e912-6f9f-4a30-a1c7-2fe9aa749a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:44:45.525097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:45.635093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7e912-6f9f-4a30-a1c7-2fe9aa749a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:44:45.636730 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7e912-6f9f-4a30-a1c7-2fe9aa749a69 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:44:45.655627 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 750/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:44:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:44:55.008448 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=82 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:44:55.653203 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=50 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:46:37.603919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858a0ef-5522-4269-a406-862527c80788 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:46:37.604561 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858a0ef-5522-4269-a406-862527c80788 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:46:37.604561 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858a0ef-5522-4269-a406-862527c80788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:46:37.693725 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-f858a0ef-5522-4269-a406-862527c80788 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:46:37.694955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f858a0ef-5522-4269-a406-862527c80788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:46:37.805326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 744/1494] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:46:37.813997 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f77156-5932-4ac9-970f-95057e66237f None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:46:37.819003 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f77156-5932-4ac9-970f-95057e66237f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:46:37.819003 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f77156-5932-4ac9-970f-95057e66237f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:46:37.835620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-95f77156-5932-4ac9-970f-95057e66237f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:46:37.836932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-95f77156-5932-4ac9-970f-95057e66237f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:46:37.845598 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 751/1495] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:46:37.850675 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858a0ef-5522-4269-a406-862527c80788 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:46:37.861586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858a0ef-5522-4269-a406-862527c80788 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:46:37.866193 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a93ffa-d917-4327-95e0-3878ed444b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:46:37.866834 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a93ffa-d917-4327-95e0-3878ed444b11 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:46:37.867116 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a93ffa-d917-4327-95e0-3878ed444b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:46:37.867386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a93ffa-d917-4327-95e0-3878ed444b11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:46:37.868664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a93ffa-d917-4327-95e0-3878ed444b11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:46:37.869631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a93ffa-d917-4327-95e0-3878ed444b11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:46:37.870687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: WARNING py.warnings [None req-82a93ffa-d917-4327-95e0-3878ed444b11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:46:37.870687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: warnings.warn(msg) Sep 07 16:46:37.870687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: Sep 07 16:46:37.871619 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a93ffa-d917-4327-95e0-3878ed444b11 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:46:37.884707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 745/1496] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:46:37.893638 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f77156-5932-4ac9-970f-95057e66237f None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:46:37.903994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f77156-5932-4ac9-970f-95057e66237f None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:46:37.908863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3ade6-a25b-4824-b4f5-c971f4f985e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:46:37.909470 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3ade6-a25b-4824-b4f5-c971f4f985e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:46:37.909752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3ade6-a25b-4824-b4f5-c971f4f985e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:46:37.910020 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3ade6-a25b-4824-b4f5-c971f4f985e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:46:37.910664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3ade6-a25b-4824-b4f5-c971f4f985e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:46:37.912459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: WARNING py.warnings [None req-d4e3ade6-a25b-4824-b4f5-c971f4f985e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:46:37.912459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: warnings.warn(msg) Sep 07 16:46:37.912459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: Sep 07 16:46:37.913650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3ade6-a25b-4824-b4f5-c971f4f985e7 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:46:38.022843 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 752/1497] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:46:37 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:46:38.027218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a93ffa-d917-4327-95e0-3878ed444b11 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:46:38.038314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a93ffa-d917-4327-95e0-3878ed444b11 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:46:38.092224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:46:38.099252 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3defa3b-eb0b-4591-80df-8d10ce77b4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:46:38.100031 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3defa3b-eb0b-4591-80df-8d10ce77b4be admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:46:38.100231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3defa3b-eb0b-4591-80df-8d10ce77b4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:46:38.100471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3defa3b-eb0b-4591-80df-8d10ce77b4be admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:46:38.101108 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3defa3b-eb0b-4591-80df-8d10ce77b4be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:46:38.102130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: WARNING py.warnings [None req-d3defa3b-eb0b-4591-80df-8d10ce77b4be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:46:38.102130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: warnings.warn(msg) Sep 07 16:46:38.102130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: Sep 07 16:46:38.104566 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3defa3b-eb0b-4591-80df-8d10ce77b4be admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:46:38.206457 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 746/1498] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:46:38 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:46:38.210800 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3ade6-a25b-4824-b4f5-c971f4f985e7 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:46:38.221295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3ade6-a25b-4824-b4f5-c971f4f985e7 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:46:38.226129 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859004f2-103c-45f9-8f97-5f1ddf440d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:46:38.226734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859004f2-103c-45f9-8f97-5f1ddf440d19 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:46:38.227102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859004f2-103c-45f9-8f97-5f1ddf440d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:46:38.227280 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859004f2-103c-45f9-8f97-5f1ddf440d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:46:38.228521 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859004f2-103c-45f9-8f97-5f1ddf440d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:46:38.231905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: WARNING py.warnings [None req-859004f2-103c-45f9-8f97-5f1ddf440d19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:46:38.231905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: warnings.warn(msg) Sep 07 16:46:38.231905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: Sep 07 16:46:38.231905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859004f2-103c-45f9-8f97-5f1ddf440d19 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:46:38.244183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 753/1499] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:46:38.248438 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3defa3b-eb0b-4591-80df-8d10ce77b4be admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:46:38.258954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3defa3b-eb0b-4591-80df-8d10ce77b4be admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:46:38.263721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1e167-594c-4cb9-972a-aab30f107b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:46:38.264331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e167-594c-4cb9-972a-aab30f107b18 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:46:38.264614 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e167-594c-4cb9-972a-aab30f107b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:46:38.264889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e167-594c-4cb9-972a-aab30f107b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:46:38.265561 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1e167-594c-4cb9-972a-aab30f107b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:46:38.266576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: WARNING py.warnings [None req-30d1e167-594c-4cb9-972a-aab30f107b18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:46:38.266576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: warnings.warn(msg) Sep 07 16:46:38.266576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: Sep 07 16:46:38.267456 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1e167-594c-4cb9-972a-aab30f107b18 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:46:38.281660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 747/1500] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:46:38.285980 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859004f2-103c-45f9-8f97-5f1ddf440d19 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:46:38.296865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859004f2-103c-45f9-8f97-5f1ddf440d19 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:46:38.301716 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cd6be-0d34-4037-99f2-a78d76739d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:46:38.302372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cd6be-0d34-4037-99f2-a78d76739d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:46:38.303213 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cd6be-0d34-4037-99f2-a78d76739d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:46:38.303213 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cd6be-0d34-4037-99f2-a78d76739d4d admin admin] PATH_INFO: `/v3/projects/7385ce3bb53346e7ad564f06367fd2f9/users/5836ab0d7d694bb8a9bf37410d72bdde/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:46:38.318883 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cd6be-0d34-4037-99f2-a78d76739d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7385ce3bb53346e7ad564f06367fd2f9, user_id=5836ab0d7d694bb8a9bf37410d72bdde, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:46:38.319944 dv-cinder-847732-5-smb devstack@keystone.service[81876]: WARNING py.warnings [None req-454cd6be-0d34-4037-99f2-a78d76739d4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:46:38.319944 dv-cinder-847732-5-smb devstack@keystone.service[81876]: warnings.warn(msg) Sep 07 16:46:38.319944 dv-cinder-847732-5-smb devstack@keystone.service[81876]: Sep 07 16:46:38.322139 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cd6be-0d34-4037-99f2-a78d76739d4d admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:46:38.393208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 754/1501] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:46:38 2022] PUT /identity/v3/projects/7385ce3bb53346e7ad564f06367fd2f9/users/5836ab0d7d694bb8a9bf37410d72bdde/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:46:38.406586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92cec2-84c4-45fd-b518-85312c9e3921 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:46:38.406866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92cec2-84c4-45fd-b518-85312c9e3921 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:46:38.407144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92cec2-84c4-45fd-b518-85312c9e3921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:46:38.438603 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-3c92cec2-84c4-45fd-b518-85312c9e3921 None None] MFA Rules not processed for user `5836ab0d7d694bb8a9bf37410d72bdde`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:46:38.439857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3c92cec2-84c4-45fd-b518-85312c9e3921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:46:38.507245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 748/1502] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:46:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:46:38.521102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232008e1-db13-432b-94b3-067f9d8d43ab None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:46:38.521380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232008e1-db13-432b-94b3-067f9d8d43ab None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:46:38.521647 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232008e1-db13-432b-94b3-067f9d8d43ab None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:46:38.522989 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 755/1503] 10.222.0.25 () {54 vars in 964 bytes} [Wed Sep 7 16:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:46:38.528279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466291a-35af-45ea-85e8-ee505a161819 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:46:38.528573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466291a-35af-45ea-85e8-ee505a161819 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:46:38.528854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466291a-35af-45ea-85e8-ee505a161819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:46:38.589970 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-1466291a-35af-45ea-85e8-ee505a161819 None None] MFA Rules not processed for user `73216eee250744bb9d9b81dd983376ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:46:38.591189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1466291a-35af-45ea-85e8-ee505a161819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:46:38.670227 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 749/1504] 10.222.0.25 () {58 vars in 1061 bytes} [Wed Sep 7 16:46:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:46:38.678624 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232008e1-db13-432b-94b3-067f9d8d43ab None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:46:38.689562 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232008e1-db13-432b-94b3-067f9d8d43ab None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:46:38.693517 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606b908-58ce-47f7-987a-b18b060c527c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:46:38.694118 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606b908-58ce-47f7-987a-b18b060c527c service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:46:38.694398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606b908-58ce-47f7-987a-b18b060c527c service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:46:38.694663 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606b908-58ce-47f7-987a-b18b060c527c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:46:38.703709 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606b908-58ce-47f7-987a-b18b060c527c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:46:38.705136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606b908-58ce-47f7-987a-b18b060c527c service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:46:38.715502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 756/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:46:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:46:38.765822 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4bf61-004c-42d7-ad97-9c92a4cc93ef None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:46:38.766104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4bf61-004c-42d7-ad97-9c92a4cc93ef None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:46:38.766379 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4bf61-004c-42d7-ad97-9c92a4cc93ef None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:46:38.767673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 750/1506] 10.222.0.25 () {52 vars in 830 bytes} [Wed Sep 7 16:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:46:38.771534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606b908-58ce-47f7-987a-b18b060c527c service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:46:38.835159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606b908-58ce-47f7-987a-b18b060c527c service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:46:38.840644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae47e83-87a4-4a61-9ed9-9aa44a1171b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:46:38.841288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae47e83-87a4-4a61-9ed9-9aa44a1171b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:46:38.841591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae47e83-87a4-4a61-9ed9-9aa44a1171b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:46:38.841866 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae47e83-87a4-4a61-9ed9-9aa44a1171b0 admin admin] PATH_INFO: `/v3/users/5836ab0d7d694bb8a9bf37410d72bdde` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:46:38.843029 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae47e83-87a4-4a61-9ed9-9aa44a1171b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5836ab0d7d694bb8a9bf37410d72bdde)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:46:38.844083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: WARNING py.warnings [None req-3ae47e83-87a4-4a61-9ed9-9aa44a1171b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:46:38.844083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: warnings.warn(msg) Sep 07 16:46:38.844083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: Sep 07 16:46:38.845287 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae47e83-87a4-4a61-9ed9-9aa44a1171b0 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:46:39.091803 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3ae47e83-87a4-4a61-9ed9-9aa44a1171b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5836ab0d7d694bb8a9bf37410d72bdde'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:46:39.165351 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3ae47e83-87a4-4a61-9ed9-9aa44a1171b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5836ab0d7d694bb8a9bf37410d72bdde'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:46:39.165988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3ae47e83-87a4-4a61-9ed9-9aa44a1171b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5836ab0d7d694bb8a9bf37410d72bdde'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:46:39.166852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3ae47e83-87a4-4a61-9ed9-9aa44a1171b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5836ab0d7d694bb8a9bf37410d72bdde'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:46:39.181744 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3ae47e83-87a4-4a61-9ed9-9aa44a1171b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5836ab0d7d694bb8a9bf37410d72bdde'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:46:39.203288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:46:39.211409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 757/1507] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:46:38 2022] DELETE /identity/v3/users/5836ab0d7d694bb8a9bf37410d72bdde => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:46:39.217226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc81284-825f-44c1-8c1b-2d7eeee4af46 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:46:39.217584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc81284-825f-44c1-8c1b-2d7eeee4af46 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:46:39.217975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc81284-825f-44c1-8c1b-2d7eeee4af46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:46:39.238795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-ddc81284-825f-44c1-8c1b-2d7eeee4af46 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:46:39.240092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ddc81284-825f-44c1-8c1b-2d7eeee4af46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:46:39.251214 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:46:39.309913 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 751/1508] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:46:39.321068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae47e83-87a4-4a61-9ed9-9aa44a1171b0 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:46:39.323673 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3ae47e83-87a4-4a61-9ed9-9aa44a1171b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:46:39.410457 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae47e83-87a4-4a61-9ed9-9aa44a1171b0 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:46:39.414136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d82e71-bc5b-4a4e-af85-ae2e6665a17b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:46:39.414762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d82e71-bc5b-4a4e-af85-ae2e6665a17b service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:46:39.415139 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d82e71-bc5b-4a4e-af85-ae2e6665a17b service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:46:39.415425 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d82e71-bc5b-4a4e-af85-ae2e6665a17b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:46:39.426191 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d82e71-bc5b-4a4e-af85-ae2e6665a17b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:46:39.427664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d82e71-bc5b-4a4e-af85-ae2e6665a17b service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:46:39.438897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 758/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:46:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:46:39.994603 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc81284-825f-44c1-8c1b-2d7eeee4af46 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:46:39.996443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ddc81284-825f-44c1-8c1b-2d7eeee4af46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:46:40.013388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc81284-825f-44c1-8c1b-2d7eeee4af46 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:46:40.016663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f0f04-5693-4b44-af1d-deb3abb4e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:46:40.017263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f0f04-5693-4b44-af1d-deb3abb4e13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:46:40.017553 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f0f04-5693-4b44-af1d-deb3abb4e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:46:40.017860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f0f04-5693-4b44-af1d-deb3abb4e13c admin admin] PATH_INFO: `/v3/projects/7385ce3bb53346e7ad564f06367fd2f9` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:46:40.019179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f0f04-5693-4b44-af1d-deb3abb4e13c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7385ce3bb53346e7ad564f06367fd2f9)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:46:40.020272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: WARNING py.warnings [None req-851f0f04-5693-4b44-af1d-deb3abb4e13c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:46:40.020272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: warnings.warn(msg) Sep 07 16:46:40.020272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: Sep 07 16:46:40.021487 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f0f04-5693-4b44-af1d-deb3abb4e13c admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:46:40.139589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-851f0f04-5693-4b44-af1d-deb3abb4e13c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7385ce3bb53346e7ad564f06367fd2f9', 'request_id': 'req-851f0f04-5693-4b44-af1d-deb3abb4e13c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:46:40.232021 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-851f0f04-5693-4b44-af1d-deb3abb4e13c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7385ce3bb53346e7ad564f06367fd2f9', 'request_id': 'req-851f0f04-5693-4b44-af1d-deb3abb4e13c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:46:40.366007 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-851f0f04-5693-4b44-af1d-deb3abb4e13c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7385ce3bb53346e7ad564f06367fd2f9', 'request_id': 'req-851f0f04-5693-4b44-af1d-deb3abb4e13c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:46:40.378177 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-851f0f04-5693-4b44-af1d-deb3abb4e13c admin admin] The token cache is being invalidate because project 7385ce3bb53346e7ad564f06367fd2f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:46:40.378467 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-851f0f04-5693-4b44-af1d-deb3abb4e13c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:46:40.379143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-851f0f04-5693-4b44-af1d-deb3abb4e13c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:46:40.380765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 752/1510] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:46:39 2022] DELETE /identity/v3/projects/7385ce3bb53346e7ad564f06367fd2f9 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:46:49.434363 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:46:50.374935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:48:12.333757 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76f8b2-20b6-4b3c-b5cb-21a3c3f911ad None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:12.334469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76f8b2-20b6-4b3c-b5cb-21a3c3f911ad None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:12.334469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76f8b2-20b6-4b3c-b5cb-21a3c3f911ad None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:12.336204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:48:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:48:12.341151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f002708-17b2-4316-9412-4959885c66c5 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:12.341611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f002708-17b2-4316-9412-4959885c66c5 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:12.341738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f002708-17b2-4316-9412-4959885c66c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:12.362991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-1f002708-17b2-4316-9412-4959885c66c5 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:48:12.363802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1f002708-17b2-4316-9412-4959885c66c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:48:12.432884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:48:12.589868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76f8b2-20b6-4b3c-b5cb-21a3c3f911ad None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:48:12.591742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8e76f8b2-20b6-4b3c-b5cb-21a3c3f911ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:48:12.696529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76f8b2-20b6-4b3c-b5cb-21a3c3f911ad None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:48:12.702078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db29007-ffd9-4ad9-9e31-71a3716c31a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:48:12.702690 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db29007-ffd9-4ad9-9e31-71a3716c31a1 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:12.702973 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db29007-ffd9-4ad9-9e31-71a3716c31a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:12.703236 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db29007-ffd9-4ad9-9e31-71a3716c31a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:12.712101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db29007-ffd9-4ad9-9e31-71a3716c31a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:48:12.713662 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db29007-ffd9-4ad9-9e31-71a3716c31a1 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:48:12.722994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 760/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:48:13.824503 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c8a8a-1b1d-4b74-9676-c9f9ebc66f60 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:13.825071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c8a8a-1b1d-4b74-9676-c9f9ebc66f60 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:13.825071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c8a8a-1b1d-4b74-9676-c9f9ebc66f60 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:13.826461 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:48:13.832919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e61e2-ea15-43b7-84e2-6a930c282b91 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:13.833330 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e61e2-ea15-43b7-84e2-6a930c282b91 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:13.833466 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e61e2-ea15-43b7-84e2-6a930c282b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:13.854013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-fc5e61e2-ea15-43b7-84e2-6a930c282b91 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:48:13.855219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-fc5e61e2-ea15-43b7-84e2-6a930c282b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:48:13.863076 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:48:14.020835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c8a8a-1b1d-4b74-9676-c9f9ebc66f60 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:48:14.035457 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c8a8a-1b1d-4b74-9676-c9f9ebc66f60 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:48:14.042039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b99c6a-d054-4c42-9350-58d7f41eb4ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:48:14.042727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b99c6a-d054-4c42-9350-58d7f41eb4ea service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:14.043008 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b99c6a-d054-4c42-9350-58d7f41eb4ea service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:14.043281 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b99c6a-d054-4c42-9350-58d7f41eb4ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:14.051770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b99c6a-d054-4c42-9350-58d7f41eb4ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:48:14.053351 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b99c6a-d054-4c42-9350-58d7f41eb4ea service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:48:14.066033 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 755/1516] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:48:14.477371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b71e7-2fa8-4379-8c28-85a05311719f None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:14.477371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b71e7-2fa8-4379-8c28-85a05311719f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:14.477371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b71e7-2fa8-4379-8c28-85a05311719f None None] PATH_INFO: `/v3` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:14.477371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 762/1517] 10.222.0.52 () {54 vars in 925 bytes} [Wed Sep 7 16:48:14 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:48:14.477976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c120c42-36f9-4f10-a575-8f0bfaaf8d5e None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:14.477976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c120c42-36f9-4f10-a575-8f0bfaaf8d5e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:14.477976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c120c42-36f9-4f10-a575-8f0bfaaf8d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:14.521771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-9c120c42-36f9-4f10-a575-8f0bfaaf8d5e None None] MFA Rules not processed for user `256e8478e5fb4c01acde0d597bae0b53`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:48:14.523626 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-9c120c42-36f9-4f10-a575-8f0bfaaf8d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:48:14.597270 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 756/1518] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Sep 7 16:48:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:48:18.403598 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827ea05-cdfe-4751-a6f8-d6af82a72500 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:18.404094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827ea05-cdfe-4751-a6f8-d6af82a72500 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:18.404226 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827ea05-cdfe-4751-a6f8-d6af82a72500 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:18.405551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 763/1519] 10.222.0.25 () {54 vars in 961 bytes} [Wed Sep 7 16:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:48:18.410663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc36385-82e0-4b72-b924-b472e825195a None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:18.412133 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc36385-82e0-4b72-b924-b472e825195a None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:18.412133 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc36385-82e0-4b72-b924-b472e825195a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:18.433715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-abc36385-82e0-4b72-b924-b472e825195a None None] MFA Rules not processed for user `256e8478e5fb4c01acde0d597bae0b53`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:48:18.434943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-abc36385-82e0-4b72-b924-b472e825195a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:48:18.443919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 757/1520] 10.222.0.25 () {58 vars in 1058 bytes} [Wed Sep 7 16:48:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:48:18.452971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827ea05-cdfe-4751-a6f8-d6af82a72500 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:48:18.468828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827ea05-cdfe-4751-a6f8-d6af82a72500 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:48:18.473985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4204b64-8f7e-4da3-9071-cc7cc87c7c58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256e8478e5fb4c01acde0d597bae0b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:48:18.475091 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4204b64-8f7e-4da3-9071-cc7cc87c7c58 service placement] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:18.475091 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4204b64-8f7e-4da3-9071-cc7cc87c7c58 service placement] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:18.475307 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4204b64-8f7e-4da3-9071-cc7cc87c7c58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:18.485002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4204b64-8f7e-4da3-9071-cc7cc87c7c58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:48:18.486673 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4204b64-8f7e-4da3-9071-cc7cc87c7c58 service placement] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:48:18.497602 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 764/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:48:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:48:25.595403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf3e97-e49b-4772-86d6-9caebb098819 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:25.595997 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf3e97-e49b-4772-86d6-9caebb098819 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:25.595997 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf3e97-e49b-4772-86d6-9caebb098819 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:25.597215 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:48:25.604044 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800abfd4-f967-4fa3-9748-635fca461ffd None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:25.604569 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800abfd4-f967-4fa3-9748-635fca461ffd None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:25.604569 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800abfd4-f967-4fa3-9748-635fca461ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:25.624796 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-800abfd4-f967-4fa3-9748-635fca461ffd None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:48:25.626003 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-800abfd4-f967-4fa3-9748-635fca461ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:48:25.634719 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:48:25.794977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf3e97-e49b-4772-86d6-9caebb098819 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:48:25.809557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf3e97-e49b-4772-86d6-9caebb098819 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:48:25.815142 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1e6cb-7af1-490e-8106-454ed5805ff6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:48:25.815787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1e6cb-7af1-490e-8106-454ed5805ff6 service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:25.816063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1e6cb-7af1-490e-8106-454ed5805ff6 service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:25.816332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1e6cb-7af1-490e-8106-454ed5805ff6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:25.825551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1e6cb-7af1-490e-8106-454ed5805ff6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:48:25.827144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1e6cb-7af1-490e-8106-454ed5805ff6 service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:48:25.838205 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 759/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:48:26.953340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278cda0-c532-45b0-8bb6-eac97dce64e2 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:26.953894 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278cda0-c532-45b0-8bb6-eac97dce64e2 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:26.953894 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278cda0-c532-45b0-8bb6-eac97dce64e2 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:26.955138 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:48:26.962413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d656f9-150f-40e6-a8cb-ff746529928c None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:26.962971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d656f9-150f-40e6-a8cb-ff746529928c None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:26.962971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d656f9-150f-40e6-a8cb-ff746529928c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:26.983245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-c5d656f9-150f-40e6-a8cb-ff746529928c None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:48:26.984534 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c5d656f9-150f-40e6-a8cb-ff746529928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:48:26.992913 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:48:27.154648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278cda0-c532-45b0-8bb6-eac97dce64e2 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:48:27.170085 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278cda0-c532-45b0-8bb6-eac97dce64e2 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:48:27.175404 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63d52b-6e04-4308-a64e-2fffe8732b22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:48:27.176029 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63d52b-6e04-4308-a64e-2fffe8732b22 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:27.176319 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63d52b-6e04-4308-a64e-2fffe8732b22 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:27.176567 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63d52b-6e04-4308-a64e-2fffe8732b22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:27.185082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63d52b-6e04-4308-a64e-2fffe8732b22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:48:27.186650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63d52b-6e04-4308-a64e-2fffe8732b22 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:48:27.196192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 767/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:48:31.271576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d79e6-15f7-4cb3-9d87-b8b20c27621a None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:31.272246 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d79e6-15f7-4cb3-9d87-b8b20c27621a None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:31.272246 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d79e6-15f7-4cb3-9d87-b8b20c27621a None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:31.274073 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:48:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:48:31.279336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cf76e-26b2-440b-bb3e-d5a3be575f59 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:31.279853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cf76e-26b2-440b-bb3e-d5a3be575f59 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:31.279960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cf76e-26b2-440b-bb3e-d5a3be575f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:31.299502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-4e1cf76e-26b2-440b-bb3e-d5a3be575f59 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:48:31.300697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-4e1cf76e-26b2-440b-bb3e-d5a3be575f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:48:31.309615 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:48:31.601200 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d79e6-15f7-4cb3-9d87-b8b20c27621a None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:48:31.602892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f40d79e6-15f7-4cb3-9d87-b8b20c27621a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:48:31.630283 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:48:31.660521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d79e6-15f7-4cb3-9d87-b8b20c27621a None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:48:31.665157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81ccf6-4ab4-46f0-8a41-9d46c36e9819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:48:31.666007 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81ccf6-4ab4-46f0-8a41-9d46c36e9819 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:31.666573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81ccf6-4ab4-46f0-8a41-9d46c36e9819 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:31.666853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81ccf6-4ab4-46f0-8a41-9d46c36e9819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:31.676608 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81ccf6-4ab4-46f0-8a41-9d46c36e9819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:48:31.678038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81ccf6-4ab4-46f0-8a41-9d46c36e9819 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:48:31.687851 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 762/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:48:33.876533 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca7792-c274-4b49-ae39-22df5bd8fd6f None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:33.877126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca7792-c274-4b49-ae39-22df5bd8fd6f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:33.877126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca7792-c274-4b49-ae39-22df5bd8fd6f None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:33.878483 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:48:33.884072 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdff782-3de2-4f25-a9cf-589177486e1d None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:33.884562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdff782-3de2-4f25-a9cf-589177486e1d None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:33.884670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdff782-3de2-4f25-a9cf-589177486e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:33.904684 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-5cdff782-3de2-4f25-a9cf-589177486e1d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:48:33.905913 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-5cdff782-3de2-4f25-a9cf-589177486e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:48:33.914615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:48:34.207195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca7792-c274-4b49-ae39-22df5bd8fd6f None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:48:34.218163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca7792-c274-4b49-ae39-22df5bd8fd6f None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:48:34.221641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d5f95-bfcb-4a22-8592-4573588dbe2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:48:34.222238 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d5f95-bfcb-4a22-8592-4573588dbe2b service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:34.222512 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d5f95-bfcb-4a22-8592-4573588dbe2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:34.222781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d5f95-bfcb-4a22-8592-4573588dbe2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:34.233444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d5f95-bfcb-4a22-8592-4573588dbe2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:48:34.234878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d5f95-bfcb-4a22-8592-4573588dbe2b service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:48:34.245307 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 770/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:48:37.760583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09d907-2f0e-4a17-8423-18b0c9c339aa None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:37.761197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09d907-2f0e-4a17-8423-18b0c9c339aa None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:37.761197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09d907-2f0e-4a17-8423-18b0c9c339aa None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:37.762449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:48:37.767789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f2ac0-3c84-47b2-8093-954efbabc6d5 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:37.768269 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f2ac0-3c84-47b2-8093-954efbabc6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:37.768385 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f2ac0-3c84-47b2-8093-954efbabc6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:37.788443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-4a3f2ac0-3c84-47b2-8093-954efbabc6d5 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:48:37.789644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-4a3f2ac0-3c84-47b2-8093-954efbabc6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:48:37.797761 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:48:38.102362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09d907-2f0e-4a17-8423-18b0c9c339aa None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:48:38.104070 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-6c09d907-2f0e-4a17-8423-18b0c9c339aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:48:38.161063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09d907-2f0e-4a17-8423-18b0c9c339aa None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:48:38.164779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae337071-12a2-4f71-aa0f-892dadf4fa1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:48:38.165377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae337071-12a2-4f71-aa0f-892dadf4fa1c service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:38.165654 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae337071-12a2-4f71-aa0f-892dadf4fa1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:38.165922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae337071-12a2-4f71-aa0f-892dadf4fa1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:38.174902 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae337071-12a2-4f71-aa0f-892dadf4fa1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:48:38.176358 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae337071-12a2-4f71-aa0f-892dadf4fa1c service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:48:38.185623 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 765/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:48:40.333196 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ddf2-7bd4-4d98-8a01-e1c655bf5be5 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:40.333769 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ddf2-7bd4-4d98-8a01-e1c655bf5be5 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:40.333769 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ddf2-7bd4-4d98-8a01-e1c655bf5be5 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:40.335112 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:48:40.340353 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a0bd7-6c27-42de-9bde-543ce746bb01 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:40.340788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a0bd7-6c27-42de-9bde-543ce746bb01 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:40.340941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a0bd7-6c27-42de-9bde-543ce746bb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:40.361862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-906a0bd7-6c27-42de-9bde-543ce746bb01 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:48:40.363061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-906a0bd7-6c27-42de-9bde-543ce746bb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:48:40.371573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:48:40.682657 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ddf2-7bd4-4d98-8a01-e1c655bf5be5 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:48:40.684384 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b593ddf2-7bd4-4d98-8a01-e1c655bf5be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:48:40.692395 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=77 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:48:40.699062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ddf2-7bd4-4d98-8a01-e1c655bf5be5 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:48:40.702695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61424817-1828-4aec-aa69-d72c850b2e84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:48:40.703294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61424817-1828-4aec-aa69-d72c850b2e84 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:48:40.703602 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61424817-1828-4aec-aa69-d72c850b2e84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:48:40.703880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61424817-1828-4aec-aa69-d72c850b2e84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:48:40.713436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61424817-1828-4aec-aa69-d72c850b2e84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:48:40.718971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61424817-1828-4aec-aa69-d72c850b2e84 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:48:40.724541 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 773/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:48:50.356971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=47 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:48:50.739734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=5 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:09.237484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb7971-7e45-4671-af1a-bbc29c43426d None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:09.238145 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb7971-7e45-4671-af1a-bbc29c43426d None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:09.238332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb7971-7e45-4671-af1a-bbc29c43426d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:09.287105 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-1bfb7971-7e45-4671-af1a-bbc29c43426d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:09.289051 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1bfb7971-7e45-4671-af1a-bbc29c43426d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:09.311234 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 767/1540] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:50:09.315078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626315da-c8be-4fb1-914e-29334b70214a None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:09.315747 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626315da-c8be-4fb1-914e-29334b70214a None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:09.315747 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626315da-c8be-4fb1-914e-29334b70214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:09.327512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887caef-e9f8-470c-9372-1925f41dd5fc None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:09.327512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887caef-e9f8-470c-9372-1925f41dd5fc None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:09.327512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887caef-e9f8-470c-9372-1925f41dd5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:09.348836 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-626315da-c8be-4fb1-914e-29334b70214a None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:09.350437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-626315da-c8be-4fb1-914e-29334b70214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:09.369254 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 774/1541] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:50:09.380141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a014459-784f-4302-a83a-b853e06ef4be None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:09.380766 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a014459-784f-4302-a83a-b853e06ef4be None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:09.381227 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a014459-784f-4302-a83a-b853e06ef4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:09.389847 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-d887caef-e9f8-470c-9372-1925f41dd5fc None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:09.390216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d887caef-e9f8-470c-9372-1925f41dd5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:09.422570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-6a014459-784f-4302-a83a-b853e06ef4be None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:09.423735 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-6a014459-784f-4302-a83a-b853e06ef4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:09.429394 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 768/1542] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:09.434227 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887caef-e9f8-470c-9372-1925f41dd5fc None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:09.444894 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 775/1543] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:50:09.446303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7545c3e-5554-4bd1-ba26-42755732d319 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:09.446603 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7545c3e-5554-4bd1-ba26-42755732d319 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:09.446874 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7545c3e-5554-4bd1-ba26-42755732d319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:09.457776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887caef-e9f8-470c-9372-1925f41dd5fc None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:09.479449 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-a7545c3e-5554-4bd1-ba26-42755732d319 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:09.485216 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a7545c3e-5554-4bd1-ba26-42755732d319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:09.491363 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca88cc5-ea7f-447e-ab02-32129c0905c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:09.492029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca88cc5-ea7f-447e-ab02-32129c0905c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:09.492348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca88cc5-ea7f-447e-ab02-32129c0905c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:09.492714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca88cc5-ea7f-447e-ab02-32129c0905c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:09.495523 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca88cc5-ea7f-447e-ab02-32129c0905c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:50:09.495523 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca88cc5-ea7f-447e-ab02-32129c0905c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:09.495523 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca88cc5-ea7f-447e-ab02-32129c0905c5 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:09.503794 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 776/1544] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:09.504125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7545c3e-5554-4bd1-ba26-42755732d319 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:09.525429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 769/1545] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:50:09.526887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a7d3a-0158-4c5b-bbfe-448befef2e87 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:09.527173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a7d3a-0158-4c5b-bbfe-448befef2e87 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:09.527447 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a7d3a-0158-4c5b-bbfe-448befef2e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:09.535392 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7545c3e-5554-4bd1-ba26-42755732d319 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:09.548376 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b3644-f8e0-4aa5-8c96-94df6245737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:09.554403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b3644-f8e0-4aa5-8c96-94df6245737b admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:09.554403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b3644-f8e0-4aa5-8c96-94df6245737b admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:09.554403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b3644-f8e0-4aa5-8c96-94df6245737b admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:09.556036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b3644-f8e0-4aa5-8c96-94df6245737b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:50:09.556973 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b3644-f8e0-4aa5-8c96-94df6245737b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:09.559405 dv-cinder-847732-5-smb devstack@keystone.service[81876]: WARNING py.warnings [None req-669b3644-f8e0-4aa5-8c96-94df6245737b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:50:09.559405 dv-cinder-847732-5-smb devstack@keystone.service[81876]: warnings.warn(msg) Sep 07 16:50:09.559405 dv-cinder-847732-5-smb devstack@keystone.service[81876]: Sep 07 16:50:09.563065 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b3644-f8e0-4aa5-8c96-94df6245737b admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:09.580827 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-d46a7d3a-0158-4c5b-bbfe-448befef2e87 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:09.582487 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d46a7d3a-0158-4c5b-bbfe-448befef2e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:09.608968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 770/1546] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:09.610642 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efca6c-7ee3-4b95-9e41-3029b06572e2 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:09.610931 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efca6c-7ee3-4b95-9e41-3029b06572e2 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:09.611208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efca6c-7ee3-4b95-9e41-3029b06572e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:09.612530 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 777/1547] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:50:09.614119 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b3644-f8e0-4aa5-8c96-94df6245737b admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:09.633354 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b3644-f8e0-4aa5-8c96-94df6245737b admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:09.646513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139af46-5b38-4e5a-b518-e0cd2b439aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:09.647149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139af46-5b38-4e5a-b518-e0cd2b439aed admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:09.647460 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139af46-5b38-4e5a-b518-e0cd2b439aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:09.647797 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139af46-5b38-4e5a-b518-e0cd2b439aed admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:09.648400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139af46-5b38-4e5a-b518-e0cd2b439aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:09.662434 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-00efca6c-7ee3-4b95-9e41-3029b06572e2 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:09.662816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139af46-5b38-4e5a-b518-e0cd2b439aed admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:09.667430 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-00efca6c-7ee3-4b95-9e41-3029b06572e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:09.687449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 771/1548] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:09.690881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b019-dbeb-41f8-b334-7b37ed542c01 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:09.690881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b019-dbeb-41f8-b334-7b37ed542c01 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:09.690881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b019-dbeb-41f8-b334-7b37ed542c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:09.729275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-fb13b019-dbeb-41f8-b334-7b37ed542c01 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:09.730624 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-fb13b019-dbeb-41f8-b334-7b37ed542c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:09.744097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 772/1549] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:09.745087 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13b019-dbeb-41f8-b334-7b37ed542c01 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:09.766144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13b019-dbeb-41f8-b334-7b37ed542c01 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:09.774020 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756d216-d677-4a7d-8533-f10a92e7b803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:09.775202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756d216-d677-4a7d-8533-f10a92e7b803 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:09.775706 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756d216-d677-4a7d-8533-f10a92e7b803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:09.776146 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756d216-d677-4a7d-8533-f10a92e7b803 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:09.777238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756d216-d677-4a7d-8533-f10a92e7b803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:50:09.777728 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756d216-d677-4a7d-8533-f10a92e7b803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:09.780700 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756d216-d677-4a7d-8533-f10a92e7b803 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:09.803199 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 773/1550] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:50:09.811588 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756d216-d677-4a7d-8533-f10a92e7b803 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:09.829933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 778/1551] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:09 2022] POST /identity/v3/projects => generated 373 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:09.832111 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c670c8d-e182-432f-a57f-768fcf4531e4 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:09.833990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c670c8d-e182-432f-a57f-768fcf4531e4 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:09.834560 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c670c8d-e182-432f-a57f-768fcf4531e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:09.834990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756d216-d677-4a7d-8533-f10a92e7b803 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:09.865825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-2c670c8d-e182-432f-a57f-768fcf4531e4 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:09.867098 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2c670c8d-e182-432f-a57f-768fcf4531e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:09.944646 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051981d-028d-4e86-bbf9-54d5bddee9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:09.945496 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051981d-028d-4e86-bbf9-54d5bddee9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:09.945965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051981d-028d-4e86-bbf9-54d5bddee9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:09.946374 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051981d-028d-4e86-bbf9-54d5bddee9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:09.948608 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051981d-028d-4e86-bbf9-54d5bddee9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:09.950570 dv-cinder-847732-5-smb devstack@keystone.service[81877]: WARNING py.warnings [None req-3051981d-028d-4e86-bbf9-54d5bddee9c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:50:09.950570 dv-cinder-847732-5-smb devstack@keystone.service[81877]: warnings.warn(msg) Sep 07 16:50:09.950570 dv-cinder-847732-5-smb devstack@keystone.service[81877]: Sep 07 16:50:09.953562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051981d-028d-4e86-bbf9-54d5bddee9c9 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:09.981389 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 779/1552] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:09.983967 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e5ff5-a1ed-47cd-85d6-24ed24711731 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:09.985559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e5ff5-a1ed-47cd-85d6-24ed24711731 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:09.985559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e5ff5-a1ed-47cd-85d6-24ed24711731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.012210 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-170e5ff5-a1ed-47cd-85d6-24ed24711731 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:10.013422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-170e5ff5-a1ed-47cd-85d6-24ed24711731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:10.022030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 780/1553] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:10.031110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672f33a-3b31-4f66-bb8c-240120330e1f None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.031110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672f33a-3b31-4f66-bb8c-240120330e1f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.031110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672f33a-3b31-4f66-bb8c-240120330e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.050197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-3672f33a-3b31-4f66-bb8c-240120330e1f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:10.051552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3672f33a-3b31-4f66-bb8c-240120330e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:10.062317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 781/1554] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:10.067211 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672f33a-3b31-4f66-bb8c-240120330e1f None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:10.076046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 774/1555] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:09 2022] POST /identity/v3/projects => generated 365 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:10.076046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051981d-028d-4e86-bbf9-54d5bddee9c9 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:10.081617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672f33a-3b31-4f66-bb8c-240120330e1f None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:10.161917 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051981d-028d-4e86-bbf9-54d5bddee9c9 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:10.167725 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19922b86-e9b5-45a5-88df-d8a0447c7c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:10.168342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19922b86-e9b5-45a5-88df-d8a0447c7c63 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.168622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19922b86-e9b5-45a5-88df-d8a0447c7c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.168897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19922b86-e9b5-45a5-88df-d8a0447c7c63 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.170517 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19922b86-e9b5-45a5-88df-d8a0447c7c63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:10.172589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19922b86-e9b5-45a5-88df-d8a0447c7c63 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:10.186974 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780fdd0-32ae-485a-8dba-d0264cbb3181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:10.187674 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780fdd0-32ae-485a-8dba-d0264cbb3181 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.187954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780fdd0-32ae-485a-8dba-d0264cbb3181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.188230 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780fdd0-32ae-485a-8dba-d0264cbb3181 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.188883 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780fdd0-32ae-485a-8dba-d0264cbb3181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:10.190886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780fdd0-32ae-485a-8dba-d0264cbb3181 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:10.275608 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 775/1556] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:10 2022] POST /identity/v3/users => generated 287 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:10.277453 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6fb91-43ac-4597-8fed-e09d6ab9e356 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.277741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6fb91-43ac-4597-8fed-e09d6ab9e356 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.278013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6fb91-43ac-4597-8fed-e09d6ab9e356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.300530 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-61a6fb91-43ac-4597-8fed-e09d6ab9e356 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:10.302538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-61a6fb91-43ac-4597-8fed-e09d6ab9e356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:10.316010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 782/1557] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:10 2022] POST /identity/v3/projects => generated 373 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:10.316655 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 776/1558] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:10.317885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780fdd0-32ae-485a-8dba-d0264cbb3181 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:10.325905 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a65afb-2194-4027-b81c-0d312281e897 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.326349 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a65afb-2194-4027-b81c-0d312281e897 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.326792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a65afb-2194-4027-b81c-0d312281e897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.342351 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:10.348672 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-b8a65afb-2194-4027-b81c-0d312281e897 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:10.349920 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b8a65afb-2194-4027-b81c-0d312281e897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:10.355149 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:10.394194 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780fdd0-32ae-485a-8dba-d0264cbb3181 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:10.399666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08ad88-03f8-47ac-8c4d-d2edc30f343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:10.400428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08ad88-03f8-47ac-8c4d-d2edc30f343f admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.400806 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08ad88-03f8-47ac-8c4d-d2edc30f343f admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.401262 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08ad88-03f8-47ac-8c4d-d2edc30f343f admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.402290 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08ad88-03f8-47ac-8c4d-d2edc30f343f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:50:10.402703 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08ad88-03f8-47ac-8c4d-d2edc30f343f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:10.407396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08ad88-03f8-47ac-8c4d-d2edc30f343f admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:10.421693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 783/1559] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:50:10.423021 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08ad88-03f8-47ac-8c4d-d2edc30f343f admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:10.431419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 777/1560] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:10.432503 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a65afb-2194-4027-b81c-0d312281e897 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:10.436973 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08ad88-03f8-47ac-8c4d-d2edc30f343f admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:10.443718 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130735b5-17e3-4a2b-8752-ae53a4ad22ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:10.444364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130735b5-17e3-4a2b-8752-ae53a4ad22ea admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.447348 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130735b5-17e3-4a2b-8752-ae53a4ad22ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.447348 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130735b5-17e3-4a2b-8752-ae53a4ad22ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.447670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a65afb-2194-4027-b81c-0d312281e897 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:10.447767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130735b5-17e3-4a2b-8752-ae53a4ad22ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:50:10.447767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130735b5-17e3-4a2b-8752-ae53a4ad22ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:10.447767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130735b5-17e3-4a2b-8752-ae53a4ad22ea admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:10.451798 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715f959-0873-4248-a014-af5949687632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:10.452801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715f959-0873-4248-a014-af5949687632 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.453268 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715f959-0873-4248-a014-af5949687632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.453703 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715f959-0873-4248-a014-af5949687632 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.454827 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715f959-0873-4248-a014-af5949687632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:10.458508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715f959-0873-4248-a014-af5949687632 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:10.469247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 784/1561] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:50:10.471317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a8b2f-1d31-4401-b7ed-2f5d511d541b None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.471797 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a8b2f-1d31-4401-b7ed-2f5d511d541b None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.472246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a8b2f-1d31-4401-b7ed-2f5d511d541b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.496413 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-bd5a8b2f-1d31-4401-b7ed-2f5d511d541b None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:10.499788 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-bd5a8b2f-1d31-4401-b7ed-2f5d511d541b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:10.506597 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 785/1562] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:10.507417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a8b2f-1d31-4401-b7ed-2f5d511d541b None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:10.518505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a8b2f-1d31-4401-b7ed-2f5d511d541b None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:10.523531 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5142e-7439-4103-b1b8-a0b3ae664d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:10.524169 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5142e-7439-4103-b1b8-a0b3ae664d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.524452 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5142e-7439-4103-b1b8-a0b3ae664d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.524754 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5142e-7439-4103-b1b8-a0b3ae664d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.525425 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5142e-7439-4103-b1b8-a0b3ae664d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:10.527124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5142e-7439-4103-b1b8-a0b3ae664d4a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:10.539208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 786/1563] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:10.540177 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5142e-7439-4103-b1b8-a0b3ae664d4a admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:10.552945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5142e-7439-4103-b1b8-a0b3ae664d4a admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:10.558718 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130af1cf-3384-44a9-81e2-fa4a4ae81aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:10.559542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130af1cf-3384-44a9-81e2-fa4a4ae81aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.559867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130af1cf-3384-44a9-81e2-fa4a4ae81aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.560181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130af1cf-3384-44a9-81e2-fa4a4ae81aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.561967 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130af1cf-3384-44a9-81e2-fa4a4ae81aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:10.563029 dv-cinder-847732-5-smb devstack@keystone.service[81876]: WARNING py.warnings [None req-130af1cf-3384-44a9-81e2-fa4a4ae81aa6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:50:10.563029 dv-cinder-847732-5-smb devstack@keystone.service[81876]: warnings.warn(msg) Sep 07 16:50:10.563029 dv-cinder-847732-5-smb devstack@keystone.service[81876]: Sep 07 16:50:10.564305 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130af1cf-3384-44a9-81e2-fa4a4ae81aa6 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:10.599624 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 778/1564] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:10 2022] POST /identity/v3/users => generated 283 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:10.603059 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ef5d8-e781-412a-af03-5db0bd9fc91c None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.603059 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ef5d8-e781-412a-af03-5db0bd9fc91c None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.603059 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ef5d8-e781-412a-af03-5db0bd9fc91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.624623 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-fe4ef5d8-e781-412a-af03-5db0bd9fc91c None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:10.625559 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-fe4ef5d8-e781-412a-af03-5db0bd9fc91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:10.633910 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 779/1565] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:10.637527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ef5d8-e781-412a-af03-5db0bd9fc91c None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:10.646477 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ef5d8-e781-412a-af03-5db0bd9fc91c None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:10.651381 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572b7a4-915c-48ba-a020-09a95313a9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:10.652039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572b7a4-915c-48ba-a020-09a95313a9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.652324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572b7a4-915c-48ba-a020-09a95313a9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.652593 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572b7a4-915c-48ba-a020-09a95313a9c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.653253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572b7a4-915c-48ba-a020-09a95313a9c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:10.655462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572b7a4-915c-48ba-a020-09a95313a9c6 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:10.676112 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 787/1566] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:10 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:10.677400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130af1cf-3384-44a9-81e2-fa4a4ae81aa6 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:10.689539 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130af1cf-3384-44a9-81e2-fa4a4ae81aa6 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:10.694619 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb955d-0654-487f-9029-0a179d43a261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:10.695347 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb955d-0654-487f-9029-0a179d43a261 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.695666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb955d-0654-487f-9029-0a179d43a261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.695944 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb955d-0654-487f-9029-0a179d43a261 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.696613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb955d-0654-487f-9029-0a179d43a261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:50:10.696916 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb955d-0654-487f-9029-0a179d43a261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:10.698636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb955d-0654-487f-9029-0a179d43a261 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:10.712730 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 788/1567] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:50:10.713572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb955d-0654-487f-9029-0a179d43a261 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:10.728559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb955d-0654-487f-9029-0a179d43a261 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:10.734292 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49ebea-6794-4718-a76e-da62020fdaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:10.734925 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ebea-6794-4718-a76e-da62020fdaf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.735204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ebea-6794-4718-a76e-da62020fdaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.735501 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ebea-6794-4718-a76e-da62020fdaf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.736160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49ebea-6794-4718-a76e-da62020fdaf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:10.738087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49ebea-6794-4718-a76e-da62020fdaf5 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:10.765508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 780/1568] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:10 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:10.769317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac8fb4-1b14-4ff4-aaa6-0273bea0f7d4 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.769317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac8fb4-1b14-4ff4-aaa6-0273bea0f7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.769317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac8fb4-1b14-4ff4-aaa6-0273bea0f7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.789826 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-4eac8fb4-1b14-4ff4-aaa6-0273bea0f7d4 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:10.790990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4eac8fb4-1b14-4ff4-aaa6-0273bea0f7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:10.844026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 789/1569] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:10 2022] POST /identity/v3/projects => generated 393 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:10.845176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49ebea-6794-4718-a76e-da62020fdaf5 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:10.903552 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 781/1570] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:10.903552 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac8fb4-1b14-4ff4-aaa6-0273bea0f7d4 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:10.922382 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac8fb4-1b14-4ff4-aaa6-0273bea0f7d4 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:10.925713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49ebea-6794-4718-a76e-da62020fdaf5 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:10.929744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b186fa-8fbb-4e0f-8d43-ad4703c42f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:10.930463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b186fa-8fbb-4e0f-8d43-ad4703c42f10 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.930740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b186fa-8fbb-4e0f-8d43-ad4703c42f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.930860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89959af1-ac3c-4fa8-ae35-d7b4f279e978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:10.931144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b186fa-8fbb-4e0f-8d43-ad4703c42f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.931500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89959af1-ac3c-4fa8-ae35-d7b4f279e978 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.931786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89959af1-ac3c-4fa8-ae35-d7b4f279e978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.932060 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89959af1-ac3c-4fa8-ae35-d7b4f279e978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.932163 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b186fa-8fbb-4e0f-8d43-ad4703c42f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:10.932711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89959af1-ac3c-4fa8-ae35-d7b4f279e978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:10.934325 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89959af1-ac3c-4fa8-ae35-d7b4f279e978 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:10.935052 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b186fa-8fbb-4e0f-8d43-ad4703c42f10 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:10.950155 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 790/1571] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:10.950155 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89959af1-ac3c-4fa8-ae35-d7b4f279e978 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:10.955056 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 782/1572] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:10.956954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b186fa-8fbb-4e0f-8d43-ad4703c42f10 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:10.962568 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89959af1-ac3c-4fa8-ae35-d7b4f279e978 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:10.970768 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a8e09-c738-4cfb-bf10-eadfea9a7bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:10.971782 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a8e09-c738-4cfb-bf10-eadfea9a7bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.972325 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a8e09-c738-4cfb-bf10-eadfea9a7bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.972844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a8e09-c738-4cfb-bf10-eadfea9a7bf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.974012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a8e09-c738-4cfb-bf10-eadfea9a7bf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:50:10.974453 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b186fa-8fbb-4e0f-8d43-ad4703c42f10 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:10.974655 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a8e09-c738-4cfb-bf10-eadfea9a7bf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:10.977423 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a8e09-c738-4cfb-bf10-eadfea9a7bf3 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:10.981896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d2a2f-ed9a-46ca-97e8-a8ce39ca0dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:10.983495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d2a2f-ed9a-46ca-97e8-a8ce39ca0dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:10.984055 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d2a2f-ed9a-46ca-97e8-a8ce39ca0dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:10.984250 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d2a2f-ed9a-46ca-97e8-a8ce39ca0dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:10.985317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d2a2f-ed9a-46ca-97e8-a8ce39ca0dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:10.988289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d2a2f-ed9a-46ca-97e8-a8ce39ca0dd9 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:11.000482 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 791/1573] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:50:11.001833 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a8e09-c738-4cfb-bf10-eadfea9a7bf3 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:11.007125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 783/1574] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:11.008791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d2a2f-ed9a-46ca-97e8-a8ce39ca0dd9 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:11.020621 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a8e09-c738-4cfb-bf10-eadfea9a7bf3 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:11.027606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74521ab3-3074-495a-8007-e906b0f95f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:11.027995 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d2a2f-ed9a-46ca-97e8-a8ce39ca0dd9 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:11.028645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74521ab3-3074-495a-8007-e906b0f95f93 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:11.029097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74521ab3-3074-495a-8007-e906b0f95f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:11.029560 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74521ab3-3074-495a-8007-e906b0f95f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:11.030644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74521ab3-3074-495a-8007-e906b0f95f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:11.034253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74521ab3-3074-495a-8007-e906b0f95f93 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:11.035513 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572ffd0-cae7-408a-bfda-35169b873960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:11.036488 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572ffd0-cae7-408a-bfda-35169b873960 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:11.036940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572ffd0-cae7-408a-bfda-35169b873960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:11.037386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572ffd0-cae7-408a-bfda-35169b873960 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:11.038481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572ffd0-cae7-408a-bfda-35169b873960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:11.042043 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572ffd0-cae7-408a-bfda-35169b873960 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:11.052631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:11.200403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 792/1575] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:11 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:11.202317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74521ab3-3074-495a-8007-e906b0f95f93 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:11.238671 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 784/1576] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:11 2022] POST /identity/v3/users => generated 290 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:11.240199 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572ffd0-cae7-408a-bfda-35169b873960 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:11.255109 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572ffd0-cae7-408a-bfda-35169b873960 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:11.286634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:11.314694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74521ab3-3074-495a-8007-e906b0f95f93 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:11.317088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cf322-bd92-4db1-8d52-5697d6721e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:11.318081 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf322-bd92-4db1-8d52-5697d6721e49 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:11.318229 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf322-bd92-4db1-8d52-5697d6721e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:11.319189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf322-bd92-4db1-8d52-5697d6721e49 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:11.320034 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cf322-bd92-4db1-8d52-5697d6721e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:11.322328 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cf322-bd92-4db1-8d52-5697d6721e49 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:11.344106 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99544920-f74d-47c5-bafc-e0bcc6e2f667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:11.344972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99544920-f74d-47c5-bafc-e0bcc6e2f667 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:11.345355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99544920-f74d-47c5-bafc-e0bcc6e2f667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:11.345738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99544920-f74d-47c5-bafc-e0bcc6e2f667 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:11.346498 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99544920-f74d-47c5-bafc-e0bcc6e2f667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:50:11.346973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99544920-f74d-47c5-bafc-e0bcc6e2f667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:11.348852 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99544920-f74d-47c5-bafc-e0bcc6e2f667 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:11.362561 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 785/1577] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:50:11.363774 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99544920-f74d-47c5-bafc-e0bcc6e2f667 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:11.376716 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99544920-f74d-47c5-bafc-e0bcc6e2f667 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:11.381857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452267d-89de-4afa-a7b0-03b082296880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:11.382640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452267d-89de-4afa-a7b0-03b082296880 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:11.382962 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452267d-89de-4afa-a7b0-03b082296880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:11.383298 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452267d-89de-4afa-a7b0-03b082296880 admin admin] PATH_INFO: `/v3/projects/53b39222792543ec9f0fecf93ebeb87d/users/cd95f101a4e14c19810747b8735168c7/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:11.407337 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452267d-89de-4afa-a7b0-03b082296880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b39222792543ec9f0fecf93ebeb87d, user_id=cd95f101a4e14c19810747b8735168c7, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:11.408949 dv-cinder-847732-5-smb devstack@keystone.service[81877]: WARNING py.warnings [None req-4452267d-89de-4afa-a7b0-03b082296880 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:50:11.408949 dv-cinder-847732-5-smb devstack@keystone.service[81877]: warnings.warn(msg) Sep 07 16:50:11.408949 dv-cinder-847732-5-smb devstack@keystone.service[81877]: Sep 07 16:50:11.411718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452267d-89de-4afa-a7b0-03b082296880 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:11.436275 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 793/1578] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:11 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:11.436275 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cf322-bd92-4db1-8d52-5697d6721e49 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:11.449816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cf322-bd92-4db1-8d52-5697d6721e49 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:11.456502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1019b-89d0-49ef-8988-722a5a496682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:11.457171 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1019b-89d0-49ef-8988-722a5a496682 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:11.457531 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1019b-89d0-49ef-8988-722a5a496682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:11.457867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1019b-89d0-49ef-8988-722a5a496682 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:11.458656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1019b-89d0-49ef-8988-722a5a496682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:11.460566 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1019b-89d0-49ef-8988-722a5a496682 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:11.473609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 794/1579] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:11.475066 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1019b-89d0-49ef-8988-722a5a496682 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:11.489218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1019b-89d0-49ef-8988-722a5a496682 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:11.494991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbeafef-d68d-4afa-8c9d-e576cfa4bc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:11.495628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeafef-d68d-4afa-8c9d-e576cfa4bc92 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:11.495911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeafef-d68d-4afa-8c9d-e576cfa4bc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:11.496201 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeafef-d68d-4afa-8c9d-e576cfa4bc92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:11.496835 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbeafef-d68d-4afa-8c9d-e576cfa4bc92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:11.500135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbeafef-d68d-4afa-8c9d-e576cfa4bc92 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:11.509173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 786/1580] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:11 2022] PUT /identity/v3/projects/53b39222792543ec9f0fecf93ebeb87d/users/cd95f101a4e14c19810747b8735168c7/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:11.525069 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452267d-89de-4afa-a7b0-03b082296880 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:11.611439 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452267d-89de-4afa-a7b0-03b082296880 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:11.617130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841fd5e-ddc7-4122-b90e-302548ddbe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:11.617949 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841fd5e-ddc7-4122-b90e-302548ddbe38 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:11.618309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841fd5e-ddc7-4122-b90e-302548ddbe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:11.618732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841fd5e-ddc7-4122-b90e-302548ddbe38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:11.619509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841fd5e-ddc7-4122-b90e-302548ddbe38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:11.621547 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841fd5e-ddc7-4122-b90e-302548ddbe38 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:11.634387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 787/1581] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:11.635257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841fd5e-ddc7-4122-b90e-302548ddbe38 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:11.646977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841fd5e-ddc7-4122-b90e-302548ddbe38 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:11.653650 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d66fab-8985-40f1-8828-15620573df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:11.655938 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d66fab-8985-40f1-8828-15620573df78 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:11.656916 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d66fab-8985-40f1-8828-15620573df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:11.657653 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d66fab-8985-40f1-8828-15620573df78 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:11.657959 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 795/1582] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:11 2022] POST /identity/v3/projects => generated 403 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:11.659527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d66fab-8985-40f1-8828-15620573df78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:11.665223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbeafef-d68d-4afa-8c9d-e576cfa4bc92 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:11.665448 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d66fab-8985-40f1-8828-15620573df78 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:11.746609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbeafef-d68d-4afa-8c9d-e576cfa4bc92 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:11.753109 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b310d-8799-4b23-9aef-546ec676d6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:11.753780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b310d-8799-4b23-9aef-546ec676d6ea admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:11.754058 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b310d-8799-4b23-9aef-546ec676d6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:11.754338 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b310d-8799-4b23-9aef-546ec676d6ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:11.754994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b310d-8799-4b23-9aef-546ec676d6ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:11.756850 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b310d-8799-4b23-9aef-546ec676d6ea admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:11.770697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 796/1583] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:11.771711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b310d-8799-4b23-9aef-546ec676d6ea admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:11.785333 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b310d-8799-4b23-9aef-546ec676d6ea admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:11.789808 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 788/1584] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:11 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:11.791095 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d66fab-8985-40f1-8828-15620573df78 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:11.791384 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fee508-1c2a-4481-ba0a-2a2f4b73ab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:11.792189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fee508-1c2a-4481-ba0a-2a2f4b73ab4d admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:11.792535 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fee508-1c2a-4481-ba0a-2a2f4b73ab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:11.792926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fee508-1c2a-4481-ba0a-2a2f4b73ab4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:11.793526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fee508-1c2a-4481-ba0a-2a2f4b73ab4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:11.796298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fee508-1c2a-4481-ba0a-2a2f4b73ab4d admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:11.806612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d66fab-8985-40f1-8828-15620573df78 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:11.813800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818a535-0a95-4c1e-adec-e4db0b173727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:11.814662 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818a535-0a95-4c1e-adec-e4db0b173727 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:11.815091 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818a535-0a95-4c1e-adec-e4db0b173727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:11.815516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818a535-0a95-4c1e-adec-e4db0b173727 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:11.816432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818a535-0a95-4c1e-adec-e4db0b173727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:11.818292 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818a535-0a95-4c1e-adec-e4db0b173727 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:11.832279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 789/1585] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:11.833143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818a535-0a95-4c1e-adec-e4db0b173727 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:11.844527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818a535-0a95-4c1e-adec-e4db0b173727 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:11.849755 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c0208-4ffe-412f-9487-1ec4b17078c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:11.850450 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c0208-4ffe-412f-9487-1ec4b17078c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:11.850725 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c0208-4ffe-412f-9487-1ec4b17078c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:11.850995 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c0208-4ffe-412f-9487-1ec4b17078c0 admin admin] PATH_INFO: `/v3/projects/41654372561b4a018a8573b0ca48dfff/users/8d8284bc38ba4b27862395823b8a34fb/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:11.869241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c0208-4ffe-412f-9487-1ec4b17078c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41654372561b4a018a8573b0ca48dfff, user_id=8d8284bc38ba4b27862395823b8a34fb, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:11.872025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c0208-4ffe-412f-9487-1ec4b17078c0 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:11.900140 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 797/1586] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:11 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:11.902604 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8901c-755a-4931-bf13-0d6ff3750069 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:11.903199 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8901c-755a-4931-bf13-0d6ff3750069 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:11.903731 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8901c-755a-4931-bf13-0d6ff3750069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:11.953925 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-ffd8901c-755a-4931-bf13-0d6ff3750069 None None] MFA Rules not processed for user `cd95f101a4e14c19810747b8735168c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:11.956039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ffd8901c-755a-4931-bf13-0d6ff3750069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:11.972111 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:11.990784 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 790/1587] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:11 2022] PUT /identity/v3/projects/41654372561b4a018a8573b0ca48dfff/users/8d8284bc38ba4b27862395823b8a34fb/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:11.993090 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c0208-4ffe-412f-9487-1ec4b17078c0 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:12.068088 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:12.071798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 798/1588] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:12.073390 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8901c-755a-4931-bf13-0d6ff3750069 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:12.116616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c0208-4ffe-412f-9487-1ec4b17078c0 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:12.123987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f6ac0-4a07-442c-a479-167513e5e66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:12.124562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f6ac0-4a07-442c-a479-167513e5e66f admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:12.124800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f6ac0-4a07-442c-a479-167513e5e66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:12.125076 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f6ac0-4a07-442c-a479-167513e5e66f admin admin] PATH_INFO: `/v3/projects/efd1a52bcfdf45d09f3f0e11034196f2/users/bb17a0fa47eb472780b19284f45a413a/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:12.153026 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f6ac0-4a07-442c-a479-167513e5e66f admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd1a52bcfdf45d09f3f0e11034196f2, user_id=bb17a0fa47eb472780b19284f45a413a, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:12.157231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f6ac0-4a07-442c-a479-167513e5e66f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:12.169074 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8901c-755a-4931-bf13-0d6ff3750069 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:12.175431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7c606-3283-464c-9684-d51fcc4be4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:12.176103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c606-3283-464c-9684-d51fcc4be4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:12.176388 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c606-3283-464c-9684-d51fcc4be4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:12.176656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c606-3283-464c-9684-d51fcc4be4e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:12.177345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7c606-3283-464c-9684-d51fcc4be4e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:12.179306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7c606-3283-464c-9684-d51fcc4be4e0 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:12.222551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 791/1589] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:11 2022] PUT /identity/v3/projects/efd1a52bcfdf45d09f3f0e11034196f2/users/bb17a0fa47eb472780b19284f45a413a/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:12.224025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f6ac0-4a07-442c-a479-167513e5e66f admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:12.319799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f6ac0-4a07-442c-a479-167513e5e66f admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:12.325339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5dd9f-a98a-4372-a857-02861ac3bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:12.326031 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5dd9f-a98a-4372-a857-02861ac3bdec admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:12.326478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5dd9f-a98a-4372-a857-02861ac3bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:12.326962 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5dd9f-a98a-4372-a857-02861ac3bdec admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:12.328374 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5dd9f-a98a-4372-a857-02861ac3bdec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:12.330748 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5dd9f-a98a-4372-a857-02861ac3bdec admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:12.338660 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 799/1590] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:12 2022] POST /identity/v3/users => generated 302 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:12.340701 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7c606-3283-464c-9684-d51fcc4be4e0 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:12.349399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 792/1591] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:12.350621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5dd9f-a98a-4372-a857-02861ac3bdec admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:12.356746 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7c606-3283-464c-9684-d51fcc4be4e0 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:12.365644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a0725-d7a9-4b69-992d-fcccae679f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:12.366811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a0725-d7a9-4b69-992d-fcccae679f55 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:12.367294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a0725-d7a9-4b69-992d-fcccae679f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:12.367777 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5dd9f-a98a-4372-a857-02861ac3bdec admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:12.367976 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a0725-d7a9-4b69-992d-fcccae679f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:12.369023 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a0725-d7a9-4b69-992d-fcccae679f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:12.372222 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a0725-d7a9-4b69-992d-fcccae679f55 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:12.375156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ac75e-e21c-4bfd-ae52-5f30df26bece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:12.375979 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ac75e-e21c-4bfd-ae52-5f30df26bece admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:12.376315 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ac75e-e21c-4bfd-ae52-5f30df26bece admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:12.376680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ac75e-e21c-4bfd-ae52-5f30df26bece admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:12.377496 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ac75e-e21c-4bfd-ae52-5f30df26bece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:12.380971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ac75e-e21c-4bfd-ae52-5f30df26bece admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:12.397865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 800/1592] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:12.398785 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a0725-d7a9-4b69-992d-fcccae679f55 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:12.407204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 793/1593] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:12.407204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55c537-d2c1-4953-90d3-f1d47e8a5892 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:12.407204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55c537-d2c1-4953-90d3-f1d47e8a5892 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:12.407204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55c537-d2c1-4953-90d3-f1d47e8a5892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:12.412234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a0725-d7a9-4b69-992d-fcccae679f55 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:12.418064 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a40b97-4b0a-43b0-b464-33966ec0de41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:12.418936 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a40b97-4b0a-43b0-b464-33966ec0de41 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:12.419235 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a40b97-4b0a-43b0-b464-33966ec0de41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:12.419867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a40b97-4b0a-43b0-b464-33966ec0de41 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:12.422608 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a40b97-4b0a-43b0-b464-33966ec0de41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:12.423512 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a40b97-4b0a-43b0-b464-33966ec0de41 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:12.453430 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-0a55c537-d2c1-4953-90d3-f1d47e8a5892 None None] MFA Rules not processed for user `8d8284bc38ba4b27862395823b8a34fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:12.454741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0a55c537-d2c1-4953-90d3-f1d47e8a5892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:12.549344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 794/1594] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:12.550743 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b807f7-c985-4686-971b-f436e65e5c65 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:12.551028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b807f7-c985-4686-971b-f436e65e5c65 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:12.551305 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b807f7-c985-4686-971b-f436e65e5c65 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:12.552967 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 795/1595] 10.222.0.25 () {54 vars in 962 bytes} [Wed Sep 7 16:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:50:12.554316 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d33cb-7850-4e36-bef1-4ccd52715686 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:12.554512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d33cb-7850-4e36-bef1-4ccd52715686 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:12.554769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d33cb-7850-4e36-bef1-4ccd52715686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:12.569626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 801/1596] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:12 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:12.571514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a40b97-4b0a-43b0-b464-33966ec0de41 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:12.595172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a40b97-4b0a-43b0-b464-33966ec0de41 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:12.595579 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-027d33cb-7850-4e36-bef1-4ccd52715686 None None] MFA Rules not processed for user `bb17a0fa47eb472780b19284f45a413a`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:12.596704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-027d33cb-7850-4e36-bef1-4ccd52715686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:12.602848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e21baa-4b42-4750-9949-c170583dc3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:12.605215 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e21baa-4b42-4750-9949-c170583dc3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:12.605215 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e21baa-4b42-4750-9949-c170583dc3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:12.605215 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e21baa-4b42-4750-9949-c170583dc3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:12.606069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e21baa-4b42-4750-9949-c170583dc3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:12.608581 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e21baa-4b42-4750-9949-c170583dc3e9 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:12.620414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 802/1597] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:12.621590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e21baa-4b42-4750-9949-c170583dc3e9 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:12.633758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e21baa-4b42-4750-9949-c170583dc3e9 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:12.639557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608dbad-7cb3-4bb8-b77e-5f10c99d2e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:12.640335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608dbad-7cb3-4bb8-b77e-5f10c99d2e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:12.640612 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608dbad-7cb3-4bb8-b77e-5f10c99d2e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:12.640945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608dbad-7cb3-4bb8-b77e-5f10c99d2e59 admin admin] PATH_INFO: `/v3/projects/c68ca919c27948d0af25cca7446764bf/users/e5dab09914634854bed1c1c4a1527746/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:12.645566 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:12.660427 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608dbad-7cb3-4bb8-b77e-5f10c99d2e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68ca919c27948d0af25cca7446764bf, user_id=e5dab09914634854bed1c1c4a1527746, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:12.664688 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608dbad-7cb3-4bb8-b77e-5f10c99d2e59 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:12.708314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 796/1598] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:12.713396 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d33cb-7850-4e36-bef1-4ccd52715686 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:12.721864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d33cb-7850-4e36-bef1-4ccd52715686 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:12.727097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f15c7a-afab-4e84-9e75-f29784d29400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:12.727762 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f15c7a-afab-4e84-9e75-f29784d29400 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:12.728037 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f15c7a-afab-4e84-9e75-f29784d29400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:12.728307 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f15c7a-afab-4e84-9e75-f29784d29400 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:12.728971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f15c7a-afab-4e84-9e75-f29784d29400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:12.730889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f15c7a-afab-4e84-9e75-f29784d29400 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:12.743966 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 797/1599] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:12.745099 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f15c7a-afab-4e84-9e75-f29784d29400 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:12.758142 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f15c7a-afab-4e84-9e75-f29784d29400 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:12.764609 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c5cec-a4d6-40db-bff9-00983cacc581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:12.765350 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c5cec-a4d6-40db-bff9-00983cacc581 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:12.765765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c5cec-a4d6-40db-bff9-00983cacc581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:12.766142 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c5cec-a4d6-40db-bff9-00983cacc581 admin admin] PATH_INFO: `/v3/projects/90a9e61e6928442f896de037b3bfa011/users/7dc367b3f3e04ec48665feef4094715a/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:12.784855 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 803/1600] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:12 2022] PUT /identity/v3/projects/c68ca919c27948d0af25cca7446764bf/users/e5dab09914634854bed1c1c4a1527746/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:12.787115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5458a-ffff-40ac-89e8-60866031505f None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:12.787701 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c5cec-a4d6-40db-bff9-00983cacc581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a9e61e6928442f896de037b3bfa011, user_id=7dc367b3f3e04ec48665feef4094715a, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:12.788404 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5458a-ffff-40ac-89e8-60866031505f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:12.788404 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5458a-ffff-40ac-89e8-60866031505f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:12.791565 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c5cec-a4d6-40db-bff9-00983cacc581 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:12.838318 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-aec5458a-ffff-40ac-89e8-60866031505f None None] MFA Rules not processed for user `cf48978c20f04173b114e15e1ce2157c`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:12.839785 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-aec5458a-ffff-40ac-89e8-60866031505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:12.861266 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:12.891604 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 798/1601] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:12 2022] PUT /identity/v3/projects/90a9e61e6928442f896de037b3bfa011/users/7dc367b3f3e04ec48665feef4094715a/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:12.893238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c5cec-a4d6-40db-bff9-00983cacc581 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:12.947095 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 804/1602] 10.222.0.25 () {58 vars in 1059 bytes} [Wed Sep 7 16:50:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:12.948644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5458a-ffff-40ac-89e8-60866031505f None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:12.980394 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c5cec-a4d6-40db-bff9-00983cacc581 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:12.986954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5784c03-c983-409f-8344-eaaa95344761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:12.987853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5784c03-c983-409f-8344-eaaa95344761 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:12.994322 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5784c03-c983-409f-8344-eaaa95344761 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:12.994322 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5784c03-c983-409f-8344-eaaa95344761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:13.059417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5458a-ffff-40ac-89e8-60866031505f None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:13.061818 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5784c03-c983-409f-8344-eaaa95344761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:13.063309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5784c03-c983-409f-8344-eaaa95344761 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:13.074474 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 799/1603] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:13.075378 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5784c03-c983-409f-8344-eaaa95344761 service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:13.141093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:13.154216 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e854207-a3a1-4371-817c-5e204f40f7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:13.154216 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e854207-a3a1-4371-817c-5e204f40f7ba admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:13.154216 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e854207-a3a1-4371-817c-5e204f40f7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:13.154216 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e854207-a3a1-4371-817c-5e204f40f7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:13.156147 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e854207-a3a1-4371-817c-5e204f40f7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:13.156147 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e854207-a3a1-4371-817c-5e204f40f7ba admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:13.173236 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5784c03-c983-409f-8344-eaaa95344761 service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:13.174870 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 805/1604] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:13.176142 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e854207-a3a1-4371-817c-5e204f40f7ba admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:13.187850 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e87a53-0c9e-4165-a62c-6ab9c7fb97aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:13.189226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e87a53-0c9e-4165-a62c-6ab9c7fb97aa admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:13.189689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e87a53-0c9e-4165-a62c-6ab9c7fb97aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:13.190133 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e87a53-0c9e-4165-a62c-6ab9c7fb97aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:13.191221 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e87a53-0c9e-4165-a62c-6ab9c7fb97aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:13.193712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e87a53-0c9e-4165-a62c-6ab9c7fb97aa admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:13.198386 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e854207-a3a1-4371-817c-5e204f40f7ba admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:13.206497 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd85cc-c343-416d-829f-4a33938c6a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:13.207127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd85cc-c343-416d-829f-4a33938c6a80 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:13.212088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd85cc-c343-416d-829f-4a33938c6a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:13.212088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd85cc-c343-416d-829f-4a33938c6a80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:13.212088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd85cc-c343-416d-829f-4a33938c6a80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:13.212088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd85cc-c343-416d-829f-4a33938c6a80 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:13.219413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 800/1605] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:13.221807 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e87a53-0c9e-4165-a62c-6ab9c7fb97aa admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:13.245363 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e87a53-0c9e-4165-a62c-6ab9c7fb97aa admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:13.253669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece31086-d5ad-44c8-9a1d-9921e072199d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:13.256788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece31086-d5ad-44c8-9a1d-9921e072199d admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:13.256788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece31086-d5ad-44c8-9a1d-9921e072199d admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:13.256788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece31086-d5ad-44c8-9a1d-9921e072199d admin admin] PATH_INFO: `/v3/projects/176bef4a9374446f8965a2d079830741/users/be6d79591cf14650a82b2b45fa8fd4aa/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:13.284828 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece31086-d5ad-44c8-9a1d-9921e072199d admin admin] RBAC: Authorizing `identity:create_grant(project_id=176bef4a9374446f8965a2d079830741, user_id=be6d79591cf14650a82b2b45fa8fd4aa, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:13.290223 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece31086-d5ad-44c8-9a1d-9921e072199d admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:13.351733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 806/1606] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:13 2022] POST /identity/v3/projects => generated 369 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:13.351733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d68f90-9cd5-45d6-85e0-e6a0de56196a None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:13.351733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d68f90-9cd5-45d6-85e0-e6a0de56196a None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:13.351733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d68f90-9cd5-45d6-85e0-e6a0de56196a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:13.376435 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-62d68f90-9cd5-45d6-85e0-e6a0de56196a None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:13.378700 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-62d68f90-9cd5-45d6-85e0-e6a0de56196a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:13.384629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 801/1607] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:13 2022] PUT /identity/v3/projects/176bef4a9374446f8965a2d079830741/users/be6d79591cf14650a82b2b45fa8fd4aa/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:13.388023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fb993-eb96-4dcc-ad41-2dbca198a6c5 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:13.388854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fb993-eb96-4dcc-ad41-2dbca198a6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:13.389533 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fb993-eb96-4dcc-ad41-2dbca198a6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:13.422854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-e20fb993-eb96-4dcc-ad41-2dbca198a6c5 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:13.424660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-e20fb993-eb96-4dcc-ad41-2dbca198a6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:13.440673 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:13.501306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 807/1608] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:13.502530 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d68f90-9cd5-45d6-85e0-e6a0de56196a None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:13.543892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 802/1609] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:13.543892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fb993-eb96-4dcc-ad41-2dbca198a6c5 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:13.563366 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fb993-eb96-4dcc-ad41-2dbca198a6c5 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:13.570993 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faab906-0142-4a27-ac4e-aa069e63df77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:13.572123 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faab906-0142-4a27-ac4e-aa069e63df77 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:13.572617 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faab906-0142-4a27-ac4e-aa069e63df77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:13.573054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faab906-0142-4a27-ac4e-aa069e63df77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:13.574186 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faab906-0142-4a27-ac4e-aa069e63df77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:13.576577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faab906-0142-4a27-ac4e-aa069e63df77 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:13.606457 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 803/1610] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:13.609468 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faab906-0142-4a27-ac4e-aa069e63df77 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:13.621823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faab906-0142-4a27-ac4e-aa069e63df77 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:13.627387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf16530-0361-4e38-afe3-059a1a6bccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:13.628100 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf16530-0361-4e38-afe3-059a1a6bccf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:13.628386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf16530-0361-4e38-afe3-059a1a6bccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:13.628664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf16530-0361-4e38-afe3-059a1a6bccf8 admin admin] PATH_INFO: `/v3/projects/ba1d20bbb1d14de59aa02b979e88fa56/users/4c033279a7634706b7e30955cddb4ce8/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:13.647367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d68f90-9cd5-45d6-85e0-e6a0de56196a None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:13.653291 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf16530-0361-4e38-afe3-059a1a6bccf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1d20bbb1d14de59aa02b979e88fa56, user_id=4c033279a7634706b7e30955cddb4ce8, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:13.653291 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf16530-0361-4e38-afe3-059a1a6bccf8 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:13.660305 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11bb84-89b4-41ff-a7a3-e3df12c90552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:13.661161 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11bb84-89b4-41ff-a7a3-e3df12c90552 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:13.661441 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11bb84-89b4-41ff-a7a3-e3df12c90552 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:13.661712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11bb84-89b4-41ff-a7a3-e3df12c90552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:13.737727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11bb84-89b4-41ff-a7a3-e3df12c90552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:13.740232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11bb84-89b4-41ff-a7a3-e3df12c90552 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:13.752921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 808/1611] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:13.754025 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11bb84-89b4-41ff-a7a3-e3df12c90552 service nova] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:13.779163 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 804/1612] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:13 2022] PUT /identity/v3/projects/ba1d20bbb1d14de59aa02b979e88fa56/users/4c033279a7634706b7e30955cddb4ce8/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:13.779163 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9980cf-a6ba-4c46-87bb-9aac2417a75e None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:13.779163 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9980cf-a6ba-4c46-87bb-9aac2417a75e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:13.779163 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9980cf-a6ba-4c46-87bb-9aac2417a75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:13.783645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11bb84-89b4-41ff-a7a3-e3df12c90552 service nova] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:13.823278 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-7e9980cf-a6ba-4c46-87bb-9aac2417a75e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:13.826721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-7e9980cf-a6ba-4c46-87bb-9aac2417a75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:13.887837 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b9426-53ed-4891-afeb-15063f1aaeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:13.889388 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b9426-53ed-4891-afeb-15063f1aaeca admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:13.889955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b9426-53ed-4891-afeb-15063f1aaeca admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:13.890374 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b9426-53ed-4891-afeb-15063f1aaeca admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:13.891765 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b9426-53ed-4891-afeb-15063f1aaeca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:13.895568 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b9426-53ed-4891-afeb-15063f1aaeca admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:13.933928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 805/1613] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:13.936804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9980cf-a6ba-4c46-87bb-9aac2417a75e None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:13.977605 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:14.013749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9980cf-a6ba-4c46-87bb-9aac2417a75e None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:14.017812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79183803-35a6-44b3-b52c-2291dc9a8ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:14.018574 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79183803-35a6-44b3-b52c-2291dc9a8ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:14.018853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79183803-35a6-44b3-b52c-2291dc9a8ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:14.019290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79183803-35a6-44b3-b52c-2291dc9a8ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:14.031650 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79183803-35a6-44b3-b52c-2291dc9a8ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:14.033216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79183803-35a6-44b3-b52c-2291dc9a8ae7 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:14.034382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 809/1614] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:13 2022] POST /identity/v3/users => generated 291 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:14.035499 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b9426-53ed-4891-afeb-15063f1aaeca admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:14.044549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:14.050996 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 806/1615] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:14.052103 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79183803-35a6-44b3-b52c-2291dc9a8ae7 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:14.052856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b9426-53ed-4891-afeb-15063f1aaeca admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:14.062728 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6a577-7f98-46e8-9578-289702da8ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:14.063833 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79183803-35a6-44b3-b52c-2291dc9a8ae7 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:14.064077 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6a577-7f98-46e8-9578-289702da8ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:14.064762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6a577-7f98-46e8-9578-289702da8ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:14.065362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6a577-7f98-46e8-9578-289702da8ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:14.072049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99343d7-e573-4ebd-bec6-79fd096e394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:14.072876 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99343d7-e573-4ebd-bec6-79fd096e394d admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:14.073160 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99343d7-e573-4ebd-bec6-79fd096e394d admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:14.073439 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99343d7-e573-4ebd-bec6-79fd096e394d admin admin] PATH_INFO: `/v3/projects/6270368ee4da4aa28e496afa3660f306/users/7a3f8b78523e4c3790b049fc783c96fd/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:14.090736 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6a577-7f98-46e8-9578-289702da8ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:14.095270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6a577-7f98-46e8-9578-289702da8ff2 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:14.095535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99343d7-e573-4ebd-bec6-79fd096e394d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6270368ee4da4aa28e496afa3660f306, user_id=7a3f8b78523e4c3790b049fc783c96fd, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:14.098332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99343d7-e573-4ebd-bec6-79fd096e394d admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:14.117691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 810/1616] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:14.122478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2771eb-92e7-4c38-be68-df0ff5a95f7e None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:14.122478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2771eb-92e7-4c38-be68-df0ff5a95f7e None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:14.122478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2771eb-92e7-4c38-be68-df0ff5a95f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:14.147842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-db2771eb-92e7-4c38-be68-df0ff5a95f7e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:14.151454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-db2771eb-92e7-4c38-be68-df0ff5a95f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:14.159176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 811/1617] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:14.160238 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2771eb-92e7-4c38-be68-df0ff5a95f7e None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:14.180317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 807/1618] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:14 2022] PUT /identity/v3/projects/6270368ee4da4aa28e496afa3660f306/users/7a3f8b78523e4c3790b049fc783c96fd/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:14.181405 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99343d7-e573-4ebd-bec6-79fd096e394d admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:14.199076 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2771eb-92e7-4c38-be68-df0ff5a95f7e None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:14.328939 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99343d7-e573-4ebd-bec6-79fd096e394d admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:14.339697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6896c8-7419-4f00-8253-c366a02c5203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:14.340860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6896c8-7419-4f00-8253-c366a02c5203 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:14.341133 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6896c8-7419-4f00-8253-c366a02c5203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:14.341912 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6896c8-7419-4f00-8253-c366a02c5203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:14.344545 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6896c8-7419-4f00-8253-c366a02c5203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:14.344747 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e630f8-a10d-487a-9d9b-29411a4c6539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:14.345794 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e630f8-a10d-487a-9d9b-29411a4c6539 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:14.346283 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e630f8-a10d-487a-9d9b-29411a4c6539 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:14.346792 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e630f8-a10d-487a-9d9b-29411a4c6539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:14.350752 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6896c8-7419-4f00-8253-c366a02c5203 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:14.371353 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e630f8-a10d-487a-9d9b-29411a4c6539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:14.376362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e630f8-a10d-487a-9d9b-29411a4c6539 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:14.385320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 808/1619] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:14.385320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6896c8-7419-4f00-8253-c366a02c5203 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:14.388451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-9c6896c8-7419-4f00-8253-c366a02c5203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:14.414191 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 812/1620] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:14.414191 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc5a91-4214-4ea9-8daa-44caf4f7f8a9 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:14.414191 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc5a91-4214-4ea9-8daa-44caf4f7f8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:14.414191 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc5a91-4214-4ea9-8daa-44caf4f7f8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:14.416394 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6896c8-7419-4f00-8253-c366a02c5203 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:14.422597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691a4ec-b424-47e3-ab55-fb919740062e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:14.423680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691a4ec-b424-47e3-ab55-fb919740062e service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:14.424382 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691a4ec-b424-47e3-ab55-fb919740062e service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:14.424927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691a4ec-b424-47e3-ab55-fb919740062e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:14.438604 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691a4ec-b424-47e3-ab55-fb919740062e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:14.440557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691a4ec-b424-47e3-ab55-fb919740062e service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:14.465007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-86cc5a91-4214-4ea9-8daa-44caf4f7f8a9 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:14.466857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 809/1621] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:14.468063 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-86cc5a91-4214-4ea9-8daa-44caf4f7f8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:14.471746 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a4ebe-bed4-4a3b-a824-ce553542bb1c None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:14.473967 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a4ebe-bed4-4a3b-a824-ce553542bb1c None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:14.474572 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a4ebe-bed4-4a3b-a824-ce553542bb1c None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:14.477455 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 810/1622] 10.222.0.25 () {54 vars in 912 bytes} [Wed Sep 7 16:50:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:50:14.482111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a4ebe-bed4-4a3b-a824-ce553542bb1c None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:14.495332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 813/1623] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:14.500373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cfa3e-dc1a-44de-8eb2-abcfea7c8737 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:14.500373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cfa3e-dc1a-44de-8eb2-abcfea7c8737 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:14.501359 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cfa3e-dc1a-44de-8eb2-abcfea7c8737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:14.519610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a4ebe-bed4-4a3b-a824-ce553542bb1c None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:14.534155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ec190-8ade-4768-bae9-22bad2e4f5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:14.543746 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ec190-8ade-4768-bae9-22bad2e4f5f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:14.543746 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ec190-8ade-4768-bae9-22bad2e4f5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:14.543746 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ec190-8ade-4768-bae9-22bad2e4f5f7 admin admin] PATH_INFO: `/v3/projects/b4ea67e4f36941c3adfc1ce993fe76bf/users/b5578e07017845f6914b396f20524a79/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:14.551951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-ef1cfa3e-dc1a-44de-8eb2-abcfea7c8737 None None] MFA Rules not processed for user `cf48978c20f04173b114e15e1ce2157c`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:14.556448 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ef1cfa3e-dc1a-44de-8eb2-abcfea7c8737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:14.559441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ec190-8ade-4768-bae9-22bad2e4f5f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ea67e4f36941c3adfc1ce993fe76bf, user_id=b5578e07017845f6914b396f20524a79, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:14.563844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ec190-8ade-4768-bae9-22bad2e4f5f7 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:14.670425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 811/1624] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:14 2022] PUT /identity/v3/projects/b4ea67e4f36941c3adfc1ce993fe76bf/users/b5578e07017845f6914b396f20524a79/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:14.670425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ec190-8ade-4768-bae9-22bad2e4f5f7 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:14.754989 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 814/1625] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Sep 7 16:50:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:14.755935 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cfa3e-dc1a-44de-8eb2-abcfea7c8737 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:14.776049 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cfa3e-dc1a-44de-8eb2-abcfea7c8737 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:14.816167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ec190-8ade-4768-bae9-22bad2e4f5f7 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:14.823182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffef8f-dd7c-4562-a28a-bc4fc9b6417d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:14.824273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffef8f-dd7c-4562-a28a-bc4fc9b6417d service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:14.825613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffef8f-dd7c-4562-a28a-bc4fc9b6417d service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:14.831381 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffef8f-dd7c-4562-a28a-bc4fc9b6417d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:14.856517 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:14.866523 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60cac4-d044-4cf5-b2cd-1814b7687bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:14.867789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60cac4-d044-4cf5-b2cd-1814b7687bcd admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:14.868366 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60cac4-d044-4cf5-b2cd-1814b7687bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:14.868906 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60cac4-d044-4cf5-b2cd-1814b7687bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:14.870126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60cac4-d044-4cf5-b2cd-1814b7687bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:14.874981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60cac4-d044-4cf5-b2cd-1814b7687bcd admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:14.923743 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 815/1626] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:14.925565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60cac4-d044-4cf5-b2cd-1814b7687bcd admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:14.952067 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:14.957053 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ffef8f-dd7c-4562-a28a-bc4fc9b6417d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:14.959325 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ffef8f-dd7c-4562-a28a-bc4fc9b6417d service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:14.976251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 812/1627] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:14.977635 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffef8f-dd7c-4562-a28a-bc4fc9b6417d service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:14.991544 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffef8f-dd7c-4562-a28a-bc4fc9b6417d service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:15.002639 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0f33e-da5d-407e-af71-32ef5bd1f63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:15.003554 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0f33e-da5d-407e-af71-32ef5bd1f63c admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:15.003892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0f33e-da5d-407e-af71-32ef5bd1f63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:15.004242 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0f33e-da5d-407e-af71-32ef5bd1f63c admin admin] PATH_INFO: `/v3/projects/b4ea67e4f36941c3adfc1ce993fe76bf/users/b5578e07017845f6914b396f20524a79/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:15.008188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0f33e-da5d-407e-af71-32ef5bd1f63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ea67e4f36941c3adfc1ce993fe76bf, user_id=b5578e07017845f6914b396f20524a79, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:15.012598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0f33e-da5d-407e-af71-32ef5bd1f63c admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:15.028735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 813/1628] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:14 2022] PUT /identity/v3/projects/b4ea67e4f36941c3adfc1ce993fe76bf/users/b5578e07017845f6914b396f20524a79/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:15.046260 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9ab7c-0a8f-4468-93a0-98cad2654f75 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:15.046784 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9ab7c-0a8f-4468-93a0-98cad2654f75 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:15.358789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9ab7c-0a8f-4468-93a0-98cad2654f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:15.365707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60cac4-d044-4cf5-b2cd-1814b7687bcd admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:15.366870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-2ed9ab7c-0a8f-4468-93a0-98cad2654f75 None None] MFA Rules not processed for user `b5578e07017845f6914b396f20524a79`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:15.366870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2ed9ab7c-0a8f-4468-93a0-98cad2654f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:15.367636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5752eb-2862-4ccf-b51b-f9e5f9083291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:15.367636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5752eb-2862-4ccf-b51b-f9e5f9083291 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:15.367636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5752eb-2862-4ccf-b51b-f9e5f9083291 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:15.367636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5752eb-2862-4ccf-b51b-f9e5f9083291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:15.368625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 814/1629] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:15.368625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9ab7c-0a8f-4468-93a0-98cad2654f75 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:15.368625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9ab7c-0a8f-4468-93a0-98cad2654f75 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:15.368625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb2a4c-5ac9-4105-91f2-ab359d8112c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:15.371226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb2a4c-5ac9-4105-91f2-ab359d8112c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:15.371226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb2a4c-5ac9-4105-91f2-ab359d8112c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:15.371226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb2a4c-5ac9-4105-91f2-ab359d8112c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:15.371226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb2a4c-5ac9-4105-91f2-ab359d8112c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:15.371226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb2a4c-5ac9-4105-91f2-ab359d8112c6 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:15.384434 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 815/1630] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:50:15.390217 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5752eb-2862-4ccf-b51b-f9e5f9083291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:15.392513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5752eb-2862-4ccf-b51b-f9e5f9083291 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:15.417613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 816/1631] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:16.087857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb2a4c-5ac9-4105-91f2-ab359d8112c6 service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:16.098084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb2a4c-5ac9-4105-91f2-ab359d8112c6 service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:16.136607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468faad-bc81-4cf0-bc36-32e99785bb7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:16.137111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468faad-bc81-4cf0-bc36-32e99785bb7e service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:16.137427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468faad-bc81-4cf0-bc36-32e99785bb7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:16.137664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468faad-bc81-4cf0-bc36-32e99785bb7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:16.322280 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468faad-bc81-4cf0-bc36-32e99785bb7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:16.330687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468faad-bc81-4cf0-bc36-32e99785bb7e service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:16.347343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 816/1632] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:50:17.333998 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ac495-f0d6-4e15-a727-a0a6af69f594 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:17.334801 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ac495-f0d6-4e15-a727-a0a6af69f594 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:17.335398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ac495-f0d6-4e15-a727-a0a6af69f594 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:17.339831 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 817/1633] 10.222.0.25 () {54 vars in 962 bytes} [Wed Sep 7 16:50:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:50:17.350394 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9eb12-8c29-46f9-8892-4d9ef56ebe93 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:17.350955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9eb12-8c29-46f9-8892-4d9ef56ebe93 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:17.351426 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9eb12-8c29-46f9-8892-4d9ef56ebe93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:17.382131 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:17.392663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-c9b9eb12-8c29-46f9-8892-4d9ef56ebe93 None None] MFA Rules not processed for user `cf48978c20f04173b114e15e1ce2157c`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:17.394825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c9b9eb12-8c29-46f9-8892-4d9ef56ebe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:17.414632 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 817/1634] 10.222.0.25 () {58 vars in 1059 bytes} [Wed Sep 7 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:17.423068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd18b2-efda-4ae1-a047-a9a72be68f4f None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:17.423501 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd18b2-efda-4ae1-a047-a9a72be68f4f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:17.423978 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd18b2-efda-4ae1-a047-a9a72be68f4f None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:17.426781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 818/1635] 10.222.0.25 () {54 vars in 912 bytes} [Wed Sep 7 16:50:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:50:17.437478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a61dd6-52ea-403e-bd5b-dcd20e5ae9e1 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:17.438038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a61dd6-52ea-403e-bd5b-dcd20e5ae9e1 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:17.438531 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a61dd6-52ea-403e-bd5b-dcd20e5ae9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:17.474444 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-e4a61dd6-52ea-403e-bd5b-dcd20e5ae9e1 None None] MFA Rules not processed for user `cf48978c20f04173b114e15e1ce2157c`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:17.476390 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-e4a61dd6-52ea-403e-bd5b-dcd20e5ae9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:17.489692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 818/1636] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Sep 7 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:17.512653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd18b2-efda-4ae1-a047-a9a72be68f4f None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:17.530060 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd18b2-efda-4ae1-a047-a9a72be68f4f None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:17.535003 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c045e-568d-48c4-96a9-f23d6c04a089 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:17.536025 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c045e-568d-48c4-96a9-f23d6c04a089 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:17.536538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c045e-568d-48c4-96a9-f23d6c04a089 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:17.537041 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c045e-568d-48c4-96a9-f23d6c04a089 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:17.552043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c045e-568d-48c4-96a9-f23d6c04a089 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:17.554234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c045e-568d-48c4-96a9-f23d6c04a089 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:17.576059 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 819/1637] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:18.198405 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b9832-eed5-484c-9739-28af26f938c9 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:18.198686 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b9832-eed5-484c-9739-28af26f938c9 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:18.199164 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b9832-eed5-484c-9739-28af26f938c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:18.268078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-5e4b9832-eed5-484c-9739-28af26f938c9 None None] MFA Rules not processed for user `4c033279a7634706b7e30955cddb4ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:18.270014 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-5e4b9832-eed5-484c-9739-28af26f938c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:18.372879 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 819/1638] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:18 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:50:18.380248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c045e-568d-48c4-96a9-f23d6c04a089 service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:18.466127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:18.485555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c045e-568d-48c4-96a9-f23d6c04a089 service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:18.494454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381b155-5506-406a-97b3-3d20d4e4ec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:18.495510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381b155-5506-406a-97b3-3d20d4e4ec38 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:18.496052 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381b155-5506-406a-97b3-3d20d4e4ec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:18.496667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381b155-5506-406a-97b3-3d20d4e4ec38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:18.497879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381b155-5506-406a-97b3-3d20d4e4ec38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:18.517200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381b155-5506-406a-97b3-3d20d4e4ec38 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:18.723427 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 820/1639] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:18 2022] POST /identity/v3/projects => generated 405 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:18.729457 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b9832-eed5-484c-9739-28af26f938c9 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:18.783636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b9832-eed5-484c-9739-28af26f938c9 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:19.029480 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c5f61-cfad-44f6-b242-173dc5969232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:19.031370 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c5f61-cfad-44f6-b242-173dc5969232 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:19.032859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c5f61-cfad-44f6-b242-173dc5969232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:19.035007 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c5f61-cfad-44f6-b242-173dc5969232 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:19.038997 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c5f61-cfad-44f6-b242-173dc5969232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:19.047864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c5f61-cfad-44f6-b242-173dc5969232 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:19.336471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 820/1640] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:18 2022] POST /identity/v3/users => generated 309 bytes in 612 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:50:19.343116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381b155-5506-406a-97b3-3d20d4e4ec38 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:19.359264 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381b155-5506-406a-97b3-3d20d4e4ec38 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:19.368595 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281c383-dcca-4ca4-b08b-dd06f6bc6659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:19.369998 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281c383-dcca-4ca4-b08b-dd06f6bc6659 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:19.370528 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281c383-dcca-4ca4-b08b-dd06f6bc6659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:19.374593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281c383-dcca-4ca4-b08b-dd06f6bc6659 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:19.374593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281c383-dcca-4ca4-b08b-dd06f6bc6659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:19.376750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281c383-dcca-4ca4-b08b-dd06f6bc6659 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:19.410028 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 821/1641] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:19.414127 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c5f61-cfad-44f6-b242-173dc5969232 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:19.432824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c5f61-cfad-44f6-b242-173dc5969232 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:19.444704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411e8f0-bd70-4c9d-8794-841ee7fabd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:19.446321 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411e8f0-bd70-4c9d-8794-841ee7fabd6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:19.446828 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411e8f0-bd70-4c9d-8794-841ee7fabd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:19.447352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411e8f0-bd70-4c9d-8794-841ee7fabd6d admin admin] PATH_INFO: `/v3/projects/8e1b7b72971e4ae5834c6ebad1f1954e/users/c432f36402d84ffe8df6688f38d075d8/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:19.495319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411e8f0-bd70-4c9d-8794-841ee7fabd6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1b7b72971e4ae5834c6ebad1f1954e, user_id=c432f36402d84ffe8df6688f38d075d8, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:19.495319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411e8f0-bd70-4c9d-8794-841ee7fabd6d admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:19.671892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 821/1642] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:19 2022] PUT /identity/v3/projects/8e1b7b72971e4ae5834c6ebad1f1954e/users/c432f36402d84ffe8df6688f38d075d8/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:19.676751 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281c383-dcca-4ca4-b08b-dd06f6bc6659 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:19.710873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281c383-dcca-4ca4-b08b-dd06f6bc6659 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:19.962523 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10e56e-68e8-4f03-b1f2-70de49206811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:19.963216 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10e56e-68e8-4f03-b1f2-70de49206811 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:19.963588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10e56e-68e8-4f03-b1f2-70de49206811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:19.963953 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10e56e-68e8-4f03-b1f2-70de49206811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:19.965031 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10e56e-68e8-4f03-b1f2-70de49206811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:19.969860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10e56e-68e8-4f03-b1f2-70de49206811 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:20.010959 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 822/1643] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:20.011040 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411e8f0-bd70-4c9d-8794-841ee7fabd6d admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:20.049906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411e8f0-bd70-4c9d-8794-841ee7fabd6d admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:20.073833 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c146e21-4cdb-4da0-8503-72068af50724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:20.075095 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c146e21-4cdb-4da0-8503-72068af50724 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:20.075663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c146e21-4cdb-4da0-8503-72068af50724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:20.076187 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c146e21-4cdb-4da0-8503-72068af50724 admin admin] PATH_INFO: `/v3/projects/8e1b7b72971e4ae5834c6ebad1f1954e/users/c432f36402d84ffe8df6688f38d075d8/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:20.088038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c146e21-4cdb-4da0-8503-72068af50724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1b7b72971e4ae5834c6ebad1f1954e, user_id=c432f36402d84ffe8df6688f38d075d8, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:20.109722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c146e21-4cdb-4da0-8503-72068af50724 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:20.155103 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 822/1644] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:20 2022] PUT /identity/v3/projects/8e1b7b72971e4ae5834c6ebad1f1954e/users/c432f36402d84ffe8df6688f38d075d8/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:50:21.049968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10e56e-68e8-4f03-b1f2-70de49206811 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:21.087950 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10e56e-68e8-4f03-b1f2-70de49206811 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:21.396456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9feeb5-c539-4338-b158-a404458a4cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:21.400922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9feeb5-c539-4338-b158-a404458a4cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:21.401643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9feeb5-c539-4338-b158-a404458a4cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:21.402352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9feeb5-c539-4338-b158-a404458a4cb1 admin admin] PATH_INFO: `/v3/users/cd95f101a4e14c19810747b8735168c7` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:21.410534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9feeb5-c539-4338-b158-a404458a4cb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd95f101a4e14c19810747b8735168c7)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:21.427586 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9feeb5-c539-4338-b158-a404458a4cb1 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:21.924236 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3d9feeb5-c539-4338-b158-a404458a4cb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd95f101a4e14c19810747b8735168c7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:22.028459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3d9feeb5-c539-4338-b158-a404458a4cb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd95f101a4e14c19810747b8735168c7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:22.030258 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3d9feeb5-c539-4338-b158-a404458a4cb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd95f101a4e14c19810747b8735168c7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:22.031645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3d9feeb5-c539-4338-b158-a404458a4cb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd95f101a4e14c19810747b8735168c7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:22.053687 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3d9feeb5-c539-4338-b158-a404458a4cb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd95f101a4e14c19810747b8735168c7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:22.058722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:22.098786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 823/1645] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:50:21 2022] DELETE /identity/v3/users/cd95f101a4e14c19810747b8735168c7 => generated 0 bytes in 1050 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:22.105997 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f45d9e-8ff4-47e1-80b2-b5a11013ec60 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:22.108545 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f45d9e-8ff4-47e1-80b2-b5a11013ec60 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:22.109277 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f45d9e-8ff4-47e1-80b2-b5a11013ec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:22.160688 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-97f45d9e-8ff4-47e1-80b2-b5a11013ec60 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:22.164146 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-97f45d9e-8ff4-47e1-80b2-b5a11013ec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:22.274222 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:22.418369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 823/1646] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:50:22.624227 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9feeb5-c539-4338-b158-a404458a4cb1 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:22.629531 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3d9feeb5-c539-4338-b158-a404458a4cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:22.816358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9feeb5-c539-4338-b158-a404458a4cb1 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:22.823244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff303b3-9b6d-4e4e-995e-04dccecacaab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:22.846339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff303b3-9b6d-4e4e-995e-04dccecacaab service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:22.846339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff303b3-9b6d-4e4e-995e-04dccecacaab service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:22.846339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff303b3-9b6d-4e4e-995e-04dccecacaab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:22.869301 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff303b3-9b6d-4e4e-995e-04dccecacaab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:22.871000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff303b3-9b6d-4e4e-995e-04dccecacaab service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:22.883361 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 824/1647] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:25.028795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f45d9e-8ff4-47e1-80b2-b5a11013ec60 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:25.033157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-97f45d9e-8ff4-47e1-80b2-b5a11013ec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:25.071907 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f45d9e-8ff4-47e1-80b2-b5a11013ec60 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:25.090344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee2289-5516-428c-b8d5-a9ad8184dac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:25.091314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee2289-5516-428c-b8d5-a9ad8184dac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:25.092373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee2289-5516-428c-b8d5-a9ad8184dac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:25.094615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee2289-5516-428c-b8d5-a9ad8184dac7 admin admin] PATH_INFO: `/v3/projects/53b39222792543ec9f0fecf93ebeb87d` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:25.097598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee2289-5516-428c-b8d5-a9ad8184dac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b39222792543ec9f0fecf93ebeb87d)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:25.101345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee2289-5516-428c-b8d5-a9ad8184dac7 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:25.353296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-eaee2289-5516-428c-b8d5-a9ad8184dac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b39222792543ec9f0fecf93ebeb87d', 'request_id': 'req-eaee2289-5516-428c-b8d5-a9ad8184dac7'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:25.441379 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-eaee2289-5516-428c-b8d5-a9ad8184dac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b39222792543ec9f0fecf93ebeb87d', 'request_id': 'req-eaee2289-5516-428c-b8d5-a9ad8184dac7'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:25.453436 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-eaee2289-5516-428c-b8d5-a9ad8184dac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b39222792543ec9f0fecf93ebeb87d', 'request_id': 'req-eaee2289-5516-428c-b8d5-a9ad8184dac7'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:25.486759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-eaee2289-5516-428c-b8d5-a9ad8184dac7 admin admin] The token cache is being invalidate because project 53b39222792543ec9f0fecf93ebeb87d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:50:25.487079 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-eaee2289-5516-428c-b8d5-a9ad8184dac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:25.492196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-eaee2289-5516-428c-b8d5-a9ad8184dac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:25.500964 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 824/1648] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:50:25 2022] DELETE /identity/v3/projects/53b39222792543ec9f0fecf93ebeb87d => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:25.503741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674ffcc-9e0b-4623-bab3-31d955464bdc None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:25.504274 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674ffcc-9e0b-4623-bab3-31d955464bdc None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:25.504732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674ffcc-9e0b-4623-bab3-31d955464bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:25.600630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-2674ffcc-9e0b-4623-bab3-31d955464bdc None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:25.610620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2674ffcc-9e0b-4623-bab3-31d955464bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:25.825312 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfbf12-7ede-4d19-b6bc-2b68b056d8e3 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:25.825665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfbf12-7ede-4d19-b6bc-2b68b056d8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:25.825889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfbf12-7ede-4d19-b6bc-2b68b056d8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:25.907718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-e1dfbf12-7ede-4d19-b6bc-2b68b056d8e3 None None] MFA Rules not processed for user `c432f36402d84ffe8df6688f38d075d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:25.912391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-e1dfbf12-7ede-4d19-b6bc-2b68b056d8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:25.990484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 825/1649] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:26.001696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de34a1-d01b-47bd-86b4-5c65546d7af2 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:26.001696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de34a1-d01b-47bd-86b4-5c65546d7af2 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:26.001696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de34a1-d01b-47bd-86b4-5c65546d7af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:26.133348 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-c8de34a1-d01b-47bd-86b4-5c65546d7af2 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:26.140523 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c8de34a1-d01b-47bd-86b4-5c65546d7af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:26.155532 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 826/1650] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:26.164389 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de34a1-d01b-47bd-86b4-5c65546d7af2 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:26.207774 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de34a1-d01b-47bd-86b4-5c65546d7af2 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:26.271137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d92ee4-044a-4918-85d8-450c3048caa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:26.272801 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d92ee4-044a-4918-85d8-450c3048caa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:26.274429 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d92ee4-044a-4918-85d8-450c3048caa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:26.275732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d92ee4-044a-4918-85d8-450c3048caa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:26.283142 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d92ee4-044a-4918-85d8-450c3048caa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:50:26.283754 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d92ee4-044a-4918-85d8-450c3048caa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:26.290553 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d92ee4-044a-4918-85d8-450c3048caa1 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:26.310051 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 825/1651] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:25 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:26.359437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 827/1652] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:50:26.361899 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfbf12-7ede-4d19-b6bc-2b68b056d8e3 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:26.378802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfbf12-7ede-4d19-b6bc-2b68b056d8e3 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:26.384915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908090b-426e-48a2-895e-a9e5e292f1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:26.385749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908090b-426e-48a2-895e-a9e5e292f1a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:26.386226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908090b-426e-48a2-895e-a9e5e292f1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:26.386699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908090b-426e-48a2-895e-a9e5e292f1a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:26.388289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908090b-426e-48a2-895e-a9e5e292f1a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:26.391673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908090b-426e-48a2-895e-a9e5e292f1a9 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:26.521999 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 826/1653] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:26 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:50:26.527866 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d92ee4-044a-4918-85d8-450c3048caa1 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:26.547609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d92ee4-044a-4918-85d8-450c3048caa1 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:26.817343 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b2259-6663-454f-97f9-563447299586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:26.819062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b2259-6663-454f-97f9-563447299586 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:26.839319 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b2259-6663-454f-97f9-563447299586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:26.839774 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b2259-6663-454f-97f9-563447299586 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:26.849281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b2259-6663-454f-97f9-563447299586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:26.870582 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b2259-6663-454f-97f9-563447299586 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:26.917348 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:27.032988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 828/1654] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:26 2022] POST /identity/v3/users => generated 283 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:27.039251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908090b-426e-48a2-895e-a9e5e292f1a9 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:27.070309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908090b-426e-48a2-895e-a9e5e292f1a9 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:27.087699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82af45e-5b39-41ea-b15a-d7c2276bd22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:27.089231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82af45e-5b39-41ea-b15a-d7c2276bd22b admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:27.094941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82af45e-5b39-41ea-b15a-d7c2276bd22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:27.096636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82af45e-5b39-41ea-b15a-d7c2276bd22b admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:27.097385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82af45e-5b39-41ea-b15a-d7c2276bd22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:27.108952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82af45e-5b39-41ea-b15a-d7c2276bd22b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:27.136301 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 827/1655] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:27.142936 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b2259-6663-454f-97f9-563447299586 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:27.161390 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b2259-6663-454f-97f9-563447299586 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:27.177450 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2704f-39ae-4ae5-acde-216854249fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:27.178092 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2704f-39ae-4ae5-acde-216854249fed admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:27.178377 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2704f-39ae-4ae5-acde-216854249fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:27.178809 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2704f-39ae-4ae5-acde-216854249fed admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:27.179739 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2704f-39ae-4ae5-acde-216854249fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:27.182902 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2704f-39ae-4ae5-acde-216854249fed admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:27.237176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 829/1656] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:50:27.239229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82af45e-5b39-41ea-b15a-d7c2276bd22b admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:27.256079 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82af45e-5b39-41ea-b15a-d7c2276bd22b admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:27.274258 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950efe3-a314-4b14-b353-47db9aadd350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:27.276346 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950efe3-a314-4b14-b353-47db9aadd350 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:27.286289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950efe3-a314-4b14-b353-47db9aadd350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:27.286756 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950efe3-a314-4b14-b353-47db9aadd350 admin admin] PATH_INFO: `/v3/projects/9e9177f6f0e04e2e86feb7183b6dac1c/users/986395a3de49456fbf4a49265045120a/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:27.312265 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:27.343117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950efe3-a314-4b14-b353-47db9aadd350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9177f6f0e04e2e86feb7183b6dac1c, user_id=986395a3de49456fbf4a49265045120a, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:27.343117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950efe3-a314-4b14-b353-47db9aadd350 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:27.510822 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 828/1657] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:27 2022] PUT /identity/v3/projects/9e9177f6f0e04e2e86feb7183b6dac1c/users/986395a3de49456fbf4a49265045120a/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:27.549880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb90a99-d0bd-4fac-b061-b45cc6e4829c None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:27.549880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb90a99-d0bd-4fac-b061-b45cc6e4829c None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:27.549880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb90a99-d0bd-4fac-b061-b45cc6e4829c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:27.599425 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-ebb90a99-d0bd-4fac-b061-b45cc6e4829c None None] MFA Rules not processed for user `986395a3de49456fbf4a49265045120a`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:27.604336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ebb90a99-d0bd-4fac-b061-b45cc6e4829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:27.829327 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 830/1658] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:50:27.834944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950efe3-a314-4b14-b353-47db9aadd350 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:27.937373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950efe3-a314-4b14-b353-47db9aadd350 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:27.952987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4693f9-df77-4bb7-8703-c202690ed3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:27.955380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4693f9-df77-4bb7-8703-c202690ed3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:27.955865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4693f9-df77-4bb7-8703-c202690ed3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:27.956021 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4693f9-df77-4bb7-8703-c202690ed3e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:27.956733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4693f9-df77-4bb7-8703-c202690ed3e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:27.963398 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4693f9-df77-4bb7-8703-c202690ed3e5 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:28.130495 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb90a99-d0bd-4fac-b061-b45cc6e4829c None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:28.132692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 829/1659] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:27 2022] POST /identity/v3/projects => generated 363 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:28.146052 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb90a99-d0bd-4fac-b061-b45cc6e4829c None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:28.406656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e7eb9-01d0-4453-99c5-b9cafba07bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:28.406656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e7eb9-01d0-4453-99c5-b9cafba07bef admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:28.406656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e7eb9-01d0-4453-99c5-b9cafba07bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:28.407099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e7eb9-01d0-4453-99c5-b9cafba07bef admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:28.408104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e7eb9-01d0-4453-99c5-b9cafba07bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:28.422825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e7eb9-01d0-4453-99c5-b9cafba07bef admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:28.590558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 831/1660] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:28 2022] POST /identity/v3/users => generated 288 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:28.596956 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4693f9-df77-4bb7-8703-c202690ed3e5 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:28.619797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4693f9-df77-4bb7-8703-c202690ed3e5 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:28.645027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7c91d-7101-4d23-b55f-d13e9994e0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:28.646299 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7c91d-7101-4d23-b55f-d13e9994e0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:28.648322 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7c91d-7101-4d23-b55f-d13e9994e0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:28.649453 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7c91d-7101-4d23-b55f-d13e9994e0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:28.651637 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7c91d-7101-4d23-b55f-d13e9994e0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:28.661888 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7c91d-7101-4d23-b55f-d13e9994e0d9 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:28.703758 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 830/1661] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:28.705898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e7eb9-01d0-4453-99c5-b9cafba07bef admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:28.722623 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e7eb9-01d0-4453-99c5-b9cafba07bef admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:28.737037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f5520-162b-4a64-9d39-f01422ce170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:28.741965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f5520-162b-4a64-9d39-f01422ce170d admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:28.744216 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f5520-162b-4a64-9d39-f01422ce170d admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:28.746183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f5520-162b-4a64-9d39-f01422ce170d admin admin] PATH_INFO: `/v3/projects/2de244a4dc094ce1b653f848df46780e/users/640c2ed523034f61b3029bc9b6c543de/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:28.769901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f5520-162b-4a64-9d39-f01422ce170d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de244a4dc094ce1b653f848df46780e, user_id=640c2ed523034f61b3029bc9b6c543de, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:28.773133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f5520-162b-4a64-9d39-f01422ce170d admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:28.888002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 832/1662] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:28 2022] PUT /identity/v3/projects/2de244a4dc094ce1b653f848df46780e/users/640c2ed523034f61b3029bc9b6c543de/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:50:28.893828 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7c91d-7101-4d23-b55f-d13e9994e0d9 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:28.922135 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7c91d-7101-4d23-b55f-d13e9994e0d9 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:29.112989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be1881-259a-42ae-862b-039bbf6b1615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:29.113334 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be1881-259a-42ae-862b-039bbf6b1615 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:29.113615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be1881-259a-42ae-862b-039bbf6b1615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:29.114079 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be1881-259a-42ae-862b-039bbf6b1615 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:29.115835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be1881-259a-42ae-862b-039bbf6b1615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:29.119530 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be1881-259a-42ae-862b-039bbf6b1615 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:29.154178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 831/1663] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:29.155919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f5520-162b-4a64-9d39-f01422ce170d admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:29.189045 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f5520-162b-4a64-9d39-f01422ce170d admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:29.205170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1cfae-960f-4b92-861f-8cbb0097989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:29.208016 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1cfae-960f-4b92-861f-8cbb0097989f admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:29.209557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1cfae-960f-4b92-861f-8cbb0097989f admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:29.214445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1cfae-960f-4b92-861f-8cbb0097989f admin admin] PATH_INFO: `/v3/projects/2de244a4dc094ce1b653f848df46780e/users/640c2ed523034f61b3029bc9b6c543de/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:29.220410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1cfae-960f-4b92-861f-8cbb0097989f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de244a4dc094ce1b653f848df46780e, user_id=640c2ed523034f61b3029bc9b6c543de, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:29.227511 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1cfae-960f-4b92-861f-8cbb0097989f admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:29.270853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 833/1664] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:29 2022] PUT /identity/v3/projects/2de244a4dc094ce1b653f848df46780e/users/640c2ed523034f61b3029bc9b6c543de/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:29.284720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a07ada-12ee-4b0a-b4ea-79dcff24fcfa None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:29.285586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a07ada-12ee-4b0a-b4ea-79dcff24fcfa None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:29.286089 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a07ada-12ee-4b0a-b4ea-79dcff24fcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:29.360213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-98a07ada-12ee-4b0a-b4ea-79dcff24fcfa None None] MFA Rules not processed for user `640c2ed523034f61b3029bc9b6c543de`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:29.361889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-98a07ada-12ee-4b0a-b4ea-79dcff24fcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:29.494599 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 832/1665] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:50:29.504405 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1cfae-960f-4b92-861f-8cbb0097989f admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:29.507881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-bef1cfae-960f-4b92-861f-8cbb0097989f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:29.675908 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:29.788193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1cfae-960f-4b92-861f-8cbb0097989f admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:29.800808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c52bc-82f2-4285-91e0-ce62328360e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:29.801956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c52bc-82f2-4285-91e0-ce62328360e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:29.802456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c52bc-82f2-4285-91e0-ce62328360e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:29.802949 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c52bc-82f2-4285-91e0-ce62328360e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:29.849232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c52bc-82f2-4285-91e0-ce62328360e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:29.852066 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c52bc-82f2-4285-91e0-ce62328360e5 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:29.891886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 834/1666] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:29.932597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:30.447716 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a07ada-12ee-4b0a-b4ea-79dcff24fcfa None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:30.450390 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-98a07ada-12ee-4b0a-b4ea-79dcff24fcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:30.719918 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a07ada-12ee-4b0a-b4ea-79dcff24fcfa None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:30.760209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e432b1-df9b-419c-b431-d6edc0f54bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:30.760209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e432b1-df9b-419c-b431-d6edc0f54bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:30.760209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e432b1-df9b-419c-b431-d6edc0f54bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:30.760209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e432b1-df9b-419c-b431-d6edc0f54bc4 admin admin] PATH_INFO: `/v3/users/8d8284bc38ba4b27862395823b8a34fb` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:30.775462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e432b1-df9b-419c-b431-d6edc0f54bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d8284bc38ba4b27862395823b8a34fb)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:30.783585 dv-cinder-847732-5-smb devstack@keystone.service[81877]: WARNING py.warnings [None req-b2e432b1-df9b-419c-b431-d6edc0f54bc4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:50:30.783585 dv-cinder-847732-5-smb devstack@keystone.service[81877]: warnings.warn(msg) Sep 07 16:50:30.783585 dv-cinder-847732-5-smb devstack@keystone.service[81877]: Sep 07 16:50:30.789186 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e432b1-df9b-419c-b431-d6edc0f54bc4 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:31.225466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b2e432b1-df9b-419c-b431-d6edc0f54bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d8284bc38ba4b27862395823b8a34fb'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:31.226445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b2e432b1-df9b-419c-b431-d6edc0f54bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d8284bc38ba4b27862395823b8a34fb'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:31.246544 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b2e432b1-df9b-419c-b431-d6edc0f54bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d8284bc38ba4b27862395823b8a34fb'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:31.292932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b2e432b1-df9b-419c-b431-d6edc0f54bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d8284bc38ba4b27862395823b8a34fb'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:31.298465 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b2e432b1-df9b-419c-b431-d6edc0f54bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d8284bc38ba4b27862395823b8a34fb'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:31.407660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 833/1667] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:50:30 2022] DELETE /identity/v3/users/8d8284bc38ba4b27862395823b8a34fb => generated 0 bytes in 961 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:31.426005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e2569-f053-4835-ad16-ddba03b70787 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:31.426593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e2569-f053-4835-ad16-ddba03b70787 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:31.427030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e2569-f053-4835-ad16-ddba03b70787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:31.500760 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-1c2e2569-f053-4835-ad16-ddba03b70787 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:31.505532 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1c2e2569-f053-4835-ad16-ddba03b70787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:31.671619 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 835/1668] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:31.739161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e432b1-df9b-419c-b431-d6edc0f54bc4 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:31.741719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b2e432b1-df9b-419c-b431-d6edc0f54bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:31.881634 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f9a38-0aab-4845-9f85-2a45237e0375 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:31.882909 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f9a38-0aab-4845-9f85-2a45237e0375 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:31.883376 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f9a38-0aab-4845-9f85-2a45237e0375 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:31.888344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 836/1669] 10.222.0.25 () {54 vars in 921 bytes} [Wed Sep 7 16:50:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:50:31.949269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e432b1-df9b-419c-b431-d6edc0f54bc4 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:31.958392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c8deb-16f0-47b4-bd7c-54316310e71a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:31.959439 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c8deb-16f0-47b4-bd7c-54316310e71a service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:31.959867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c8deb-16f0-47b4-bd7c-54316310e71a service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:31.967086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c8deb-16f0-47b4-bd7c-54316310e71a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:31.983052 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c8deb-16f0-47b4-bd7c-54316310e71a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:31.984921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c8deb-16f0-47b4-bd7c-54316310e71a service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:32.015379 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 834/1670] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:32.020207 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f9a38-0aab-4845-9f85-2a45237e0375 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:32.024279 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-542f9a38-0aab-4845-9f85-2a45237e0375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:32.040292 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9e661-d09a-4f49-9ddf-acf91264f381 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:32.042475 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9e661-d09a-4f49-9ddf-acf91264f381 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:32.043810 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9e661-d09a-4f49-9ddf-acf91264f381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:32.099762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f9a38-0aab-4845-9f85-2a45237e0375 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:32.107058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:32.124976 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887334e-3ae5-46cc-aec9-1d751a44acac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:32.124976 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887334e-3ae5-46cc-aec9-1d751a44acac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:32.124976 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887334e-3ae5-46cc-aec9-1d751a44acac admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:32.124976 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887334e-3ae5-46cc-aec9-1d751a44acac admin admin] PATH_INFO: `/v3/users/986395a3de49456fbf4a49265045120a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:32.133229 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887334e-3ae5-46cc-aec9-1d751a44acac admin admin] RBAC: Authorizing `identity:delete_user(user_id=986395a3de49456fbf4a49265045120a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:32.138113 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887334e-3ae5-46cc-aec9-1d751a44acac admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:32.178340 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-5aa9e661-d09a-4f49-9ddf-acf91264f381 None None] MFA Rules not processed for user `256e8478e5fb4c01acde0d597bae0b53`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:32.182806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-5aa9e661-d09a-4f49-9ddf-acf91264f381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:32.426143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 835/1671] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Sep 7 16:50:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:32.599248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-5887334e-3ae5-46cc-aec9-1d751a44acac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '986395a3de49456fbf4a49265045120a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:32.613087 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9e661-d09a-4f49-9ddf-acf91264f381 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:32.614820 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-5aa9e661-d09a-4f49-9ddf-acf91264f381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:32.640415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9e661-d09a-4f49-9ddf-acf91264f381 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:32.655763 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c552d9-0416-4cf4-8e6b-496aedbe11ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256e8478e5fb4c01acde0d597bae0b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:32.656420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c552d9-0416-4cf4-8e6b-496aedbe11ee service placement] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:32.656696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c552d9-0416-4cf4-8e6b-496aedbe11ee service placement] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:32.656963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c552d9-0416-4cf4-8e6b-496aedbe11ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:32.672943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c552d9-0416-4cf4-8e6b-496aedbe11ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:32.674910 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c552d9-0416-4cf4-8e6b-496aedbe11ee service placement] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:32.716038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 836/1672] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:50:32.744069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-5887334e-3ae5-46cc-aec9-1d751a44acac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '986395a3de49456fbf4a49265045120a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:32.745257 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-5887334e-3ae5-46cc-aec9-1d751a44acac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '986395a3de49456fbf4a49265045120a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:32.746424 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-5887334e-3ae5-46cc-aec9-1d751a44acac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '986395a3de49456fbf4a49265045120a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:32.760269 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-5887334e-3ae5-46cc-aec9-1d751a44acac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '986395a3de49456fbf4a49265045120a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:32.801458 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 837/1673] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:50:32 2022] DELETE /identity/v3/users/986395a3de49456fbf4a49265045120a => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:50:32.807392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687af04e-9134-415f-bd4e-3efd1338bf5f None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:32.810136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687af04e-9134-415f-bd4e-3efd1338bf5f None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:32.810136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687af04e-9134-415f-bd4e-3efd1338bf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:32.879513 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-687af04e-9134-415f-bd4e-3efd1338bf5f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:32.882422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-687af04e-9134-415f-bd4e-3efd1338bf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:33.085638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 837/1674] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:33.125715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887334e-3ae5-46cc-aec9-1d751a44acac admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:33.132906 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5887334e-3ae5-46cc-aec9-1d751a44acac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:33.358026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:33.426412 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887334e-3ae5-46cc-aec9-1d751a44acac admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:33.438838 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef84354-940d-44f4-add1-412f59f86d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:33.439591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef84354-940d-44f4-add1-412f59f86d2a service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:33.441093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef84354-940d-44f4-add1-412f59f86d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:33.441402 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef84354-940d-44f4-add1-412f59f86d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:33.470055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef84354-940d-44f4-add1-412f59f86d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:33.474574 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef84354-940d-44f4-add1-412f59f86d2a service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:33.508146 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 838/1675] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:34.399271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687af04e-9134-415f-bd4e-3efd1338bf5f None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:34.401812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-687af04e-9134-415f-bd4e-3efd1338bf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:34.464027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687af04e-9134-415f-bd4e-3efd1338bf5f None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:34.519448 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940fc9c-d758-452f-b2ce-ecf495eb30e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:34.522652 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940fc9c-d758-452f-b2ce-ecf495eb30e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:34.526621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940fc9c-d758-452f-b2ce-ecf495eb30e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:34.531244 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940fc9c-d758-452f-b2ce-ecf495eb30e2 admin admin] PATH_INFO: `/v3/projects/41654372561b4a018a8573b0ca48dfff` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:34.537003 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940fc9c-d758-452f-b2ce-ecf495eb30e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41654372561b4a018a8573b0ca48dfff)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:34.558968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940fc9c-d758-452f-b2ce-ecf495eb30e2 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:35.041921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3940fc9c-d758-452f-b2ce-ecf495eb30e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41654372561b4a018a8573b0ca48dfff', 'request_id': 'req-3940fc9c-d758-452f-b2ce-ecf495eb30e2'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:35.156775 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3940fc9c-d758-452f-b2ce-ecf495eb30e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41654372561b4a018a8573b0ca48dfff', 'request_id': 'req-3940fc9c-d758-452f-b2ce-ecf495eb30e2'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:35.197451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3940fc9c-d758-452f-b2ce-ecf495eb30e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41654372561b4a018a8573b0ca48dfff', 'request_id': 'req-3940fc9c-d758-452f-b2ce-ecf495eb30e2'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:35.274784 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3940fc9c-d758-452f-b2ce-ecf495eb30e2 admin admin] The token cache is being invalidate because project 41654372561b4a018a8573b0ca48dfff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:50:35.274784 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3940fc9c-d758-452f-b2ce-ecf495eb30e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:35.276178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3940fc9c-d758-452f-b2ce-ecf495eb30e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:35.290407 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 838/1676] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:50:34 2022] DELETE /identity/v3/projects/41654372561b4a018a8573b0ca48dfff => generated 0 bytes in 893 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:50:35.296797 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d6268-089a-489a-9d22-8cc15aa17b65 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:35.297625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d6268-089a-489a-9d22-8cc15aa17b65 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:35.297815 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d6268-089a-489a-9d22-8cc15aa17b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:35.391641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-d23d6268-089a-489a-9d22-8cc15aa17b65 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:35.392938 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-d23d6268-089a-489a-9d22-8cc15aa17b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:35.663239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 839/1677] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:35.674713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6544-a1ad-4ce4-920a-fa4c46b9f1d0 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:35.675328 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6544-a1ad-4ce4-920a-fa4c46b9f1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:35.676030 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6544-a1ad-4ce4-920a-fa4c46b9f1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:35.752608 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-0a9b6544-a1ad-4ce4-920a-fa4c46b9f1d0 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:35.757404 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0a9b6544-a1ad-4ce4-920a-fa4c46b9f1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:35.783820 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d6268-089a-489a-9d22-8cc15aa17b65 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:35.786102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-d23d6268-089a-489a-9d22-8cc15aa17b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:35.796465 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 839/1678] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:50:35.796465 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b6544-a1ad-4ce4-920a-fa4c46b9f1d0 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:35.828039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:35.830677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d6268-089a-489a-9d22-8cc15aa17b65 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:35.833817 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b6544-a1ad-4ce4-920a-fa4c46b9f1d0 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:35.856099 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2ac24-78a9-4151-ae9d-1325c4231280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:35.857168 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2ac24-78a9-4151-ae9d-1325c4231280 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:35.858197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2ac24-78a9-4151-ae9d-1325c4231280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:35.858695 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2ac24-78a9-4151-ae9d-1325c4231280 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:35.859984 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2ac24-78a9-4151-ae9d-1325c4231280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:50:35.860541 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2ac24-78a9-4151-ae9d-1325c4231280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:35.876998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2ac24-78a9-4151-ae9d-1325c4231280 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:35.883807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e13985-284d-4caf-ba6a-fed00c66b129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:35.884975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e13985-284d-4caf-ba6a-fed00c66b129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:35.885532 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e13985-284d-4caf-ba6a-fed00c66b129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:35.886026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e13985-284d-4caf-ba6a-fed00c66b129 admin admin] PATH_INFO: `/v3/projects/9e9177f6f0e04e2e86feb7183b6dac1c` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:35.908421 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e13985-284d-4caf-ba6a-fed00c66b129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9177f6f0e04e2e86feb7183b6dac1c)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:35.911062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: WARNING py.warnings [None req-98e13985-284d-4caf-ba6a-fed00c66b129 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:50:35.911062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: warnings.warn(msg) Sep 07 16:50:35.911062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: Sep 07 16:50:35.913794 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e13985-284d-4caf-ba6a-fed00c66b129 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:35.952139 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 840/1679] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:50:35.959516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2ac24-78a9-4151-ae9d-1325c4231280 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:36.031511 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2ac24-78a9-4151-ae9d-1325c4231280 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:36.090311 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bec0d1-cf39-4a37-be0c-1d92f21c646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:36.091601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bec0d1-cf39-4a37-be0c-1d92f21c646a admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:36.092631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bec0d1-cf39-4a37-be0c-1d92f21c646a admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:36.093149 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bec0d1-cf39-4a37-be0c-1d92f21c646a admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:36.094549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bec0d1-cf39-4a37-be0c-1d92f21c646a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:36.110547 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bec0d1-cf39-4a37-be0c-1d92f21c646a admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:36.324754 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 841/1680] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:35 2022] POST /identity/v3/projects => generated 369 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:36.329798 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6da3f-4421-44d1-9ebd-dab743dcca98 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:36.334355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6da3f-4421-44d1-9ebd-dab743dcca98 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:36.336054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6da3f-4421-44d1-9ebd-dab743dcca98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:36.381901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-98e13985-284d-4caf-ba6a-fed00c66b129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9177f6f0e04e2e86feb7183b6dac1c', 'request_id': 'req-98e13985-284d-4caf-ba6a-fed00c66b129'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:36.426047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-98e13985-284d-4caf-ba6a-fed00c66b129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9177f6f0e04e2e86feb7183b6dac1c', 'request_id': 'req-98e13985-284d-4caf-ba6a-fed00c66b129'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:36.502029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-27a6da3f-4421-44d1-9ebd-dab743dcca98 None None] MFA Rules not processed for user `7dc367b3f3e04ec48665feef4094715a`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:36.503238 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-98e13985-284d-4caf-ba6a-fed00c66b129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9177f6f0e04e2e86feb7183b6dac1c', 'request_id': 'req-98e13985-284d-4caf-ba6a-fed00c66b129'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:36.507963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-27a6da3f-4421-44d1-9ebd-dab743dcca98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:36.527380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-98e13985-284d-4caf-ba6a-fed00c66b129 admin admin] The token cache is being invalidate because project 9e9177f6f0e04e2e86feb7183b6dac1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:50:36.527815 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-98e13985-284d-4caf-ba6a-fed00c66b129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:36.532107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-98e13985-284d-4caf-ba6a-fed00c66b129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:36.533903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 840/1681] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:50:35 2022] DELETE /identity/v3/projects/9e9177f6f0e04e2e86feb7183b6dac1c => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:50:36.535616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e13985-284d-4caf-ba6a-fed00c66b129 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:36.542587 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-98e13985-284d-4caf-ba6a-fed00c66b129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:36.739316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e13985-284d-4caf-ba6a-fed00c66b129 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:36.772294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:36.823798 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 842/1682] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:36.831214 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6da3f-4421-44d1-9ebd-dab743dcca98 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:36.846151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-27a6da3f-4421-44d1-9ebd-dab743dcca98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:36.906361 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef12975-5eec-4ffb-8af7-84c402f455c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:36.907026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef12975-5eec-4ffb-8af7-84c402f455c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:36.907310 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef12975-5eec-4ffb-8af7-84c402f455c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:36.907624 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef12975-5eec-4ffb-8af7-84c402f455c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:36.910223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef12975-5eec-4ffb-8af7-84c402f455c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:36.917213 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef12975-5eec-4ffb-8af7-84c402f455c3 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:37.100668 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 841/1683] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:36 2022] POST /identity/v3/users => generated 285 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:37.103158 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b8096-e656-44eb-9558-f543654700c5 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:37.113688 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b8096-e656-44eb-9558-f543654700c5 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:37.113688 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b8096-e656-44eb-9558-f543654700c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:37.235093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6da3f-4421-44d1-9ebd-dab743dcca98 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:37.237298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-bb6b8096-e656-44eb-9558-f543654700c5 None None] MFA Rules not processed for user `7dc367b3f3e04ec48665feef4094715a`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:37.239521 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-bb6b8096-e656-44eb-9558-f543654700c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:37.270879 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cbf23-941e-4148-bc93-8dcb98363bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:37.276079 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cbf23-941e-4148-bc93-8dcb98363bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:37.276731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cbf23-941e-4148-bc93-8dcb98363bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:37.276991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cbf23-941e-4148-bc93-8dcb98363bfa admin admin] PATH_INFO: `/v3/users/640c2ed523034f61b3029bc9b6c543de` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:37.284578 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cbf23-941e-4148-bc93-8dcb98363bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=640c2ed523034f61b3029bc9b6c543de)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:37.302704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cbf23-941e-4148-bc93-8dcb98363bfa admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:37.303013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 842/1684] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:37.305245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5362f5-1cbb-40dd-9483-a1eeda7d0505 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:37.305701 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5362f5-1cbb-40dd-9483-a1eeda7d0505 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:37.306171 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5362f5-1cbb-40dd-9483-a1eeda7d0505 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:37.333422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 843/1685] 10.222.0.25 () {54 vars in 921 bytes} [Wed Sep 7 16:50:37 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:50:37.335834 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5362f5-1cbb-40dd-9483-a1eeda7d0505 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:37.426264 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5362f5-1cbb-40dd-9483-a1eeda7d0505 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:37.453868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862652a-0d7e-47fa-bded-6965cde83267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:37.454806 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862652a-0d7e-47fa-bded-6965cde83267 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:37.455280 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862652a-0d7e-47fa-bded-6965cde83267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:37.455821 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862652a-0d7e-47fa-bded-6965cde83267 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:37.459576 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862652a-0d7e-47fa-bded-6965cde83267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:37.486979 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862652a-0d7e-47fa-bded-6965cde83267 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:37.578217 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 844/1686] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:37.580005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862652a-0d7e-47fa-bded-6965cde83267 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:37.585672 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-4862652a-0d7e-47fa-bded-6965cde83267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:37.648687 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862652a-0d7e-47fa-bded-6965cde83267 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:37.682968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6943b89-6e8b-46cd-86b8-c8e43e8ff6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:37.693163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6943b89-6e8b-46cd-86b8-c8e43e8ff6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:37.693895 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6943b89-6e8b-46cd-86b8-c8e43e8ff6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:37.694558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6943b89-6e8b-46cd-86b8-c8e43e8ff6db admin admin] PATH_INFO: `/v3/users/4c033279a7634706b7e30955cddb4ce8` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:37.700440 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6943b89-6e8b-46cd-86b8-c8e43e8ff6db admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c033279a7634706b7e30955cddb4ce8)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:37.704607 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6943b89-6e8b-46cd-86b8-c8e43e8ff6db admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:37.758846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-018cbf23-941e-4148-bc93-8dcb98363bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '640c2ed523034f61b3029bc9b6c543de'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:37.762798 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-018cbf23-941e-4148-bc93-8dcb98363bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '640c2ed523034f61b3029bc9b6c543de'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:37.810041 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-018cbf23-941e-4148-bc93-8dcb98363bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '640c2ed523034f61b3029bc9b6c543de'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:37.849310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:37.898698 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-018cbf23-941e-4148-bc93-8dcb98363bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '640c2ed523034f61b3029bc9b6c543de'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:37.901598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-018cbf23-941e-4148-bc93-8dcb98363bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '640c2ed523034f61b3029bc9b6c543de'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:38.043426 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 843/1687] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:50:36 2022] DELETE /identity/v3/users/640c2ed523034f61b3029bc9b6c543de => generated 0 bytes in 1218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:38.048311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f6943b89-6e8b-46cd-86b8-c8e43e8ff6db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c033279a7634706b7e30955cddb4ce8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:38.059278 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cbf23-941e-4148-bc93-8dcb98363bfa admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:38.074300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-018cbf23-941e-4148-bc93-8dcb98363bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:38.189799 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f6943b89-6e8b-46cd-86b8-c8e43e8ff6db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c033279a7634706b7e30955cddb4ce8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:38.191454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f6943b89-6e8b-46cd-86b8-c8e43e8ff6db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c033279a7634706b7e30955cddb4ce8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:38.192500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f6943b89-6e8b-46cd-86b8-c8e43e8ff6db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c033279a7634706b7e30955cddb4ce8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:38.208253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f6943b89-6e8b-46cd-86b8-c8e43e8ff6db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c033279a7634706b7e30955cddb4ce8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:38.280619 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 845/1688] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:50:37 2022] DELETE /identity/v3/users/4c033279a7634706b7e30955cddb4ce8 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:38.288958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa378b5-5f7e-487d-a411-673106d10574 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:38.289356 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa378b5-5f7e-487d-a411-673106d10574 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:38.289643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa378b5-5f7e-487d-a411-673106d10574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:38.306634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cbf23-941e-4148-bc93-8dcb98363bfa admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:38.391260 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-bfa378b5-5f7e-487d-a411-673106d10574 None None] MFA Rules not processed for user `256e8478e5fb4c01acde0d597bae0b53`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:38.398498 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-bfa378b5-5f7e-487d-a411-673106d10574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:38.478275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e313569-ecbb-465e-89cf-9fefeab0f89b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:38.478980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e313569-ecbb-465e-89cf-9fefeab0f89b service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:38.479268 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e313569-ecbb-465e-89cf-9fefeab0f89b service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:38.479576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e313569-ecbb-465e-89cf-9fefeab0f89b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:38.490648 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-9e313569-ecbb-465e-89cf-9fefeab0f89b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:38.734736 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:38.763238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e313569-ecbb-465e-89cf-9fefeab0f89b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:38.771639 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e313569-ecbb-465e-89cf-9fefeab0f89b service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:38.790165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 846/1689] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Sep 7 16:50:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:38.792553 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa378b5-5f7e-487d-a411-673106d10574 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:38.797612 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-bfa378b5-5f7e-487d-a411-673106d10574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:38.816058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 844/1690] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:38.818116 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2e3d6-19cb-48df-b46e-09ab5fbf9f5f None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:38.818580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2e3d6-19cb-48df-b46e-09ab5fbf9f5f None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:38.819019 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2e3d6-19cb-48df-b46e-09ab5fbf9f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:38.926141 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-8bf2e3d6-19cb-48df-b46e-09ab5fbf9f5f None None] MFA Rules not processed for user `e5dab09914634854bed1c1c4a1527746`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:38.932023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-8bf2e3d6-19cb-48df-b46e-09ab5fbf9f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:39.028689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa378b5-5f7e-487d-a411-673106d10574 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:39.048490 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e01ec1-17a2-4300-b003-706d1689303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:39.052168 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e01ec1-17a2-4300-b003-706d1689303c admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:39.054021 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e01ec1-17a2-4300-b003-706d1689303c admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:39.054567 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e01ec1-17a2-4300-b003-706d1689303c admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:39.059075 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e01ec1-17a2-4300-b003-706d1689303c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:39.068526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e01ec1-17a2-4300-b003-706d1689303c admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:39.197331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 847/1691] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:39.199764 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e01ec1-17a2-4300-b003-706d1689303c admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:39.207832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a8e01ec1-17a2-4300-b003-706d1689303c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:39.242850 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:39.251137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e01ec1-17a2-4300-b003-706d1689303c admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:39.276763 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfab0f-564f-4e56-8e76-e068cd8479aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256e8478e5fb4c01acde0d597bae0b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:39.276763 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfab0f-564f-4e56-8e76-e068cd8479aa service placement] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:39.276763 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfab0f-564f-4e56-8e76-e068cd8479aa service placement] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:39.276763 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfab0f-564f-4e56-8e76-e068cd8479aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:39.314069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfab0f-564f-4e56-8e76-e068cd8479aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:39.320681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfab0f-564f-4e56-8e76-e068cd8479aa service placement] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:39.321169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 845/1692] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 504 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:39.322989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2e3d6-19cb-48df-b46e-09ab5fbf9f5f None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:39.342453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 848/1693] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:39.345515 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf3273-c129-4fa0-9633-d25f09c31efb None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:39.345924 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf3273-c129-4fa0-9633-d25f09c31efb None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:39.346177 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf3273-c129-4fa0-9633-d25f09c31efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:39.381297 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2e3d6-19cb-48df-b46e-09ab5fbf9f5f None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:39.383529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-5cbf3273-c129-4fa0-9633-d25f09c31efb None None] MFA Rules not processed for user `e5dab09914634854bed1c1c4a1527746`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:39.386660 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5cbf3273-c129-4fa0-9633-d25f09c31efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:39.408206 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cc140-c367-4415-a55d-3f9f8bec8186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:39.409547 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cc140-c367-4415-a55d-3f9f8bec8186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:39.412406 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cc140-c367-4415-a55d-3f9f8bec8186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:39.413008 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cc140-c367-4415-a55d-3f9f8bec8186 admin admin] PATH_INFO: `/v3/projects/e91176e7223640fbbc8504330d0a47b3/users/f943747a30624dde8cb19ac132f601e8/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:39.427494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 849/1694] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:39.439181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf3273-c129-4fa0-9633-d25f09c31efb None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:39.442748 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5cbf3273-c129-4fa0-9633-d25f09c31efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:39.528228 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6cc140-c367-4415-a55d-3f9f8bec8186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91176e7223640fbbc8504330d0a47b3, user_id=f943747a30624dde8cb19ac132f601e8, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:39.558445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6cc140-c367-4415-a55d-3f9f8bec8186 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:39.567116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf3273-c129-4fa0-9633-d25f09c31efb None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:39.590768 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e67590-f799-4cc9-8544-397b751e8ee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:39.609683 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e67590-f799-4cc9-8544-397b751e8ee6 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:39.609683 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e67590-f799-4cc9-8544-397b751e8ee6 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:39.609683 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e67590-f799-4cc9-8544-397b751e8ee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:39.628616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e67590-f799-4cc9-8544-397b751e8ee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:39.643843 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e67590-f799-4cc9-8544-397b751e8ee6 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:39.671714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 850/1695] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:39.713103 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 846/1696] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:39 2022] PUT /identity/v3/projects/e91176e7223640fbbc8504330d0a47b3/users/f943747a30624dde8cb19ac132f601e8/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:39.743771 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3738c6-f412-4ab4-b8c4-f03555e28e62 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:39.744604 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3738c6-f412-4ab4-b8c4-f03555e28e62 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:39.745260 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3738c6-f412-4ab4-b8c4-f03555e28e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:39.869802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-aa3738c6-f412-4ab4-b8c4-f03555e28e62 None None] MFA Rules not processed for user `f943747a30624dde8cb19ac132f601e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:39.872183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-aa3738c6-f412-4ab4-b8c4-f03555e28e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:40.081462 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 851/1697] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:40.082965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931ac85-3de3-4163-a57f-242accb84dfa None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:40.083465 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931ac85-3de3-4163-a57f-242accb84dfa None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:40.084037 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931ac85-3de3-4163-a57f-242accb84dfa None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:40.086673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 847/1698] 10.222.0.25 () {54 vars in 912 bytes} [Wed Sep 7 16:50:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:50:40.088820 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3738c6-f412-4ab4-b8c4-f03555e28e62 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:40.120545 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0ac42-6a75-4c8e-abfe-fb0cbacb3495 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:40.121144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0ac42-6a75-4c8e-abfe-fb0cbacb3495 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:40.121693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0ac42-6a75-4c8e-abfe-fb0cbacb3495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:40.318019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3738c6-f412-4ab4-b8c4-f03555e28e62 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:40.344394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f9e82-5847-499f-8135-509e4cdd8497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:40.345189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f9e82-5847-499f-8135-509e4cdd8497 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:40.347743 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f9e82-5847-499f-8135-509e4cdd8497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:40.348794 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f9e82-5847-499f-8135-509e4cdd8497 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:40.351463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-cbf0ac42-6a75-4c8e-abfe-fb0cbacb3495 None None] MFA Rules not processed for user `bac099b78bd04e02b8614c8afce53ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:40.354807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f9e82-5847-499f-8135-509e4cdd8497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:40.360125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f9e82-5847-499f-8135-509e4cdd8497 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:40.362022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-cbf0ac42-6a75-4c8e-abfe-fb0cbacb3495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:40.429646 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:40.584078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 852/1699] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:40 2022] POST /identity/v3/projects => generated 369 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:40.595707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f9e82-5847-499f-8135-509e4cdd8497 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:40.653649 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 848/1700] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Sep 7 16:50:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 535 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:50:40.738144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0ac42-6a75-4c8e-abfe-fb0cbacb3495 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:40.745949 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-cbf0ac42-6a75-4c8e-abfe-fb0cbacb3495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:40.800334 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0ac42-6a75-4c8e-abfe-fb0cbacb3495 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:40.924170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f9e82-5847-499f-8135-509e4cdd8497 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:40.948531 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300a433-6cd0-4508-8cf8-ee82bb759de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:40.949462 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300a433-6cd0-4508-8cf8-ee82bb759de2 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:40.949950 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300a433-6cd0-4508-8cf8-ee82bb759de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:40.950551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300a433-6cd0-4508-8cf8-ee82bb759de2 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:40.951892 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300a433-6cd0-4508-8cf8-ee82bb759de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:40.954033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300a433-6cd0-4508-8cf8-ee82bb759de2 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:41.002512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e51ed7-a447-4fe2-98fb-26832fec8ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:41.003164 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e51ed7-a447-4fe2-98fb-26832fec8ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:41.003434 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e51ed7-a447-4fe2-98fb-26832fec8ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:41.003952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e51ed7-a447-4fe2-98fb-26832fec8ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:41.013056 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e51ed7-a447-4fe2-98fb-26832fec8ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:41.017368 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e51ed7-a447-4fe2-98fb-26832fec8ea2 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:41.026701 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 849/1701] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:41.027896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e51ed7-a447-4fe2-98fb-26832fec8ea2 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:41.029662 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-79e51ed7-a447-4fe2-98fb-26832fec8ea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:41.053952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e51ed7-a447-4fe2-98fb-26832fec8ea2 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:41.066875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938e1bc-e86a-4345-b07d-34d64accc34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:41.070847 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938e1bc-e86a-4345-b07d-34d64accc34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:41.086194 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 853/1702] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:40 2022] POST /identity/v3/users => generated 291 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:41.086194 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc684a38-a36e-410a-b402-eac36627ffac None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:41.086194 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc684a38-a36e-410a-b402-eac36627ffac None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:41.086194 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc684a38-a36e-410a-b402-eac36627ffac None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:41.086828 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938e1bc-e86a-4345-b07d-34d64accc34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:41.086828 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938e1bc-e86a-4345-b07d-34d64accc34c admin admin] PATH_INFO: `/v3/projects/2de244a4dc094ce1b653f848df46780e` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:41.086828 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938e1bc-e86a-4345-b07d-34d64accc34c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de244a4dc094ce1b653f848df46780e)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:41.087464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 854/1703] 10.222.0.25 () {54 vars in 912 bytes} [Wed Sep 7 16:50:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:50:41.087464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc684a38-a36e-410a-b402-eac36627ffac None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:41.088787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938e1bc-e86a-4345-b07d-34d64accc34c admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:41.122609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc684a38-a36e-410a-b402-eac36627ffac None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:41.127808 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:41.136225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bdbdd-f40f-4319-9329-beead4ebc345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:41.136865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bdbdd-f40f-4319-9329-beead4ebc345 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:41.137134 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bdbdd-f40f-4319-9329-beead4ebc345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:41.137403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bdbdd-f40f-4319-9329-beead4ebc345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:41.138069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bdbdd-f40f-4319-9329-beead4ebc345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:41.148072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bdbdd-f40f-4319-9329-beead4ebc345 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:41.229287 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 855/1704] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:41.231340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742881c9-d987-4ebb-843e-f9ba4ed610b9 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:41.231880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742881c9-d987-4ebb-843e-f9ba4ed610b9 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:41.232494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742881c9-d987-4ebb-843e-f9ba4ed610b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:41.293419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-742881c9-d987-4ebb-843e-f9ba4ed610b9 None None] MFA Rules not processed for user `bac099b78bd04e02b8614c8afce53ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:41.298192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-742881c9-d987-4ebb-843e-f9ba4ed610b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:41.311463 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 856/1705] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Sep 7 16:50:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:41.320082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742881c9-d987-4ebb-843e-f9ba4ed610b9 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:41.322653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-742881c9-d987-4ebb-843e-f9ba4ed610b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:41.343717 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742881c9-d987-4ebb-843e-f9ba4ed610b9 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:41.359928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f938e1bc-e86a-4345-b07d-34d64accc34c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de244a4dc094ce1b653f848df46780e', 'request_id': 'req-f938e1bc-e86a-4345-b07d-34d64accc34c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:41.463345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f938e1bc-e86a-4345-b07d-34d64accc34c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de244a4dc094ce1b653f848df46780e', 'request_id': 'req-f938e1bc-e86a-4345-b07d-34d64accc34c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:41.474725 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f938e1bc-e86a-4345-b07d-34d64accc34c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de244a4dc094ce1b653f848df46780e', 'request_id': 'req-f938e1bc-e86a-4345-b07d-34d64accc34c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:41.483577 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720bcb2-2dd1-4434-b772-4883ce8665f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:41.485688 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720bcb2-2dd1-4434-b772-4883ce8665f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:41.486238 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720bcb2-2dd1-4434-b772-4883ce8665f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:41.486626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720bcb2-2dd1-4434-b772-4883ce8665f7 admin admin] PATH_INFO: `/v3/projects/ba1d20bbb1d14de59aa02b979e88fa56` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:41.492698 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720bcb2-2dd1-4434-b772-4883ce8665f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba1d20bbb1d14de59aa02b979e88fa56)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:41.494919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720bcb2-2dd1-4434-b772-4883ce8665f7 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:41.497626 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f938e1bc-e86a-4345-b07d-34d64accc34c admin admin] The token cache is being invalidate because project 2de244a4dc094ce1b653f848df46780e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:50:41.497903 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f938e1bc-e86a-4345-b07d-34d64accc34c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:41.500553 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f938e1bc-e86a-4345-b07d-34d64accc34c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:41.506267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 850/1706] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:50:41 2022] DELETE /identity/v3/projects/2de244a4dc094ce1b653f848df46780e => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:41.508160 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b35b8a-adb5-4ce9-97c2-0146054ae541 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:41.508459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b35b8a-adb5-4ce9-97c2-0146054ae541 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:41.508738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b35b8a-adb5-4ce9-97c2-0146054ae541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:41.571597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-27b35b8a-adb5-4ce9-97c2-0146054ae541 None None] MFA Rules not processed for user `7a3f8b78523e4c3790b049fc783c96fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:41.572946 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-27b35b8a-adb5-4ce9-97c2-0146054ae541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:41.798360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:41.819366 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9720bcb2-2dd1-4434-b772-4883ce8665f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba1d20bbb1d14de59aa02b979e88fa56', 'request_id': 'req-9720bcb2-2dd1-4434-b772-4883ce8665f7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:41.882450 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9720bcb2-2dd1-4434-b772-4883ce8665f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba1d20bbb1d14de59aa02b979e88fa56', 'request_id': 'req-9720bcb2-2dd1-4434-b772-4883ce8665f7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:42.053061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 851/1707] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 546 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:42.054692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b35b8a-adb5-4ce9-97c2-0146054ae541 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:42.063718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-27b35b8a-adb5-4ce9-97c2-0146054ae541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:42.066724 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9720bcb2-2dd1-4434-b772-4883ce8665f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba1d20bbb1d14de59aa02b979e88fa56', 'request_id': 'req-9720bcb2-2dd1-4434-b772-4883ce8665f7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:42.131944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b35b8a-adb5-4ce9-97c2-0146054ae541 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:42.142919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9720bcb2-2dd1-4434-b772-4883ce8665f7 admin admin] The token cache is being invalidate because project ba1d20bbb1d14de59aa02b979e88fa56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:50:42.143349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9720bcb2-2dd1-4434-b772-4883ce8665f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:42.159189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9720bcb2-2dd1-4434-b772-4883ce8665f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:42.163991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 857/1708] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:50:41 2022] DELETE /identity/v3/projects/ba1d20bbb1d14de59aa02b979e88fa56 => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:42.168268 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720bcb2-2dd1-4434-b772-4883ce8665f7 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:42.182955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9720bcb2-2dd1-4434-b772-4883ce8665f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:42.277214 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d9583-31da-4773-a3bc-af6659ae5fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:42.279180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d9583-31da-4773-a3bc-af6659ae5fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:42.280197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d9583-31da-4773-a3bc-af6659ae5fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:42.280949 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d9583-31da-4773-a3bc-af6659ae5fa9 admin admin] PATH_INFO: `/v3/projects/d6aa9a80462b4e168f37c0e1d6cde6ab/users/b033aaa2670b4726858a06e805e07182/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:42.316529 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d9583-31da-4773-a3bc-af6659ae5fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6aa9a80462b4e168f37c0e1d6cde6ab, user_id=b033aaa2670b4726858a06e805e07182, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:42.320476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d9583-31da-4773-a3bc-af6659ae5fa9 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:42.392620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720bcb2-2dd1-4434-b772-4883ce8665f7 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:42.411182 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84104f2b-1713-428b-9de9-a702c3257286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:42.411758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104f2b-1713-428b-9de9-a702c3257286 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:42.412019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104f2b-1713-428b-9de9-a702c3257286 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:42.412281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104f2b-1713-428b-9de9-a702c3257286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:42.417911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-84104f2b-1713-428b-9de9-a702c3257286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:42.444013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84104f2b-1713-428b-9de9-a702c3257286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:42.448319 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84104f2b-1713-428b-9de9-a702c3257286 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:42.465085 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 852/1709] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:42 2022] PUT /identity/v3/projects/d6aa9a80462b4e168f37c0e1d6cde6ab/users/b033aaa2670b4726858a06e805e07182/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:42.468145 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf828c2-5580-48d7-9774-8ebda390ecba None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:42.477815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf828c2-5580-48d7-9774-8ebda390ecba None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:42.478258 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf828c2-5580-48d7-9774-8ebda390ecba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:42.482079 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 858/1710] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:42.484340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84104f2b-1713-428b-9de9-a702c3257286 service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:42.490131 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-84104f2b-1713-428b-9de9-a702c3257286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:42.522349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84104f2b-1713-428b-9de9-a702c3257286 service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:42.551678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-fcf828c2-5580-48d7-9774-8ebda390ecba None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:42.555527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-fcf828c2-5580-48d7-9774-8ebda390ecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:42.596817 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:42.700745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d342d0-db7b-4a3f-8494-44b3d800ddac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:42.701513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d342d0-db7b-4a3f-8494-44b3d800ddac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:42.701795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d342d0-db7b-4a3f-8494-44b3d800ddac admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:42.702069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d342d0-db7b-4a3f-8494-44b3d800ddac admin admin] PATH_INFO: `/v3/users/c432f36402d84ffe8df6688f38d075d8` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:42.704251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d342d0-db7b-4a3f-8494-44b3d800ddac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c432f36402d84ffe8df6688f38d075d8)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:42.706309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d342d0-db7b-4a3f-8494-44b3d800ddac admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:42.843282 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 853/1711] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:42.846927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d23de-c43b-4c44-8775-b3978477767e None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:42.847707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d23de-c43b-4c44-8775-b3978477767e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:42.848528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d23de-c43b-4c44-8775-b3978477767e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:42.921987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-240d23de-c43b-4c44-8775-b3978477767e None None] MFA Rules not processed for user `be6d79591cf14650a82b2b45fa8fd4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:42.924400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-240d23de-c43b-4c44-8775-b3978477767e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:43.048821 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f5d342d0-db7b-4a3f-8494-44b3d800ddac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c432f36402d84ffe8df6688f38d075d8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:43.086673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 854/1712] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:43.094640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d23de-c43b-4c44-8775-b3978477767e None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:43.100669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-240d23de-c43b-4c44-8775-b3978477767e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:43.133666 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d23de-c43b-4c44-8775-b3978477767e None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:43.148021 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c86854-b445-4c21-919c-d8de5dad1199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:43.148919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c86854-b445-4c21-919c-d8de5dad1199 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:43.149269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c86854-b445-4c21-919c-d8de5dad1199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:43.149678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c86854-b445-4c21-919c-d8de5dad1199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:43.150366 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c86854-b445-4c21-919c-d8de5dad1199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:43.157766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c86854-b445-4c21-919c-d8de5dad1199 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:43.199744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 855/1713] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:43.199744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c86854-b445-4c21-919c-d8de5dad1199 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:43.200420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f6c86854-b445-4c21-919c-d8de5dad1199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:43.224524 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f5d342d0-db7b-4a3f-8494-44b3d800ddac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c432f36402d84ffe8df6688f38d075d8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:43.226187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f5d342d0-db7b-4a3f-8494-44b3d800ddac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c432f36402d84ffe8df6688f38d075d8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:43.227667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f5d342d0-db7b-4a3f-8494-44b3d800ddac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c432f36402d84ffe8df6688f38d075d8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:43.244898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f5d342d0-db7b-4a3f-8494-44b3d800ddac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c432f36402d84ffe8df6688f38d075d8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:43.307606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 859/1714] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:50:42 2022] DELETE /identity/v3/users/c432f36402d84ffe8df6688f38d075d8 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:43.307606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0880ee-7129-4b3d-aa83-f7aae087916d None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:43.307606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0880ee-7129-4b3d-aa83-f7aae087916d None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:43.307606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0880ee-7129-4b3d-aa83-f7aae087916d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:43.309594 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:43.332605 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c86854-b445-4c21-919c-d8de5dad1199 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:43.342635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-ce0880ee-7129-4b3d-aa83-f7aae087916d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:43.345160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ce0880ee-7129-4b3d-aa83-f7aae087916d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:43.585204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83d0de-a77b-4b6c-88cc-2ca22e2ab997 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:43.589098 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83d0de-a77b-4b6c-88cc-2ca22e2ab997 service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:43.591105 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83d0de-a77b-4b6c-88cc-2ca22e2ab997 service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:43.594884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83d0de-a77b-4b6c-88cc-2ca22e2ab997 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:43.602920 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:43.605452 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1a83d0de-a77b-4b6c-88cc-2ca22e2ab997 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:43.648778 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 860/1715] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:43.671020 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0880ee-7129-4b3d-aa83-f7aae087916d None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:43.679564 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ce0880ee-7129-4b3d-aa83-f7aae087916d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:43.912433 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0880ee-7129-4b3d-aa83-f7aae087916d None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:43.920351 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83d0de-a77b-4b6c-88cc-2ca22e2ab997 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:43.931800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83d0de-a77b-4b6c-88cc-2ca22e2ab997 service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:43.934184 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298616b-34a0-496d-8d58-c86344e6be96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256e8478e5fb4c01acde0d597bae0b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:43.938672 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298616b-34a0-496d-8d58-c86344e6be96 service placement] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:43.938672 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298616b-34a0-496d-8d58-c86344e6be96 service placement] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:43.938672 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298616b-34a0-496d-8d58-c86344e6be96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:43.940727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9298616b-34a0-496d-8d58-c86344e6be96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:43.944578 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 856/1716] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:43.947081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83d0de-a77b-4b6c-88cc-2ca22e2ab997 service nova] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:43.948958 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1a83d0de-a77b-4b6c-88cc-2ca22e2ab997 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:43.965207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83d0de-a77b-4b6c-88cc-2ca22e2ab997 service nova] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:43.971837 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298616b-34a0-496d-8d58-c86344e6be96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:43.973700 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298616b-34a0-496d-8d58-c86344e6be96 service placement] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:43.978600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ad314-dccd-4f39-83b5-a04afe2c2335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:43.979774 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ad314-dccd-4f39-83b5-a04afe2c2335 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:43.980327 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ad314-dccd-4f39-83b5-a04afe2c2335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:43.980971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ad314-dccd-4f39-83b5-a04afe2c2335 admin admin] PATH_INFO: `/v3/projects/d6aa9a80462b4e168f37c0e1d6cde6ab/users/b033aaa2670b4726858a06e805e07182/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:43.984830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ad314-dccd-4f39-83b5-a04afe2c2335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6aa9a80462b4e168f37c0e1d6cde6ab, user_id=b033aaa2670b4726858a06e805e07182, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:43.992592 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 861/1717] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:43.995163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298616b-34a0-496d-8d58-c86344e6be96 service placement] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:44.005203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ad314-dccd-4f39-83b5-a04afe2c2335 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:44.014184 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298616b-34a0-496d-8d58-c86344e6be96 service placement] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:44.023933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38b932-f643-480c-9a91-be1112c4a19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:44.024512 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38b932-f643-480c-9a91-be1112c4a19c admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:44.024806 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38b932-f643-480c-9a91-be1112c4a19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:44.025087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38b932-f643-480c-9a91-be1112c4a19c admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:44.025895 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38b932-f643-480c-9a91-be1112c4a19c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:50:44.026394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38b932-f643-480c-9a91-be1112c4a19c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:44.028255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38b932-f643-480c-9a91-be1112c4a19c admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:44.043987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 857/1718] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:43 2022] PUT /identity/v3/projects/d6aa9a80462b4e168f37c0e1d6cde6ab/users/b033aaa2670b4726858a06e805e07182/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:44.047097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 862/1719] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:50:44.048121 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38b932-f643-480c-9a91-be1112c4a19c admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:44.050930 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753417f8-15d2-491b-8246-babee5a5fef2 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:44.051747 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753417f8-15d2-491b-8246-babee5a5fef2 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:44.052561 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753417f8-15d2-491b-8246-babee5a5fef2 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:44.059188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 858/1720] 10.222.0.25 () {54 vars in 961 bytes} [Wed Sep 7 16:50:44 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:50:44.061001 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c707783-c31f-4f21-8b33-3c8a7942b0a4 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:44.061305 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c707783-c31f-4f21-8b33-3c8a7942b0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:44.061580 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c707783-c31f-4f21-8b33-3c8a7942b0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:44.063903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9e38b932-f643-480c-9a91-be1112c4a19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:44.087578 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38b932-f643-480c-9a91-be1112c4a19c admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:44.111407 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-1c707783-c31f-4f21-8b33-3c8a7942b0a4 None None] MFA Rules not processed for user `7dc367b3f3e04ec48665feef4094715a`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:44.112701 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1c707783-c31f-4f21-8b33-3c8a7942b0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:44.224584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218a768-9032-45ce-960a-c1ac9c8007b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:44.228655 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218a768-9032-45ce-960a-c1ac9c8007b9 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:44.232174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218a768-9032-45ce-960a-c1ac9c8007b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:44.233036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218a768-9032-45ce-960a-c1ac9c8007b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:44.243609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-0218a768-9032-45ce-960a-c1ac9c8007b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:44.265107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 859/1721] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:44.266827 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c707783-c31f-4f21-8b33-3c8a7942b0a4 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:44.285219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:44.433378 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c707783-c31f-4f21-8b33-3c8a7942b0a4 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:44.447753 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218a768-9032-45ce-960a-c1ac9c8007b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:44.453936 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218a768-9032-45ce-960a-c1ac9c8007b9 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:44.468574 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1e324-509c-493d-b31e-698baa4f6308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:44.469610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1e324-509c-493d-b31e-698baa4f6308 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:44.470158 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1e324-509c-493d-b31e-698baa4f6308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:44.470622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1e324-509c-493d-b31e-698baa4f6308 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:44.471716 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1e324-509c-493d-b31e-698baa4f6308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:44.489769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1e324-509c-493d-b31e-698baa4f6308 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:44.499978 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 863/1722] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:44.502551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:44.505502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27c4c4-d1a6-4019-b8ed-f7e7d1122b41 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:44.507522 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27c4c4-d1a6-4019-b8ed-f7e7d1122b41 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:44.512947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27c4c4-d1a6-4019-b8ed-f7e7d1122b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:44.618764 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-da27c4c4-d1a6-4019-b8ed-f7e7d1122b41 None None] MFA Rules not processed for user `b033aaa2670b4726858a06e805e07182`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:44.618764 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-da27c4c4-d1a6-4019-b8ed-f7e7d1122b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:44.716687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 860/1723] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:44 2022] POST /identity/v3/projects => generated 357 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:44.729039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3024d4-3411-4d3e-a171-9f1fb010af14 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:44.729039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3024d4-3411-4d3e-a171-9f1fb010af14 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:44.729039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3024d4-3411-4d3e-a171-9f1fb010af14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:44.766490 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 864/1724] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:44.767410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27c4c4-d1a6-4019-b8ed-f7e7d1122b41 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:44.789730 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-da27c4c4-d1a6-4019-b8ed-f7e7d1122b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:44.844049 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27c4c4-d1a6-4019-b8ed-f7e7d1122b41 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:44.879519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-3a3024d4-3411-4d3e-a171-9f1fb010af14 None None] MFA Rules not processed for user `256e8478e5fb4c01acde0d597bae0b53`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:44.886885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3a3024d4-3411-4d3e-a171-9f1fb010af14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:45.043642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a649c-4ee3-480c-99d1-5665fac6f09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:45.045366 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a649c-4ee3-480c-99d1-5665fac6f09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:45.054166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a649c-4ee3-480c-99d1-5665fac6f09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:45.056999 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a649c-4ee3-480c-99d1-5665fac6f09b admin admin] PATH_INFO: `/v3/projects/8e1b7b72971e4ae5834c6ebad1f1954e` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:45.058097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 861/1725] 10.222.0.25 () {58 vars in 1058 bytes} [Wed Sep 7 16:50:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:45.059185 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3024d4-3411-4d3e-a171-9f1fb010af14 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:45.060384 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a649c-4ee3-480c-99d1-5665fac6f09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1b7b72971e4ae5834c6ebad1f1954e)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:45.079614 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a649c-4ee3-480c-99d1-5665fac6f09b admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:45.079853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3024d4-3411-4d3e-a171-9f1fb010af14 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:45.093153 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b861a-82ed-4054-852f-208cee2ca79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:45.098975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b861a-82ed-4054-852f-208cee2ca79a admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:45.098975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b861a-82ed-4054-852f-208cee2ca79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:45.098975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b861a-82ed-4054-852f-208cee2ca79a admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:45.100259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b861a-82ed-4054-852f-208cee2ca79a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:45.105330 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b861a-82ed-4054-852f-208cee2ca79a admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:45.248030 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 862/1726] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:45 2022] POST /identity/v3/users => generated 279 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:45.250896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b861a-82ed-4054-852f-208cee2ca79a admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:45.255700 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-068b861a-82ed-4054-852f-208cee2ca79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:45.319415 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:45.388118 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-048a649c-4ee3-480c-99d1-5665fac6f09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1b7b72971e4ae5834c6ebad1f1954e', 'request_id': 'req-048a649c-4ee3-480c-99d1-5665fac6f09b'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:45.411434 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-048a649c-4ee3-480c-99d1-5665fac6f09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1b7b72971e4ae5834c6ebad1f1954e', 'request_id': 'req-048a649c-4ee3-480c-99d1-5665fac6f09b'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:45.520140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b861a-82ed-4054-852f-208cee2ca79a admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:45.552209 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-048a649c-4ee3-480c-99d1-5665fac6f09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1b7b72971e4ae5834c6ebad1f1954e', 'request_id': 'req-048a649c-4ee3-480c-99d1-5665fac6f09b'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:45.603855 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-048a649c-4ee3-480c-99d1-5665fac6f09b admin admin] The token cache is being invalidate because project 8e1b7b72971e4ae5834c6ebad1f1954e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:50:45.605756 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-048a649c-4ee3-480c-99d1-5665fac6f09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:45.607533 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-048a649c-4ee3-480c-99d1-5665fac6f09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:45.610670 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 865/1727] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:50:44 2022] DELETE /identity/v3/projects/8e1b7b72971e4ae5834c6ebad1f1954e => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:45.614275 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a649c-4ee3-480c-99d1-5665fac6f09b admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:45.615494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-048a649c-4ee3-480c-99d1-5665fac6f09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:45.701448 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed0ddd-2a1f-4253-9c3b-1bb623e6e9ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:45.702432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed0ddd-2a1f-4253-9c3b-1bb623e6e9ec service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:45.702713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed0ddd-2a1f-4253-9c3b-1bb623e6e9ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:45.702986 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed0ddd-2a1f-4253-9c3b-1bb623e6e9ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:45.708392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f0ed0ddd-2a1f-4253-9c3b-1bb623e6e9ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:45.844060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:45.903435 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a649c-4ee3-480c-99d1-5665fac6f09b admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:45.904167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed0ddd-2a1f-4253-9c3b-1bb623e6e9ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:45.906611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed0ddd-2a1f-4253-9c3b-1bb623e6e9ec service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:45.918583 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f1059-c42e-4d13-b3ed-fd070859b9d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256e8478e5fb4c01acde0d597bae0b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:45.919097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f1059-c42e-4d13-b3ed-fd070859b9d2 service placement] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:45.919321 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f1059-c42e-4d13-b3ed-fd070859b9d2 service placement] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:45.919932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f1059-c42e-4d13-b3ed-fd070859b9d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:45.927832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-aa0f1059-c42e-4d13-b3ed-fd070859b9d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:45.952203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 863/1728] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:45.953568 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed0ddd-2a1f-4253-9c3b-1bb623e6e9ec service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:45.962321 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f0ed0ddd-2a1f-4253-9c3b-1bb623e6e9ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:45.983572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f1059-c42e-4d13-b3ed-fd070859b9d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:45.992184 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f1059-c42e-4d13-b3ed-fd070859b9d2 service placement] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:46.044519 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 866/1729] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:46.051817 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c449a-cc00-49e0-a6b5-c6323bdd76ab None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:46.052119 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c449a-cc00-49e0-a6b5-c6323bdd76ab None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:46.052387 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c449a-cc00-49e0-a6b5-c6323bdd76ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:46.135050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-5b8c449a-cc00-49e0-a6b5-c6323bdd76ab None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:46.137632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5b8c449a-cc00-49e0-a6b5-c6323bdd76ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:46.228826 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed0ddd-2a1f-4253-9c3b-1bb623e6e9ec service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:46.251049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e937f-3aad-45ae-9623-3896c6c7b533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:46.251049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e937f-3aad-45ae-9623-3896c6c7b533 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:46.251049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e937f-3aad-45ae-9623-3896c6c7b533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:46.251395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e937f-3aad-45ae-9623-3896c6c7b533 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:46.252084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e937f-3aad-45ae-9623-3896c6c7b533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:46.259444 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e937f-3aad-45ae-9623-3896c6c7b533 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:46.295613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 864/1730] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:46.297337 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e937f-3aad-45ae-9623-3896c6c7b533 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:46.333133 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e937f-3aad-45ae-9623-3896c6c7b533 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:46.348344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdce2ec-d0a3-4024-bea6-37a3d426b77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:46.350045 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdce2ec-d0a3-4024-bea6-37a3d426b77b admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:46.350396 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdce2ec-d0a3-4024-bea6-37a3d426b77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:46.350670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdce2ec-d0a3-4024-bea6-37a3d426b77b admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:46.351343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdce2ec-d0a3-4024-bea6-37a3d426b77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:46.358876 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdce2ec-d0a3-4024-bea6-37a3d426b77b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:46.384056 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 865/1731] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:46.386668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdce2ec-d0a3-4024-bea6-37a3d426b77b admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:46.409914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 867/1732] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:46.414917 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdce2ec-d0a3-4024-bea6-37a3d426b77b admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:46.419390 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5c59b-cc91-4076-9e96-ae798431b1cd None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:46.421099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5c59b-cc91-4076-9e96-ae798431b1cd None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:46.421571 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5c59b-cc91-4076-9e96-ae798431b1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:46.437709 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d426d0-08cc-45f8-a40b-158b3e4cf4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:46.440315 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d426d0-08cc-45f8-a40b-158b3e4cf4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:46.442987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d426d0-08cc-45f8-a40b-158b3e4cf4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:46.443947 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d426d0-08cc-45f8-a40b-158b3e4cf4bc admin admin] PATH_INFO: `/v3/projects/85cc90af73344d1aa2a916a27b3850b5/users/5c3da99dd2b2428b92d323332bd412de/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:46.480516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-fec5c59b-cc91-4076-9e96-ae798431b1cd None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:46.484659 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-fec5c59b-cc91-4076-9e96-ae798431b1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:46.494923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d426d0-08cc-45f8-a40b-158b3e4cf4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=85cc90af73344d1aa2a916a27b3850b5, user_id=5c3da99dd2b2428b92d323332bd412de, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:46.503019 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d426d0-08cc-45f8-a40b-158b3e4cf4bc admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:46.526894 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 868/1733] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:46.534724 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5c59b-cc91-4076-9e96-ae798431b1cd None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:46.565005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5c59b-cc91-4076-9e96-ae798431b1cd None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:46.579227 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf86c8-ac33-481e-8a76-c288ec27812c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:46.580880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf86c8-ac33-481e-8a76-c288ec27812c admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:46.587021 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf86c8-ac33-481e-8a76-c288ec27812c admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:46.587021 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf86c8-ac33-481e-8a76-c288ec27812c admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:46.617759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf86c8-ac33-481e-8a76-c288ec27812c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:50:46.617759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf86c8-ac33-481e-8a76-c288ec27812c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:46.617759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf86c8-ac33-481e-8a76-c288ec27812c admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:46.669175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 869/1734] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:50:46.672345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf86c8-ac33-481e-8a76-c288ec27812c admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:46.711898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 866/1735] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:46 2022] PUT /identity/v3/projects/85cc90af73344d1aa2a916a27b3850b5/users/5c3da99dd2b2428b92d323332bd412de/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:50:46.723675 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf86c8-ac33-481e-8a76-c288ec27812c admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:46.748679 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0dfc7-1131-4ca0-97f0-2320bb93124a None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:46.748679 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0dfc7-1131-4ca0-97f0-2320bb93124a None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:46.748679 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0dfc7-1131-4ca0-97f0-2320bb93124a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:46.878143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:46.878809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-c8e0dfc7-1131-4ca0-97f0-2320bb93124a None None] MFA Rules not processed for user `5c3da99dd2b2428b92d323332bd412de`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:46.880179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c8e0dfc7-1131-4ca0-97f0-2320bb93124a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:46.986584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e34cf-e198-48ee-8a9c-95b803ee6065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:46.987555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e34cf-e198-48ee-8a9c-95b803ee6065 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:46.987555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e34cf-e198-48ee-8a9c-95b803ee6065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:46.988679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e34cf-e198-48ee-8a9c-95b803ee6065 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:46.989352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e34cf-e198-48ee-8a9c-95b803ee6065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:46.996557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e34cf-e198-48ee-8a9c-95b803ee6065 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:47.105502 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 867/1736] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:47.116250 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0dfc7-1131-4ca0-97f0-2320bb93124a None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:47.139939 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0dfc7-1131-4ca0-97f0-2320bb93124a None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:47.144449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6342dd9-199f-4151-a955-3dbbbce0538f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:47.145506 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6342dd9-199f-4151-a955-3dbbbce0538f admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:47.145980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6342dd9-199f-4151-a955-3dbbbce0538f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:47.147125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6342dd9-199f-4151-a955-3dbbbce0538f admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:47.147662 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6342dd9-199f-4151-a955-3dbbbce0538f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:47.153570 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6342dd9-199f-4151-a955-3dbbbce0538f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:47.237877 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 870/1737] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:46 2022] POST /identity/v3/projects => generated 365 bytes in 565 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:47.246996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e34cf-e198-48ee-8a9c-95b803ee6065 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:47.294867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:47.344956 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 868/1738] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:47 2022] POST /identity/v3/projects => generated 355 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:50:47.347730 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6342dd9-199f-4151-a955-3dbbbce0538f admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:47.738618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e34cf-e198-48ee-8a9c-95b803ee6065 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:47.794151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6342dd9-199f-4151-a955-3dbbbce0538f admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:47.823042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279dde5f-7210-43cd-a87e-433c92ea3450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:47.824543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dde5f-7210-43cd-a87e-433c92ea3450 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:47.825299 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dde5f-7210-43cd-a87e-433c92ea3450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:47.826014 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dde5f-7210-43cd-a87e-433c92ea3450 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:47.830903 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279dde5f-7210-43cd-a87e-433c92ea3450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:47.835318 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279dde5f-7210-43cd-a87e-433c92ea3450 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:48.026798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d4e7e-cb0e-4a4e-9fbd-84905f193ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:48.033769 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d4e7e-cb0e-4a4e-9fbd-84905f193ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:48.033769 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d4e7e-cb0e-4a4e-9fbd-84905f193ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:48.033769 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d4e7e-cb0e-4a4e-9fbd-84905f193ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:48.038024 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d4e7e-cb0e-4a4e-9fbd-84905f193ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:48.050425 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d4e7e-cb0e-4a4e-9fbd-84905f193ba7 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:48.082562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 869/1739] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:47 2022] POST /identity/v3/users => generated 284 bytes in 736 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:48.092769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279dde5f-7210-43cd-a87e-433c92ea3450 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:48.126778 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279dde5f-7210-43cd-a87e-433c92ea3450 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:48.135980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c182e9-4705-4c99-9623-93d75f0618e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:48.136998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c182e9-4705-4c99-9623-93d75f0618e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:48.144543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c182e9-4705-4c99-9623-93d75f0618e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:48.145278 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c182e9-4705-4c99-9623-93d75f0618e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:48.146933 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c182e9-4705-4c99-9623-93d75f0618e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:48.150733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c182e9-4705-4c99-9623-93d75f0618e1 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:48.213322 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 870/1740] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:48.225431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c182e9-4705-4c99-9623-93d75f0618e1 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:48.267779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c182e9-4705-4c99-9623-93d75f0618e1 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:48.279166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 871/1741] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:47 2022] POST /identity/v3/users => generated 283 bytes in 1036 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:48.284598 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d4e7e-cb0e-4a4e-9fbd-84905f193ba7 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:48.292433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b234221-1d0d-43cb-b6b3-12b9471a0cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:48.295939 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b234221-1d0d-43cb-b6b3-12b9471a0cba admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:48.297144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b234221-1d0d-43cb-b6b3-12b9471a0cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:48.300005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b234221-1d0d-43cb-b6b3-12b9471a0cba admin admin] PATH_INFO: `/v3/projects/1803c97333e742928baaeafd54b9f48e/users/84d5dd4269ac46b5a72cb7f502d931e9/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:48.332660 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d4e7e-cb0e-4a4e-9fbd-84905f193ba7 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:48.360214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48d6a4-b533-473b-843f-0c8886ff5638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:48.361418 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48d6a4-b533-473b-843f-0c8886ff5638 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:48.362387 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48d6a4-b533-473b-843f-0c8886ff5638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:48.362957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48d6a4-b533-473b-843f-0c8886ff5638 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:48.364211 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48d6a4-b533-473b-843f-0c8886ff5638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:48.373664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b234221-1d0d-43cb-b6b3-12b9471a0cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1803c97333e742928baaeafd54b9f48e, user_id=84d5dd4269ac46b5a72cb7f502d931e9, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:48.373881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48d6a4-b533-473b-843f-0c8886ff5638 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:48.373970 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b234221-1d0d-43cb-b6b3-12b9471a0cba admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:48.396280 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 872/1742] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:48.398388 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48d6a4-b533-473b-843f-0c8886ff5638 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:48.421212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48d6a4-b533-473b-843f-0c8886ff5638 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:48.438219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa2b13-42e6-4468-9c5e-929aa27f0aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:48.439711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa2b13-42e6-4468-9c5e-929aa27f0aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:48.440308 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa2b13-42e6-4468-9c5e-929aa27f0aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:48.440869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa2b13-42e6-4468-9c5e-929aa27f0aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:48.442356 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa2b13-42e6-4468-9c5e-929aa27f0aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:48.445880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa2b13-42e6-4468-9c5e-929aa27f0aa4 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:48.475542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 873/1743] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:48.479778 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa2b13-42e6-4468-9c5e-929aa27f0aa4 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:48.501688 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa2b13-42e6-4468-9c5e-929aa27f0aa4 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:48.508180 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3263f-52a7-484c-af1a-d7fcb85dd875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:48.508977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3263f-52a7-484c-af1a-d7fcb85dd875 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:48.509261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3263f-52a7-484c-af1a-d7fcb85dd875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:48.509541 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3263f-52a7-484c-af1a-d7fcb85dd875 admin admin] PATH_INFO: `/v3/projects/55ce820305bf4afc90e0d6ebe984544c/users/f2d86ac30fb748bf87dae63d455f0e55/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:48.527845 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3263f-52a7-484c-af1a-d7fcb85dd875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ce820305bf4afc90e0d6ebe984544c, user_id=f2d86ac30fb748bf87dae63d455f0e55, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:48.531388 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3263f-52a7-484c-af1a-d7fcb85dd875 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:48.637209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 871/1744] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:48 2022] PUT /identity/v3/projects/1803c97333e742928baaeafd54b9f48e/users/84d5dd4269ac46b5a72cb7f502d931e9/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:48.640384 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b234221-1d0d-43cb-b6b3-12b9471a0cba admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:48.729527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 874/1745] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:48 2022] PUT /identity/v3/projects/55ce820305bf4afc90e0d6ebe984544c/users/f2d86ac30fb748bf87dae63d455f0e55/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:48.742975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea61b0-914d-44b6-960c-6022f6c991d3 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:48.743939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea61b0-914d-44b6-960c-6022f6c991d3 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:48.743939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea61b0-914d-44b6-960c-6022f6c991d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:48.833174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:48.852543 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-eeea61b0-914d-44b6-960c-6022f6c991d3 None None] MFA Rules not processed for user `f2d86ac30fb748bf87dae63d455f0e55`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:48.855502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-eeea61b0-914d-44b6-960c-6022f6c991d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:48.887558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b234221-1d0d-43cb-b6b3-12b9471a0cba admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:49.065380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 875/1746] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:50:49.067226 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea61b0-914d-44b6-960c-6022f6c991d3 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:49.227167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c2490-c8e3-4862-9a27-79f01334300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:49.239055 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2490-c8e3-4862-9a27-79f01334300a admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:49.247135 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2490-c8e3-4862-9a27-79f01334300a admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:49.247135 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2490-c8e3-4862-9a27-79f01334300a admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:49.247135 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c2490-c8e3-4862-9a27-79f01334300a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:49.247135 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c2490-c8e3-4862-9a27-79f01334300a admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:49.247135 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:49.310901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 872/1747] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 654 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:49.315741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c2490-c8e3-4862-9a27-79f01334300a admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:49.353562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c2490-c8e3-4862-9a27-79f01334300a admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:49.387171 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea61b0-914d-44b6-960c-6022f6c991d3 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:49.390681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db8f8b-2593-45e2-bca8-fd73ffd1fbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:49.392270 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db8f8b-2593-45e2-bca8-fd73ffd1fbb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:49.392425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db8f8b-2593-45e2-bca8-fd73ffd1fbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:49.397909 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122552cb-078e-40ae-8dff-767a2e778921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:49.400097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db8f8b-2593-45e2-bca8-fd73ffd1fbb7 admin admin] PATH_INFO: `/v3/projects/1803c97333e742928baaeafd54b9f48e/users/84d5dd4269ac46b5a72cb7f502d931e9/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:49.401689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122552cb-078e-40ae-8dff-767a2e778921 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:49.402572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122552cb-078e-40ae-8dff-767a2e778921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:49.403283 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122552cb-078e-40ae-8dff-767a2e778921 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:49.414653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122552cb-078e-40ae-8dff-767a2e778921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:49.414942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db8f8b-2593-45e2-bca8-fd73ffd1fbb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1803c97333e742928baaeafd54b9f48e, user_id=84d5dd4269ac46b5a72cb7f502d931e9, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:49.421179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122552cb-078e-40ae-8dff-767a2e778921 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:49.433152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db8f8b-2593-45e2-bca8-fd73ffd1fbb7 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:49.485925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 873/1748] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:49 2022] PUT /identity/v3/projects/1803c97333e742928baaeafd54b9f48e/users/84d5dd4269ac46b5a72cb7f502d931e9/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:50:49.500807 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a10214-2640-468b-95ab-51df31c6998c None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:49.501259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a10214-2640-468b-95ab-51df31c6998c None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:49.501737 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a10214-2640-468b-95ab-51df31c6998c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:49.551730 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-d6a10214-2640-468b-95ab-51df31c6998c None None] MFA Rules not processed for user `84d5dd4269ac46b5a72cb7f502d931e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:49.553865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d6a10214-2640-468b-95ab-51df31c6998c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:49.601368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 876/1749] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:50:49 2022] POST /identity/v3/projects => generated 365 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:49.608035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122552cb-078e-40ae-8dff-767a2e778921 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:49.842670 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122552cb-078e-40ae-8dff-767a2e778921 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:49.865918 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d007c1-2bd7-45bc-87cf-9a124aa826ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:49.866756 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d007c1-2bd7-45bc-87cf-9a124aa826ea admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:49.867067 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d007c1-2bd7-45bc-87cf-9a124aa826ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:49.867348 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d007c1-2bd7-45bc-87cf-9a124aa826ea admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:49.868064 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d007c1-2bd7-45bc-87cf-9a124aa826ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:49.882408 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d007c1-2bd7-45bc-87cf-9a124aa826ea admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:49.941831 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 874/1750] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:49.987359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a10214-2640-468b-95ab-51df31c6998c None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:49.993773 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d6a10214-2640-468b-95ab-51df31c6998c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:50.076627 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 877/1751] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:50:49 2022] POST /identity/v3/users => generated 289 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:50:50.078033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d007c1-2bd7-45bc-87cf-9a124aa826ea admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:50.118574 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d007c1-2bd7-45bc-87cf-9a124aa826ea admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:50.187522 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997b77a-44ae-4110-b5cf-300c90194ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:50.190610 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997b77a-44ae-4110-b5cf-300c90194ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:50.191113 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997b77a-44ae-4110-b5cf-300c90194ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:50.195060 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997b77a-44ae-4110-b5cf-300c90194ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:50.196379 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997b77a-44ae-4110-b5cf-300c90194ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:50.250862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997b77a-44ae-4110-b5cf-300c90194ed3 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:50.338288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 878/1752] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:50.352253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997b77a-44ae-4110-b5cf-300c90194ed3 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:50.353370 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a10214-2640-468b-95ab-51df31c6998c None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:50.394384 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:50.409665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997b77a-44ae-4110-b5cf-300c90194ed3 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:50.438854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bdec8-990e-4514-86d9-e833b63f8a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:50.442832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bdec8-990e-4514-86d9-e833b63f8a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:50.447119 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bdec8-990e-4514-86d9-e833b63f8a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:50.450349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bdec8-990e-4514-86d9-e833b63f8a9c admin admin] PATH_INFO: `/v3/projects/4132c4391f7041f3981e28c970424a7e/users/968855185a654d01b8fa6a17eed0e214/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:50.605181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bdec8-990e-4514-86d9-e833b63f8a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4132c4391f7041f3981e28c970424a7e, user_id=968855185a654d01b8fa6a17eed0e214, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:50.608420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdfe41-11f3-4d07-8676-0d3ff32e0721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:50.618552 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdfe41-11f3-4d07-8676-0d3ff32e0721 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:50.619621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdfe41-11f3-4d07-8676-0d3ff32e0721 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:50.620200 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdfe41-11f3-4d07-8676-0d3ff32e0721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:50.628887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bdec8-990e-4514-86d9-e833b63f8a9c admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:50.775020 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:50.848677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdfe41-11f3-4d07-8676-0d3ff32e0721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:50.854281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 879/1753] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:50 2022] PUT /identity/v3/projects/4132c4391f7041f3981e28c970424a7e/users/968855185a654d01b8fa6a17eed0e214/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:50.855105 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdfe41-11f3-4d07-8676-0d3ff32e0721 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:50.861028 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bdec8-990e-4514-86d9-e833b63f8a9c admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:50.916497 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 875/1754] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 931 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:51.086478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bdec8-990e-4514-86d9-e833b63f8a9c admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:51.101443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf19fb6-8264-4e4d-bab7-70f5fe1bfb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:51.115716 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf19fb6-8264-4e4d-bab7-70f5fe1bfb77 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:51.115716 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf19fb6-8264-4e4d-bab7-70f5fe1bfb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:51.115716 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf19fb6-8264-4e4d-bab7-70f5fe1bfb77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:51.115716 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf19fb6-8264-4e4d-bab7-70f5fe1bfb77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:51.115716 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf19fb6-8264-4e4d-bab7-70f5fe1bfb77 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:51.141891 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 880/1755] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:50:51.142203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdfe41-11f3-4d07-8676-0d3ff32e0721 service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:51.156746 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdfe41-11f3-4d07-8676-0d3ff32e0721 service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:51.171005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6c379-403c-4dbb-a852-223fc1b2fbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:51.171880 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6c379-403c-4dbb-a852-223fc1b2fbca admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:51.172209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6c379-403c-4dbb-a852-223fc1b2fbca admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:51.172577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6c379-403c-4dbb-a852-223fc1b2fbca admin admin] PATH_INFO: `/v3/projects/4132c4391f7041f3981e28c970424a7e/users/968855185a654d01b8fa6a17eed0e214/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:51.178536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6c379-403c-4dbb-a852-223fc1b2fbca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4132c4391f7041f3981e28c970424a7e, user_id=968855185a654d01b8fa6a17eed0e214, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:51.183173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6c379-403c-4dbb-a852-223fc1b2fbca admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:51.215912 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 876/1756] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:50:51 2022] PUT /identity/v3/projects/4132c4391f7041f3981e28c970424a7e/users/968855185a654d01b8fa6a17eed0e214/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:51.239567 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55292c7b-3124-49cf-b0a3-ab3d8b3fbdd2 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:51.239567 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55292c7b-3124-49cf-b0a3-ab3d8b3fbdd2 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:51.240055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55292c7b-3124-49cf-b0a3-ab3d8b3fbdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:51.334260 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-55292c7b-3124-49cf-b0a3-ab3d8b3fbdd2 None None] MFA Rules not processed for user `968855185a654d01b8fa6a17eed0e214`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:51.337629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6c379-403c-4dbb-a852-223fc1b2fbca admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:51.338307 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-55292c7b-3124-49cf-b0a3-ab3d8b3fbdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:51.490586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6c379-403c-4dbb-a852-223fc1b2fbca admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:51.496479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e92bc-7630-4ef8-98b5-0b544d9a8188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:51.497174 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e92bc-7630-4ef8-98b5-0b544d9a8188 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:51.497456 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e92bc-7630-4ef8-98b5-0b544d9a8188 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:51.497795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e92bc-7630-4ef8-98b5-0b544d9a8188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:51.602492 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 881/1757] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:51.668245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e92bc-7630-4ef8-98b5-0b544d9a8188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:51.678169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e92bc-7630-4ef8-98b5-0b544d9a8188 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:51.698713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 877/1758] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:50:51.710545 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc44c8-394c-40b6-9f03-e4656b9558e0 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:51.711161 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc44c8-394c-40b6-9f03-e4656b9558e0 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:51.712020 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc44c8-394c-40b6-9f03-e4656b9558e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:51.890432 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-12cc44c8-394c-40b6-9f03-e4656b9558e0 None None] MFA Rules not processed for user `87ba67fc171b4258b6fda72094ed11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:51.893224 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-12cc44c8-394c-40b6-9f03-e4656b9558e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:51.897014 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e92bc-7630-4ef8-98b5-0b544d9a8188 service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:51.898619 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-cb6e92bc-7630-4ef8-98b5-0b544d9a8188 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:51.912153 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e92bc-7630-4ef8-98b5-0b544d9a8188 service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:51.917201 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707d7bd-1b77-498d-9730-7386a445d838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:51.918531 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707d7bd-1b77-498d-9730-7386a445d838 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:51.919022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707d7bd-1b77-498d-9730-7386a445d838 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:51.919527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707d7bd-1b77-498d-9730-7386a445d838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:51.933030 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707d7bd-1b77-498d-9730-7386a445d838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:51.934895 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707d7bd-1b77-498d-9730-7386a445d838 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:51.971978 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 878/1759] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:50:52.028152 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:52.122160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 882/1760] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Sep 7 16:50:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:52.694084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707d7bd-1b77-498d-9730-7386a445d838 service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:52.718878 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707d7bd-1b77-498d-9730-7386a445d838 service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:52.726088 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f792723-0c10-4319-b115-7c684383ae6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:52.727724 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f792723-0c10-4319-b115-7c684383ae6e service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:52.728459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f792723-0c10-4319-b115-7c684383ae6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:52.728992 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f792723-0c10-4319-b115-7c684383ae6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:52.870724 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc44c8-394c-40b6-9f03-e4656b9558e0 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:52.873582 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-12cc44c8-394c-40b6-9f03-e4656b9558e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:52.954910 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f792723-0c10-4319-b115-7c684383ae6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:52.964770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f792723-0c10-4319-b115-7c684383ae6e service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:52.990035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:53.012035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 879/1761] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:53.289857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc44c8-394c-40b6-9f03-e4656b9558e0 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:53.313899 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b806700-45c1-4bb1-9ef8-70de4ce2c46e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56cd868e866d436aa1d601f7791e812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:53.314565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b806700-45c1-4bb1-9ef8-70de4ce2c46e service swift] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:53.314844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b806700-45c1-4bb1-9ef8-70de4ce2c46e service swift] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:53.315117 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b806700-45c1-4bb1-9ef8-70de4ce2c46e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:53.338432 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b806700-45c1-4bb1-9ef8-70de4ce2c46e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:53.338432 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b806700-45c1-4bb1-9ef8-70de4ce2c46e service swift] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:53.381036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 883/1762] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Sep 7 16:50:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 16:50:55.518314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7b48-392d-4478-be25-062af87e0e22 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:55.518314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7b48-392d-4478-be25-062af87e0e22 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:55.522390 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7b48-392d-4478-be25-062af87e0e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:55.578015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103eef6-0345-4e32-82c9-01642b46e358 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:55.578879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103eef6-0345-4e32-82c9-01642b46e358 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:55.578879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103eef6-0345-4e32-82c9-01642b46e358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:55.652848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-5103eef6-0345-4e32-82c9-01642b46e358 None None] MFA Rules not processed for user `bac099b78bd04e02b8614c8afce53ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:55.661948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5103eef6-0345-4e32-82c9-01642b46e358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:55.671621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-a0ce7b48-392d-4478-be25-062af87e0e22 None None] MFA Rules not processed for user `be6d79591cf14650a82b2b45fa8fd4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:55.674460 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a0ce7b48-392d-4478-be25-062af87e0e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:55.862406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 884/1763] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Sep 7 16:50:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:55.891620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103eef6-0345-4e32-82c9-01642b46e358 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:55.893293 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5103eef6-0345-4e32-82c9-01642b46e358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:55.920532 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103eef6-0345-4e32-82c9-01642b46e358 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:55.938660 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98740b-0949-4ebf-b1c3-8a25bae9c24a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:55.939419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98740b-0949-4ebf-b1c3-8a25bae9c24a service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:55.941487 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98740b-0949-4ebf-b1c3-8a25bae9c24a service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:55.941790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98740b-0949-4ebf-b1c3-8a25bae9c24a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:55.980754 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98740b-0949-4ebf-b1c3-8a25bae9c24a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:55.987537 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98740b-0949-4ebf-b1c3-8a25bae9c24a service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:56.020259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 880/1764] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:56.061607 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 885/1765] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:50:56.097782 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce7b48-392d-4478-be25-062af87e0e22 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:56.100576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a0ce7b48-392d-4478-be25-062af87e0e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:56.173313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce7b48-392d-4478-be25-062af87e0e22 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:56.192570 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e452c-919e-4e68-961b-b2f60bca9088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:56.193585 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e452c-919e-4e68-961b-b2f60bca9088 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:56.194060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e452c-919e-4e68-961b-b2f60bca9088 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:56.194526 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e452c-919e-4e68-961b-b2f60bca9088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:56.248665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e452c-919e-4e68-961b-b2f60bca9088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:56.250437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e452c-919e-4e68-961b-b2f60bca9088 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:56.273689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 881/1766] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:50:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:50:56.554347 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ccbac-7521-4caf-861b-387887555787 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:56.554906 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ccbac-7521-4caf-861b-387887555787 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:56.555339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ccbac-7521-4caf-861b-387887555787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:56.627897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-361ccbac-7521-4caf-861b-387887555787 None None] MFA Rules not processed for user `7a3f8b78523e4c3790b049fc783c96fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:56.630313 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-361ccbac-7521-4caf-861b-387887555787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:56.761358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:50:56.876155 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 886/1767] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:50:58.739913 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e452c-919e-4e68-961b-b2f60bca9088 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:50:58.739913 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-026e452c-919e-4e68-961b-b2f60bca9088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:58.992967 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e452c-919e-4e68-961b-b2f60bca9088 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:50:59.010151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cd741-efc5-4f16-bb92-3c13acfe2a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:50:59.011266 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cd741-efc5-4f16-bb92-3c13acfe2a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:59.011897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cd741-efc5-4f16-bb92-3c13acfe2a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:59.012538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cd741-efc5-4f16-bb92-3c13acfe2a98 admin admin] PATH_INFO: `/v3/users/f943747a30624dde8cb19ac132f601e8` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:59.018343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cd741-efc5-4f16-bb92-3c13acfe2a98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f943747a30624dde8cb19ac132f601e8)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:50:59.023005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cd741-efc5-4f16-bb92-3c13acfe2a98 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:50:59.285208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914ce45-e0b3-4b87-afa1-b623f8e02698 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:59.285821 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914ce45-e0b3-4b87-afa1-b623f8e02698 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:59.285821 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914ce45-e0b3-4b87-afa1-b623f8e02698 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:59.289323 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 887/1768] 10.222.0.25 () {54 vars in 921 bytes} [Wed Sep 7 16:50:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:50:59.296610 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dded39-7cd4-4015-9e63-532faa28c647 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:59.296935 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dded39-7cd4-4015-9e63-532faa28c647 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:59.299377 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dded39-7cd4-4015-9e63-532faa28c647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:50:59.350002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-14dded39-7cd4-4015-9e63-532faa28c647 None None] MFA Rules not processed for user `cf48978c20f04173b114e15e1ce2157c`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:50:59.352546 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-14dded39-7cd4-4015-9e63-532faa28c647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:50:59.575258 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 888/1769] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Sep 7 16:50:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:50:59.728642 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d51cd741-efc5-4f16-bb92-3c13acfe2a98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f943747a30624dde8cb19ac132f601e8'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:59.729650 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d51cd741-efc5-4f16-bb92-3c13acfe2a98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f943747a30624dde8cb19ac132f601e8'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:59.740929 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d51cd741-efc5-4f16-bb92-3c13acfe2a98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f943747a30624dde8cb19ac132f601e8'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:59.801522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d51cd741-efc5-4f16-bb92-3c13acfe2a98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f943747a30624dde8cb19ac132f601e8'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:59.802407 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d51cd741-efc5-4f16-bb92-3c13acfe2a98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f943747a30624dde8cb19ac132f601e8'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:50:59.953806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 882/1770] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:50:58 2022] DELETE /identity/v3/users/f943747a30624dde8cb19ac132f601e8 => generated 0 bytes in 1224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:50:59.960212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89b709-df35-4272-98cd-e406bf169b55 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:50:59.961042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89b709-df35-4272-98cd-e406bf169b55 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:50:59.961503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89b709-df35-4272-98cd-e406bf169b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:00.002199 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-ce89b709-df35-4272-98cd-e406bf169b55 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:00.010050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ce89b709-df35-4272-98cd-e406bf169b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:00.274084 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 889/1771] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:00.422536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cd741-efc5-4f16-bb92-3c13acfe2a98 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:00.424968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d51cd741-efc5-4f16-bb92-3c13acfe2a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:00.487656 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:00.724841 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cd741-efc5-4f16-bb92-3c13acfe2a98 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:00.758700 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91102c-82c9-4934-abb7-c5b27508ef99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:00.761453 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91102c-82c9-4934-abb7-c5b27508ef99 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:00.762276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91102c-82c9-4934-abb7-c5b27508ef99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:00.762970 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91102c-82c9-4934-abb7-c5b27508ef99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:00.794154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91102c-82c9-4934-abb7-c5b27508ef99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:00.801594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91102c-82c9-4934-abb7-c5b27508ef99 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:00.865688 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 883/1772] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:51:02.038228 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89b709-df35-4272-98cd-e406bf169b55 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:02.041984 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ce89b709-df35-4272-98cd-e406bf169b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:02.368618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89b709-df35-4272-98cd-e406bf169b55 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:02.398207 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed11f20-1543-4735-b68f-a94b7084f0de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:02.399290 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed11f20-1543-4735-b68f-a94b7084f0de service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:02.399852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed11f20-1543-4735-b68f-a94b7084f0de service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:02.403247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed11f20-1543-4735-b68f-a94b7084f0de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:02.410201 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-4ed11f20-1543-4735-b68f-a94b7084f0de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:02.494191 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed11f20-1543-4735-b68f-a94b7084f0de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:02.506824 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed11f20-1543-4735-b68f-a94b7084f0de service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:02.547547 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 890/1773] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:51:03.423362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6698df0-4854-463a-9d56-8d62ba5a1981 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:03.423362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6698df0-4854-463a-9d56-8d62ba5a1981 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:03.423362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6698df0-4854-463a-9d56-8d62ba5a1981 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:03.423362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 884/1774] 10.222.0.25 () {54 vars in 921 bytes} [Wed Sep 7 16:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:51:03.491241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0d064-106d-4df4-a368-3b9a963b4588 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:03.496957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0d064-106d-4df4-a368-3b9a963b4588 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:03.496957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0d064-106d-4df4-a368-3b9a963b4588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:03.519159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:03.562447 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-89e0d064-106d-4df4-a368-3b9a963b4588 None None] MFA Rules not processed for user `cf48978c20f04173b114e15e1ce2157c`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:03.582567 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-89e0d064-106d-4df4-a368-3b9a963b4588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:03.617131 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 891/1775] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Sep 7 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:03.683509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6698df0-4854-463a-9d56-8d62ba5a1981 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:03.688682 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c6698df0-4854-463a-9d56-8d62ba5a1981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:03.739149 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6698df0-4854-463a-9d56-8d62ba5a1981 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:03.754720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978d87a-4b3b-43fe-96b2-6cb613561430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:03.759717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978d87a-4b3b-43fe-96b2-6cb613561430 service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:03.761180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978d87a-4b3b-43fe-96b2-6cb613561430 service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:03.763070 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978d87a-4b3b-43fe-96b2-6cb613561430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:03.792346 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978d87a-4b3b-43fe-96b2-6cb613561430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:03.799910 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978d87a-4b3b-43fe-96b2-6cb613561430 service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:03.839730 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 885/1776] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:04.659872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0d064-106d-4df4-a368-3b9a963b4588 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:04.661377 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-89e0d064-106d-4df4-a368-3b9a963b4588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:04.739096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0d064-106d-4df4-a368-3b9a963b4588 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:04.765204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8e109-9242-439c-87f1-d7f450ef09ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:04.768476 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8e109-9242-439c-87f1-d7f450ef09ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:04.770272 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8e109-9242-439c-87f1-d7f450ef09ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:04.771832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8e109-9242-439c-87f1-d7f450ef09ba admin admin] PATH_INFO: `/v3/projects/e91176e7223640fbbc8504330d0a47b3` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:04.776843 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8e109-9242-439c-87f1-d7f450ef09ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e91176e7223640fbbc8504330d0a47b3)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:04.796546 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8e109-9242-439c-87f1-d7f450ef09ba admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:05.218701 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-14b8e109-9242-439c-87f1-d7f450ef09ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e91176e7223640fbbc8504330d0a47b3', 'request_id': 'req-14b8e109-9242-439c-87f1-d7f450ef09ba'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:05.235926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-14b8e109-9242-439c-87f1-d7f450ef09ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e91176e7223640fbbc8504330d0a47b3', 'request_id': 'req-14b8e109-9242-439c-87f1-d7f450ef09ba'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:05.406647 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-14b8e109-9242-439c-87f1-d7f450ef09ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e91176e7223640fbbc8504330d0a47b3', 'request_id': 'req-14b8e109-9242-439c-87f1-d7f450ef09ba'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:05.469363 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-14b8e109-9242-439c-87f1-d7f450ef09ba admin admin] The token cache is being invalidate because project e91176e7223640fbbc8504330d0a47b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:05.469693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-14b8e109-9242-439c-87f1-d7f450ef09ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:05.473170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-14b8e109-9242-439c-87f1-d7f450ef09ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:05.487087 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978d87a-4b3b-43fe-96b2-6cb613561430 service nova] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:05.487899 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 892/1777] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:04 2022] DELETE /identity/v3/projects/e91176e7223640fbbc8504330d0a47b3 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:05.501644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978d87a-4b3b-43fe-96b2-6cb613561430 service nova] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:05.659303 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf43192-4336-48eb-9479-7766072a3a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:05.666513 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf43192-4336-48eb-9479-7766072a3a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:05.666513 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf43192-4336-48eb-9479-7766072a3a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:05.666513 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf43192-4336-48eb-9479-7766072a3a8f admin admin] PATH_INFO: `/v3/users/b033aaa2670b4726858a06e805e07182` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:05.666513 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf43192-4336-48eb-9479-7766072a3a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b033aaa2670b4726858a06e805e07182)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:05.667896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf43192-4336-48eb-9479-7766072a3a8f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:06.148948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-bbf43192-4336-48eb-9479-7766072a3a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b033aaa2670b4726858a06e805e07182'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:06.150831 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-bbf43192-4336-48eb-9479-7766072a3a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b033aaa2670b4726858a06e805e07182'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:06.188063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-bbf43192-4336-48eb-9479-7766072a3a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b033aaa2670b4726858a06e805e07182'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:06.209971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-bbf43192-4336-48eb-9479-7766072a3a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b033aaa2670b4726858a06e805e07182'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:06.211002 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-bbf43192-4336-48eb-9479-7766072a3a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b033aaa2670b4726858a06e805e07182'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:06.858700 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 886/1778] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:05 2022] DELETE /identity/v3/users/b033aaa2670b4726858a06e805e07182 => generated 0 bytes in 1369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:08.164750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8e109-9242-439c-87f1-d7f450ef09ba admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:08.169398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-14b8e109-9242-439c-87f1-d7f450ef09ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:08.195179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8e109-9242-439c-87f1-d7f450ef09ba admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:08.291984 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e134d70-2a66-44e9-b0a0-fe583fd7bb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:08.293181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e134d70-2a66-44e9-b0a0-fe583fd7bb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:08.293660 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e134d70-2a66-44e9-b0a0-fe583fd7bb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:08.294130 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e134d70-2a66-44e9-b0a0-fe583fd7bb4e admin admin] PATH_INFO: `/v3/projects/d6aa9a80462b4e168f37c0e1d6cde6ab` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:08.297560 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e134d70-2a66-44e9-b0a0-fe583fd7bb4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6aa9a80462b4e168f37c0e1d6cde6ab)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:08.300046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e134d70-2a66-44e9-b0a0-fe583fd7bb4e admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:08.513270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7e134d70-2a66-44e9-b0a0-fe583fd7bb4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6aa9a80462b4e168f37c0e1d6cde6ab', 'request_id': 'req-7e134d70-2a66-44e9-b0a0-fe583fd7bb4e'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:08.521506 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7e134d70-2a66-44e9-b0a0-fe583fd7bb4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6aa9a80462b4e168f37c0e1d6cde6ab', 'request_id': 'req-7e134d70-2a66-44e9-b0a0-fe583fd7bb4e'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:08.707191 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7e134d70-2a66-44e9-b0a0-fe583fd7bb4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6aa9a80462b4e168f37c0e1d6cde6ab', 'request_id': 'req-7e134d70-2a66-44e9-b0a0-fe583fd7bb4e'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:08.726305 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7e134d70-2a66-44e9-b0a0-fe583fd7bb4e admin admin] The token cache is being invalidate because project d6aa9a80462b4e168f37c0e1d6cde6ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:08.726305 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7e134d70-2a66-44e9-b0a0-fe583fd7bb4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:08.727165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7e134d70-2a66-44e9-b0a0-fe583fd7bb4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:08.730792 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 893/1779] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:08 2022] DELETE /identity/v3/projects/d6aa9a80462b4e168f37c0e1d6cde6ab => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:08.735688 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217611f-b576-47bc-b041-77e2b5e03c91 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:08.736272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217611f-b576-47bc-b041-77e2b5e03c91 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:08.736637 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217611f-b576-47bc-b041-77e2b5e03c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:08.772012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-8217611f-b576-47bc-b041-77e2b5e03c91 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:08.773438 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-8217611f-b576-47bc-b041-77e2b5e03c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:08.805102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:08.864953 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 887/1780] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:08.875139 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26350b-e919-47e3-bd77-dbf78afa4184 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:08.875468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26350b-e919-47e3-bd77-dbf78afa4184 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:08.875806 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26350b-e919-47e3-bd77-dbf78afa4184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:08.898969 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-5f26350b-e919-47e3-bd77-dbf78afa4184 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:08.903649 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5f26350b-e919-47e3-bd77-dbf78afa4184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:08.912492 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 894/1781] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:08.916922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217611f-b576-47bc-b041-77e2b5e03c91 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:08.930037 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217611f-b576-47bc-b041-77e2b5e03c91 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:08.936221 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9af54-23f4-41c2-b368-3f8d74f63f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:08.936803 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9af54-23f4-41c2-b368-3f8d74f63f3c admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:08.937082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9af54-23f4-41c2-b368-3f8d74f63f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:08.937355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9af54-23f4-41c2-b368-3f8d74f63f3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:08.938028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9af54-23f4-41c2-b368-3f8d74f63f3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:51:08.938359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9af54-23f4-41c2-b368-3f8d74f63f3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:08.940183 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9af54-23f4-41c2-b368-3f8d74f63f3c admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:08.953380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 888/1782] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:51:08.957939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26350b-e919-47e3-bd77-dbf78afa4184 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:08.962988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:08.969370 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26350b-e919-47e3-bd77-dbf78afa4184 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:08.974232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d729be-2026-42f0-8226-e7f61b7e336c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:08.974872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d729be-2026-42f0-8226-e7f61b7e336c admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:08.975143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d729be-2026-42f0-8226-e7f61b7e336c admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:08.975408 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d729be-2026-42f0-8226-e7f61b7e336c admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:08.976068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d729be-2026-42f0-8226-e7f61b7e336c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:08.977983 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d729be-2026-42f0-8226-e7f61b7e336c admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:09.194982 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 895/1783] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:08 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:09.199599 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9af54-23f4-41c2-b368-3f8d74f63f3c admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:09.210876 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9af54-23f4-41c2-b368-3f8d74f63f3c admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:09.273994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e63abf-02ce-46d9-9ac9-7f447abf87bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:09.274627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e63abf-02ce-46d9-9ac9-7f447abf87bf admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:09.275021 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e63abf-02ce-46d9-9ac9-7f447abf87bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:09.275375 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e63abf-02ce-46d9-9ac9-7f447abf87bf admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:09.276125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e63abf-02ce-46d9-9ac9-7f447abf87bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:09.278266 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e63abf-02ce-46d9-9ac9-7f447abf87bf admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:09.430461 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 889/1784] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:09 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:51:09.431467 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d729be-2026-42f0-8226-e7f61b7e336c admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:09.447995 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d729be-2026-42f0-8226-e7f61b7e336c admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:09.455353 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdf972-ed1c-454c-a04b-a8bd32d0ecdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:09.456248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdf972-ed1c-454c-a04b-a8bd32d0ecdd admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:09.456564 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdf972-ed1c-454c-a04b-a8bd32d0ecdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:09.456906 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdf972-ed1c-454c-a04b-a8bd32d0ecdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:09.457888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdf972-ed1c-454c-a04b-a8bd32d0ecdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:09.460547 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdf972-ed1c-454c-a04b-a8bd32d0ecdd admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:09.501513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 896/1785] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:09.504586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e63abf-02ce-46d9-9ac9-7f447abf87bf admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:09.522337 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e63abf-02ce-46d9-9ac9-7f447abf87bf admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:09.534057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13b908-0561-497c-8753-a05dcd516675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:09.534057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b908-0561-497c-8753-a05dcd516675 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:09.534057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b908-0561-497c-8753-a05dcd516675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:09.534057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b908-0561-497c-8753-a05dcd516675 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:09.534689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13b908-0561-497c-8753-a05dcd516675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:09.534689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13b908-0561-497c-8753-a05dcd516675 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:09.568417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 890/1786] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:09.569748 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdf972-ed1c-454c-a04b-a8bd32d0ecdd admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:09.581659 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdf972-ed1c-454c-a04b-a8bd32d0ecdd admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:09.586983 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0413701-63ce-46ec-8cb9-d48b91b0d7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:09.587705 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0413701-63ce-46ec-8cb9-d48b91b0d7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:09.587986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0413701-63ce-46ec-8cb9-d48b91b0d7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:09.588267 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0413701-63ce-46ec-8cb9-d48b91b0d7fb admin admin] PATH_INFO: `/v3/projects/e3514681f8424537a4254d108eefbe75/users/238780d5d7dc4bda91fc68da86aeb07d/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:09.609071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0413701-63ce-46ec-8cb9-d48b91b0d7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3514681f8424537a4254d108eefbe75, user_id=238780d5d7dc4bda91fc68da86aeb07d, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:09.612284 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0413701-63ce-46ec-8cb9-d48b91b0d7fb admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:09.749877 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 897/1787] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:09 2022] PUT /identity/v3/projects/e3514681f8424537a4254d108eefbe75/users/238780d5d7dc4bda91fc68da86aeb07d/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:09.762201 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b9f92-c336-47f3-bdb0-9bcbd8d49360 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:09.762779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b9f92-c336-47f3-bdb0-9bcbd8d49360 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:09.762979 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b9f92-c336-47f3-bdb0-9bcbd8d49360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:09.806664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-0e4b9f92-c336-47f3-bdb0-9bcbd8d49360 None None] MFA Rules not processed for user `238780d5d7dc4bda91fc68da86aeb07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:09.808153 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0e4b9f92-c336-47f3-bdb0-9bcbd8d49360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:09.906336 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 891/1788] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:09.914084 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0413701-63ce-46ec-8cb9-d48b91b0d7fb admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:10.020219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0413701-63ce-46ec-8cb9-d48b91b0d7fb admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:10.026707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069e382-d3e7-45e2-b3b8-9e04ac23ad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:10.028508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069e382-d3e7-45e2-b3b8-9e04ac23ad63 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:10.029015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069e382-d3e7-45e2-b3b8-9e04ac23ad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:10.038366 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069e382-d3e7-45e2-b3b8-9e04ac23ad63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:10.038366 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069e382-d3e7-45e2-b3b8-9e04ac23ad63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:10.038366 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069e382-d3e7-45e2-b3b8-9e04ac23ad63 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:10.171520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 898/1789] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:09 2022] POST /identity/v3/projects => generated 385 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:10.178044 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b9f92-c336-47f3-bdb0-9bcbd8d49360 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:10.201738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b9f92-c336-47f3-bdb0-9bcbd8d49360 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:10.316844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab607c7-84e0-49e1-bf87-f6ab0fe0ba3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:10.317893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab607c7-84e0-49e1-bf87-f6ab0fe0ba3e admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:10.318400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab607c7-84e0-49e1-bf87-f6ab0fe0ba3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:10.318843 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab607c7-84e0-49e1-bf87-f6ab0fe0ba3e admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:10.319978 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab607c7-84e0-49e1-bf87-f6ab0fe0ba3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:10.324931 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab607c7-84e0-49e1-bf87-f6ab0fe0ba3e admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:10.504676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 892/1790] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:10 2022] POST /identity/v3/users => generated 299 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:10.510166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069e382-d3e7-45e2-b3b8-9e04ac23ad63 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:10.543299 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069e382-d3e7-45e2-b3b8-9e04ac23ad63 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:10.567464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540917d2-0635-4270-9499-86108ee5a4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:10.571290 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540917d2-0635-4270-9499-86108ee5a4ab admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:10.572552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540917d2-0635-4270-9499-86108ee5a4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:10.579768 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540917d2-0635-4270-9499-86108ee5a4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:10.582480 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540917d2-0635-4270-9499-86108ee5a4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:10.587953 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540917d2-0635-4270-9499-86108ee5a4ab admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:10.616648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 899/1791] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:10.620606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab607c7-84e0-49e1-bf87-f6ab0fe0ba3e admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:10.642348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab607c7-84e0-49e1-bf87-f6ab0fe0ba3e admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:10.664305 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a950bd-ffba-485e-94e0-1d7c28ce0251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:10.666190 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a950bd-ffba-485e-94e0-1d7c28ce0251 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:10.666365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a950bd-ffba-485e-94e0-1d7c28ce0251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:10.666757 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a950bd-ffba-485e-94e0-1d7c28ce0251 admin admin] PATH_INFO: `/v3/projects/f41aad3d07604f09a7627ec8be76c7f4/users/ca8b61f3e8ee4cb49772ccdafef1687d/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:10.764855 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a950bd-ffba-485e-94e0-1d7c28ce0251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41aad3d07604f09a7627ec8be76c7f4, user_id=ca8b61f3e8ee4cb49772ccdafef1687d, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:10.770016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a950bd-ffba-485e-94e0-1d7c28ce0251 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:10.851320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540917d2-0635-4270-9499-86108ee5a4ab admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:10.854970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-540917d2-0635-4270-9499-86108ee5a4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:10.882018 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540917d2-0635-4270-9499-86108ee5a4ab admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:10.891237 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d430d38-aed8-4f4e-9016-d1133cbb495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:10.892417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d430d38-aed8-4f4e-9016-d1133cbb495e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:10.892971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d430d38-aed8-4f4e-9016-d1133cbb495e admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:10.893463 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d430d38-aed8-4f4e-9016-d1133cbb495e admin admin] PATH_INFO: `/v3/users/f2d86ac30fb748bf87dae63d455f0e55` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:10.895466 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d430d38-aed8-4f4e-9016-d1133cbb495e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d86ac30fb748bf87dae63d455f0e55)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:10.902301 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d430d38-aed8-4f4e-9016-d1133cbb495e admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:10.915278 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 893/1792] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:10 2022] PUT /identity/v3/projects/f41aad3d07604f09a7627ec8be76c7f4/users/ca8b61f3e8ee4cb49772ccdafef1687d/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:10.925061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a950bd-ffba-485e-94e0-1d7c28ce0251 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:11.047285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a950bd-ffba-485e-94e0-1d7c28ce0251 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:11.067555 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bf08c-9af8-45a8-8a93-5de6d707a01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:11.069052 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf08c-9af8-45a8-8a93-5de6d707a01f admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:11.069764 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf08c-9af8-45a8-8a93-5de6d707a01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:11.070721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf08c-9af8-45a8-8a93-5de6d707a01f admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:11.073431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bf08c-9af8-45a8-8a93-5de6d707a01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:11.080384 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bf08c-9af8-45a8-8a93-5de6d707a01f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:11.138189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 894/1793] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:11.145407 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bf08c-9af8-45a8-8a93-5de6d707a01f admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:11.171834 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-6d430d38-aed8-4f4e-9016-d1133cbb495e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d86ac30fb748bf87dae63d455f0e55'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:11.206930 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bf08c-9af8-45a8-8a93-5de6d707a01f admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:11.219735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea8c04-23b4-4ca3-9257-8d0eb146c71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:11.220496 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea8c04-23b4-4ca3-9257-8d0eb146c71f admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:11.220839 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea8c04-23b4-4ca3-9257-8d0eb146c71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:11.221042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea8c04-23b4-4ca3-9257-8d0eb146c71f admin admin] PATH_INFO: `/v3/projects/f41aad3d07604f09a7627ec8be76c7f4/users/ca8b61f3e8ee4cb49772ccdafef1687d/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:11.223666 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea8c04-23b4-4ca3-9257-8d0eb146c71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41aad3d07604f09a7627ec8be76c7f4, user_id=ca8b61f3e8ee4cb49772ccdafef1687d, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:11.227090 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea8c04-23b4-4ca3-9257-8d0eb146c71f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:11.243383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 895/1794] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:11 2022] PUT /identity/v3/projects/f41aad3d07604f09a7627ec8be76c7f4/users/ca8b61f3e8ee4cb49772ccdafef1687d/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:11.264202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba37854-73db-475c-84bf-53a2269935a6 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:11.266314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba37854-73db-475c-84bf-53a2269935a6 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:11.266915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba37854-73db-475c-84bf-53a2269935a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:11.293733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-6d430d38-aed8-4f4e-9016-d1133cbb495e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d86ac30fb748bf87dae63d455f0e55'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:11.295449 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-6d430d38-aed8-4f4e-9016-d1133cbb495e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d86ac30fb748bf87dae63d455f0e55'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:11.297103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-6d430d38-aed8-4f4e-9016-d1133cbb495e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d86ac30fb748bf87dae63d455f0e55'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:11.325344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-6d430d38-aed8-4f4e-9016-d1133cbb495e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d86ac30fb748bf87dae63d455f0e55'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:11.349895 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-fba37854-73db-475c-84bf-53a2269935a6 None None] MFA Rules not processed for user `ca8b61f3e8ee4cb49772ccdafef1687d`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:11.352708 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-fba37854-73db-475c-84bf-53a2269935a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:11.414518 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 900/1795] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:10 2022] DELETE /identity/v3/users/f2d86ac30fb748bf87dae63d455f0e55 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:11.417153 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef1bb4-49ea-44c7-9694-bbc76d007d1e None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:11.428276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef1bb4-49ea-44c7-9694-bbc76d007d1e None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:11.429087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef1bb4-49ea-44c7-9694-bbc76d007d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:11.511992 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-ffef1bb4-49ea-44c7-9694-bbc76d007d1e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:11.516018 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ffef1bb4-49ea-44c7-9694-bbc76d007d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:11.723987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 896/1796] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:11.758486 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 901/1797] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:11.772239 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba37854-73db-475c-84bf-53a2269935a6 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:11.774917 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-fba37854-73db-475c-84bf-53a2269935a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:11.805160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef1bb4-49ea-44c7-9694-bbc76d007d1e None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:11.808182 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ffef1bb4-49ea-44c7-9694-bbc76d007d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:12.008793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef1bb4-49ea-44c7-9694-bbc76d007d1e None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:12.035340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca32c2-8958-4e2c-afc4-d8b2ad5bedea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:12.041308 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba37854-73db-475c-84bf-53a2269935a6 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:12.043270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca32c2-8958-4e2c-afc4-d8b2ad5bedea service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:12.043822 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca32c2-8958-4e2c-afc4-d8b2ad5bedea service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:12.046870 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca32c2-8958-4e2c-afc4-d8b2ad5bedea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:12.100230 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca32c2-8958-4e2c-afc4-d8b2ad5bedea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:12.103324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca32c2-8958-4e2c-afc4-d8b2ad5bedea service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:12.158993 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ce920-21b2-4228-8617-886c921a6c55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:12.159845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ce920-21b2-4228-8617-886c921a6c55 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:12.160233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ce920-21b2-4228-8617-886c921a6c55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:12.160676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ce920-21b2-4228-8617-886c921a6c55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:12.210677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 902/1798] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:12.331332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ce920-21b2-4228-8617-886c921a6c55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:12.339725 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ce920-21b2-4228-8617-886c921a6c55 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:12.371266 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 897/1799] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:12.416946 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca32c2-8958-4e2c-afc4-d8b2ad5bedea service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:12.420104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b7ca32c2-8958-4e2c-afc4-d8b2ad5bedea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:12.477004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca32c2-8958-4e2c-afc4-d8b2ad5bedea service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:12.514084 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d9561-6b92-423a-a991-22352ef27f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:12.515695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d9561-6b92-423a-a991-22352ef27f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:12.526046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d9561-6b92-423a-a991-22352ef27f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:12.526317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d9561-6b92-423a-a991-22352ef27f13 admin admin] PATH_INFO: `/v3/users/238780d5d7dc4bda91fc68da86aeb07d` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:12.528981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d9561-6b92-423a-a991-22352ef27f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=238780d5d7dc4bda91fc68da86aeb07d)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:12.537443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d9561-6b92-423a-a991-22352ef27f13 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:12.886986 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:12.915374 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-290d9561-6b92-423a-a991-22352ef27f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '238780d5d7dc4bda91fc68da86aeb07d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:13.015968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-290d9561-6b92-423a-a991-22352ef27f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '238780d5d7dc4bda91fc68da86aeb07d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:13.017034 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-290d9561-6b92-423a-a991-22352ef27f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '238780d5d7dc4bda91fc68da86aeb07d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:13.019172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-290d9561-6b92-423a-a991-22352ef27f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '238780d5d7dc4bda91fc68da86aeb07d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:13.036869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-290d9561-6b92-423a-a991-22352ef27f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '238780d5d7dc4bda91fc68da86aeb07d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:13.041005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:13.064452 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 903/1800] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:12 2022] DELETE /identity/v3/users/238780d5d7dc4bda91fc68da86aeb07d => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:13.069314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddfb97-bf86-48af-8246-42fe62fdf3aa None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:13.070062 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddfb97-bf86-48af-8246-42fe62fdf3aa None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:13.070334 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddfb97-bf86-48af-8246-42fe62fdf3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:13.097012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-c0ddfb97-bf86-48af-8246-42fe62fdf3aa None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:13.098298 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c0ddfb97-bf86-48af-8246-42fe62fdf3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:13.197975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 898/1801] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:13.230444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d9561-6b92-423a-a991-22352ef27f13 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:13.232891 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-290d9561-6b92-423a-a991-22352ef27f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:13.289777 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddfb97-bf86-48af-8246-42fe62fdf3aa None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:13.292167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c0ddfb97-bf86-48af-8246-42fe62fdf3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:13.342550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddfb97-bf86-48af-8246-42fe62fdf3aa None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:13.386090 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee55f5-ee3c-44fd-b535-09d4aa7038cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:13.391756 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee55f5-ee3c-44fd-b535-09d4aa7038cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:13.391756 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee55f5-ee3c-44fd-b535-09d4aa7038cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:13.391756 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee55f5-ee3c-44fd-b535-09d4aa7038cd admin admin] PATH_INFO: `/v3/projects/55ce820305bf4afc90e0d6ebe984544c` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:13.392986 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee55f5-ee3c-44fd-b535-09d4aa7038cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=55ce820305bf4afc90e0d6ebe984544c)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:13.397754 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee55f5-ee3c-44fd-b535-09d4aa7038cd admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:13.488631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d9561-6b92-423a-a991-22352ef27f13 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:13.494006 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005fb9e-90d0-4262-b764-d4d48f5b8fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:13.495073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005fb9e-90d0-4262-b764-d4d48f5b8fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:13.495073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005fb9e-90d0-4262-b764-d4d48f5b8fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:13.495267 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005fb9e-90d0-4262-b764-d4d48f5b8fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:13.506444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005fb9e-90d0-4262-b764-d4d48f5b8fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:13.507933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005fb9e-90d0-4262-b764-d4d48f5b8fe9 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:13.521453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 904/1802] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:13.609578 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-83ee55f5-ee3c-44fd-b535-09d4aa7038cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55ce820305bf4afc90e0d6ebe984544c', 'request_id': 'req-83ee55f5-ee3c-44fd-b535-09d4aa7038cd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:13.752438 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-83ee55f5-ee3c-44fd-b535-09d4aa7038cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55ce820305bf4afc90e0d6ebe984544c', 'request_id': 'req-83ee55f5-ee3c-44fd-b535-09d4aa7038cd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:13.761852 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-83ee55f5-ee3c-44fd-b535-09d4aa7038cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55ce820305bf4afc90e0d6ebe984544c', 'request_id': 'req-83ee55f5-ee3c-44fd-b535-09d4aa7038cd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:13.781598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-83ee55f5-ee3c-44fd-b535-09d4aa7038cd admin admin] The token cache is being invalidate because project 55ce820305bf4afc90e0d6ebe984544c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:13.782609 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-83ee55f5-ee3c-44fd-b535-09d4aa7038cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:13.783128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-83ee55f5-ee3c-44fd-b535-09d4aa7038cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:13.785290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 899/1803] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:13 2022] DELETE /identity/v3/projects/55ce820305bf4afc90e0d6ebe984544c => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:13.789308 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005fb9e-90d0-4262-b764-d4d48f5b8fe9 service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:13.800402 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005fb9e-90d0-4262-b764-d4d48f5b8fe9 service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:13.872116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe2cc4-2854-481a-8b38-00c12eb735ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:13.872796 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe2cc4-2854-481a-8b38-00c12eb735ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:13.873379 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe2cc4-2854-481a-8b38-00c12eb735ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:13.873652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe2cc4-2854-481a-8b38-00c12eb735ac admin admin] PATH_INFO: `/v3/users/968855185a654d01b8fa6a17eed0e214` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:13.875019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe2cc4-2854-481a-8b38-00c12eb735ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=968855185a654d01b8fa6a17eed0e214)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:13.876989 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe2cc4-2854-481a-8b38-00c12eb735ac admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:13.916540 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922d7b1-f354-4fd4-b19e-eaf780918c99 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:13.917923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922d7b1-f354-4fd4-b19e-eaf780918c99 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:13.918360 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922d7b1-f354-4fd4-b19e-eaf780918c99 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:13.922180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 900/1804] 10.222.0.25 () {54 vars in 921 bytes} [Wed Sep 7 16:51:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:51:13.932949 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682916b2-9f49-4f76-9787-9adaa3192b25 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:13.933591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682916b2-9f49-4f76-9787-9adaa3192b25 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:13.934037 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682916b2-9f49-4f76-9787-9adaa3192b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:13.968643 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-682916b2-9f49-4f76-9787-9adaa3192b25 None None] MFA Rules not processed for user `cf48978c20f04173b114e15e1ce2157c`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:13.970074 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-682916b2-9f49-4f76-9787-9adaa3192b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:14.145075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 901/1805] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Sep 7 16:51:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:14.185142 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-e8fe2cc4-2854-481a-8b38-00c12eb735ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '968855185a654d01b8fa6a17eed0e214'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:14.375539 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-e8fe2cc4-2854-481a-8b38-00c12eb735ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '968855185a654d01b8fa6a17eed0e214'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:14.376491 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-e8fe2cc4-2854-481a-8b38-00c12eb735ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '968855185a654d01b8fa6a17eed0e214'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:14.377479 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-e8fe2cc4-2854-481a-8b38-00c12eb735ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '968855185a654d01b8fa6a17eed0e214'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:14.388309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-e8fe2cc4-2854-481a-8b38-00c12eb735ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '968855185a654d01b8fa6a17eed0e214'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:14.407864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682916b2-9f49-4f76-9787-9adaa3192b25 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:14.419245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-682916b2-9f49-4f76-9787-9adaa3192b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:14.451178 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 905/1806] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:13 2022] DELETE /identity/v3/users/968855185a654d01b8fa6a17eed0e214 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:14.500429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682916b2-9f49-4f76-9787-9adaa3192b25 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:14.682742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe2cc4-2854-481a-8b38-00c12eb735ac admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:14.685285 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e8fe2cc4-2854-481a-8b38-00c12eb735ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:14.754300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae57886-fb92-48a3-92d4-83bfe37edc6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:14.755078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae57886-fb92-48a3-92d4-83bfe37edc6f service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:14.755218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae57886-fb92-48a3-92d4-83bfe37edc6f service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:14.755514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae57886-fb92-48a3-92d4-83bfe37edc6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:14.761008 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1ae57886-fb92-48a3-92d4-83bfe37edc6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:14.825508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae57886-fb92-48a3-92d4-83bfe37edc6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:14.829320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae57886-fb92-48a3-92d4-83bfe37edc6f service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:14.874754 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe2cc4-2854-481a-8b38-00c12eb735ac admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:14.998704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b30899-f20d-4924-80a2-31ab2f8d9d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:14.998704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b30899-f20d-4924-80a2-31ab2f8d9d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:14.998704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b30899-f20d-4924-80a2-31ab2f8d9d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:14.998704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b30899-f20d-4924-80a2-31ab2f8d9d73 admin admin] PATH_INFO: `/v3/projects/e3514681f8424537a4254d108eefbe75` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:15.001893 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b30899-f20d-4924-80a2-31ab2f8d9d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3514681f8424537a4254d108eefbe75)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:15.001893 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b30899-f20d-4924-80a2-31ab2f8d9d73 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:15.003912 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 902/1807] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:15.340311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c5b30899-f20d-4924-80a2-31ab2f8d9d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3514681f8424537a4254d108eefbe75', 'request_id': 'req-c5b30899-f20d-4924-80a2-31ab2f8d9d73'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:15.380479 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c5b30899-f20d-4924-80a2-31ab2f8d9d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3514681f8424537a4254d108eefbe75', 'request_id': 'req-c5b30899-f20d-4924-80a2-31ab2f8d9d73'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:15.484383 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c5b30899-f20d-4924-80a2-31ab2f8d9d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3514681f8424537a4254d108eefbe75', 'request_id': 'req-c5b30899-f20d-4924-80a2-31ab2f8d9d73'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:15.530144 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c5b30899-f20d-4924-80a2-31ab2f8d9d73 admin admin] The token cache is being invalidate because project e3514681f8424537a4254d108eefbe75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:15.530687 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c5b30899-f20d-4924-80a2-31ab2f8d9d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:15.531523 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c5b30899-f20d-4924-80a2-31ab2f8d9d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:15.538141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 906/1808] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:14 2022] DELETE /identity/v3/projects/e3514681f8424537a4254d108eefbe75 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:15.539104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae57886-fb92-48a3-92d4-83bfe37edc6f service nova] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:15.559164 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae57886-fb92-48a3-92d4-83bfe37edc6f service nova] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:15.752293 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e6a58-7574-41e6-b3bf-0fc07d31340b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:15.753178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e6a58-7574-41e6-b3bf-0fc07d31340b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:15.754643 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e6a58-7574-41e6-b3bf-0fc07d31340b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:15.755028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e6a58-7574-41e6-b3bf-0fc07d31340b admin admin] PATH_INFO: `/v3/users/ca8b61f3e8ee4cb49772ccdafef1687d` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:15.759154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e6a58-7574-41e6-b3bf-0fc07d31340b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca8b61f3e8ee4cb49772ccdafef1687d)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:15.768910 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e6a58-7574-41e6-b3bf-0fc07d31340b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:15.998567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-340e6a58-7574-41e6-b3bf-0fc07d31340b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca8b61f3e8ee4cb49772ccdafef1687d'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:15.999694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-340e6a58-7574-41e6-b3bf-0fc07d31340b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca8b61f3e8ee4cb49772ccdafef1687d'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:16.025441 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b30899-f20d-4924-80a2-31ab2f8d9d73 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:16.027416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c5b30899-f20d-4924-80a2-31ab2f8d9d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:16.035326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-340e6a58-7574-41e6-b3bf-0fc07d31340b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca8b61f3e8ee4cb49772ccdafef1687d'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:16.078196 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b30899-f20d-4924-80a2-31ab2f8d9d73 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:16.085500 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-340e6a58-7574-41e6-b3bf-0fc07d31340b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca8b61f3e8ee4cb49772ccdafef1687d'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:16.086312 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-340e6a58-7574-41e6-b3bf-0fc07d31340b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca8b61f3e8ee4cb49772ccdafef1687d'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:16.088622 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824176e-7bd7-4006-9165-3482ef184a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:16.094988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824176e-7bd7-4006-9165-3482ef184a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:16.094988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824176e-7bd7-4006-9165-3482ef184a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:16.094988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824176e-7bd7-4006-9165-3482ef184a7d admin admin] PATH_INFO: `/v3/projects/4132c4391f7041f3981e28c970424a7e` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:16.094988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824176e-7bd7-4006-9165-3482ef184a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4132c4391f7041f3981e28c970424a7e)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:16.096200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824176e-7bd7-4006-9165-3482ef184a7d admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:16.294606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 903/1809] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:15 2022] DELETE /identity/v3/users/ca8b61f3e8ee4cb49772ccdafef1687d => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:16.393051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-8824176e-7bd7-4006-9165-3482ef184a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4132c4391f7041f3981e28c970424a7e', 'request_id': 'req-8824176e-7bd7-4006-9165-3482ef184a7d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:16.406399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-8824176e-7bd7-4006-9165-3482ef184a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4132c4391f7041f3981e28c970424a7e', 'request_id': 'req-8824176e-7bd7-4006-9165-3482ef184a7d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:16.519721 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-8824176e-7bd7-4006-9165-3482ef184a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4132c4391f7041f3981e28c970424a7e', 'request_id': 'req-8824176e-7bd7-4006-9165-3482ef184a7d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:16.552310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:16.562962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-8824176e-7bd7-4006-9165-3482ef184a7d admin admin] The token cache is being invalidate because project 4132c4391f7041f3981e28c970424a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:16.564110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-8824176e-7bd7-4006-9165-3482ef184a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:16.565453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-8824176e-7bd7-4006-9165-3482ef184a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:16.569822 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 907/1810] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:16 2022] DELETE /identity/v3/projects/4132c4391f7041f3981e28c970424a7e => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:16.577875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262a309-247f-44ad-9306-2ac80f6d9e82 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:16.578582 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262a309-247f-44ad-9306-2ac80f6d9e82 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:16.579058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262a309-247f-44ad-9306-2ac80f6d9e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:16.614284 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-4262a309-247f-44ad-9306-2ac80f6d9e82 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:16.615510 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4262a309-247f-44ad-9306-2ac80f6d9e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:16.744129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 904/1811] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:16.751857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46087090-9bef-4b99-91d0-0fabc4247e04 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:16.751857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46087090-9bef-4b99-91d0-0fabc4247e04 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:16.752590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46087090-9bef-4b99-91d0-0fabc4247e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:16.785705 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-46087090-9bef-4b99-91d0-0fabc4247e04 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:16.789890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-46087090-9bef-4b99-91d0-0fabc4247e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:16.808452 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 908/1812] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:16.815739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262a309-247f-44ad-9306-2ac80f6d9e82 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:16.835058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262a309-247f-44ad-9306-2ac80f6d9e82 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:16.842871 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1353ea-b1d3-4a45-a876-4ff51cfb2f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:16.844242 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1353ea-b1d3-4a45-a876-4ff51cfb2f8a admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:16.844669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1353ea-b1d3-4a45-a876-4ff51cfb2f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:16.845529 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1353ea-b1d3-4a45-a876-4ff51cfb2f8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:16.846905 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1353ea-b1d3-4a45-a876-4ff51cfb2f8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:51:16.851625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1353ea-b1d3-4a45-a876-4ff51cfb2f8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:16.851625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1353ea-b1d3-4a45-a876-4ff51cfb2f8a admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:16.879999 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 905/1813] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:51:16.892859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46087090-9bef-4b99-91d0-0fabc4247e04 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:16.903256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46087090-9bef-4b99-91d0-0fabc4247e04 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:16.919056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fbc74-ef7d-4750-9f94-48450153d14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:16.924334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fbc74-ef7d-4750-9f94-48450153d14b admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:16.924334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fbc74-ef7d-4750-9f94-48450153d14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:16.924334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fbc74-ef7d-4750-9f94-48450153d14b admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:16.924334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fbc74-ef7d-4750-9f94-48450153d14b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:16.925038 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fbc74-ef7d-4750-9f94-48450153d14b admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:17.056597 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 909/1814] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:16 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:17.063766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1353ea-b1d3-4a45-a876-4ff51cfb2f8a admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:17.079056 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1353ea-b1d3-4a45-a876-4ff51cfb2f8a admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:17.192025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dba7c-528a-4ea9-bb2f-6803884cf7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:17.192644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dba7c-528a-4ea9-bb2f-6803884cf7fe admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:17.192920 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dba7c-528a-4ea9-bb2f-6803884cf7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:17.193189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dba7c-528a-4ea9-bb2f-6803884cf7fe admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:17.193820 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dba7c-528a-4ea9-bb2f-6803884cf7fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:17.195916 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dba7c-528a-4ea9-bb2f-6803884cf7fe admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:17.196177 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fbc74-ef7d-4750-9f94-48450153d14b admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:17.198074 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b89fbc74-ef7d-4750-9f94-48450153d14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:17.222994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fbc74-ef7d-4750-9f94-48450153d14b admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:17.233746 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363649f-49da-4684-9abf-7f2fdd3e7efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:17.235339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363649f-49da-4684-9abf-7f2fdd3e7efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:17.235722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363649f-49da-4684-9abf-7f2fdd3e7efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:17.236055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363649f-49da-4684-9abf-7f2fdd3e7efb admin admin] PATH_INFO: `/v3/projects/f41aad3d07604f09a7627ec8be76c7f4` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:17.237452 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363649f-49da-4684-9abf-7f2fdd3e7efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41aad3d07604f09a7627ec8be76c7f4)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:17.239695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363649f-49da-4684-9abf-7f2fdd3e7efb admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:17.324431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 906/1815] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:17 2022] POST /identity/v3/users => generated 290 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:17.325226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dba7c-528a-4ea9-bb2f-6803884cf7fe admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:17.346245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dba7c-528a-4ea9-bb2f-6803884cf7fe admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:17.363785 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f0ed5-442a-43f3-b542-a34e8210a949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:17.364431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f0ed5-442a-43f3-b542-a34e8210a949 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:17.364708 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f0ed5-442a-43f3-b542-a34e8210a949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:17.365040 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f0ed5-442a-43f3-b542-a34e8210a949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:17.365613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f0ed5-442a-43f3-b542-a34e8210a949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:17.381859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f0ed5-442a-43f3-b542-a34e8210a949 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:17.437282 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 907/1816] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:17.454167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f0ed5-442a-43f3-b542-a34e8210a949 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:17.466592 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3363649f-49da-4684-9abf-7f2fdd3e7efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41aad3d07604f09a7627ec8be76c7f4', 'request_id': 'req-3363649f-49da-4684-9abf-7f2fdd3e7efb'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:17.483745 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f0ed5-442a-43f3-b542-a34e8210a949 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:17.486476 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3363649f-49da-4684-9abf-7f2fdd3e7efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41aad3d07604f09a7627ec8be76c7f4', 'request_id': 'req-3363649f-49da-4684-9abf-7f2fdd3e7efb'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:17.589897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3363649f-49da-4684-9abf-7f2fdd3e7efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41aad3d07604f09a7627ec8be76c7f4', 'request_id': 'req-3363649f-49da-4684-9abf-7f2fdd3e7efb'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:17.609999 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1e327-e2af-465b-8830-f2eee5ceff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:17.611523 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1e327-e2af-465b-8830-f2eee5ceff03 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:17.612253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1e327-e2af-465b-8830-f2eee5ceff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:17.613384 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1e327-e2af-465b-8830-f2eee5ceff03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:17.615579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3363649f-49da-4684-9abf-7f2fdd3e7efb admin admin] The token cache is being invalidate because project f41aad3d07604f09a7627ec8be76c7f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:17.616020 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1e327-e2af-465b-8830-f2eee5ceff03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:17.620067 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1e327-e2af-465b-8830-f2eee5ceff03 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:17.620315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3363649f-49da-4684-9abf-7f2fdd3e7efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:17.622001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3363649f-49da-4684-9abf-7f2fdd3e7efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:17.629740 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 910/1817] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:17 2022] DELETE /identity/v3/projects/f41aad3d07604f09a7627ec8be76c7f4 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:17.636536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f29d8d-2cb8-411f-83f3-0c86222a441f None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:17.636827 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f29d8d-2cb8-411f-83f3-0c86222a441f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:17.638465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f29d8d-2cb8-411f-83f3-0c86222a441f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:17.667557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 908/1818] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:17.684714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1e327-e2af-465b-8830-f2eee5ceff03 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:17.688591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-cfa1e327-e2af-465b-8830-f2eee5ceff03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:17.699862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-42f29d8d-2cb8-411f-83f3-0c86222a441f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:17.702750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-42f29d8d-2cb8-411f-83f3-0c86222a441f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:17.719419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1e327-e2af-465b-8830-f2eee5ceff03 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:17.729064 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 911/1819] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:17.731579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd84c7-b4b5-499d-a35d-ab1cf9c5eb4a None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:17.731956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd84c7-b4b5-499d-a35d-ab1cf9c5eb4a None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:17.732972 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd84c7-b4b5-499d-a35d-ab1cf9c5eb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:17.736643 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869313b-8868-44c6-9193-cd947d6b320b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:17.754801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869313b-8868-44c6-9193-cd947d6b320b admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:17.754801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869313b-8868-44c6-9193-cd947d6b320b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:17.754801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869313b-8868-44c6-9193-cd947d6b320b admin admin] PATH_INFO: `/v3/projects/2ae0c8aa3b244cb883a5626fbac6d6ca/users/cc0493c686ac4556a3c5be603e869a99/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:17.758633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-e9bd84c7-b4b5-499d-a35d-ab1cf9c5eb4a None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:17.761254 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e9bd84c7-b4b5-499d-a35d-ab1cf9c5eb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:17.772236 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 912/1820] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:17.778417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd84c7-b4b5-499d-a35d-ab1cf9c5eb4a None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:17.781519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869313b-8868-44c6-9193-cd947d6b320b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae0c8aa3b244cb883a5626fbac6d6ca, user_id=cc0493c686ac4556a3c5be603e869a99, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:17.786233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869313b-8868-44c6-9193-cd947d6b320b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:17.790051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd84c7-b4b5-499d-a35d-ab1cf9c5eb4a None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:17.798132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b64909-e452-4871-9df4-70b8babd3e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:17.798886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b64909-e452-4871-9df4-70b8babd3e97 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:17.799237 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b64909-e452-4871-9df4-70b8babd3e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:17.799638 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b64909-e452-4871-9df4-70b8babd3e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:17.800440 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b64909-e452-4871-9df4-70b8babd3e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:51:17.800806 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b64909-e452-4871-9df4-70b8babd3e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:17.802597 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b64909-e452-4871-9df4-70b8babd3e97 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:17.824226 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 913/1821] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:51:17.828366 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b64909-e452-4871-9df4-70b8babd3e97 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:17.843105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b64909-e452-4871-9df4-70b8babd3e97 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:17.849364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fca263-6fdd-4e43-b179-5bba2f370a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:17.849982 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fca263-6fdd-4e43-b179-5bba2f370a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:17.850261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fca263-6fdd-4e43-b179-5bba2f370a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:17.850525 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fca263-6fdd-4e43-b179-5bba2f370a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:17.851151 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fca263-6fdd-4e43-b179-5bba2f370a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:17.853390 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fca263-6fdd-4e43-b179-5bba2f370a8c admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:17.909603 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 909/1822] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:17 2022] PUT /identity/v3/projects/2ae0c8aa3b244cb883a5626fbac6d6ca/users/cc0493c686ac4556a3c5be603e869a99/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:17.914910 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a1248-94bb-450e-b64b-3c49ccb854bb None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:17.915454 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a1248-94bb-450e-b64b-3c49ccb854bb None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:17.916161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a1248-94bb-450e-b64b-3c49ccb854bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:17.965129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-326a1248-94bb-450e-b64b-3c49ccb854bb None None] MFA Rules not processed for user `cc0493c686ac4556a3c5be603e869a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:17.967756 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-326a1248-94bb-450e-b64b-3c49ccb854bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:18.074057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 914/1823] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:17 2022] POST /identity/v3/projects => generated 393 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:18.074057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fca263-6fdd-4e43-b179-5bba2f370a8c admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:18.074931 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c1fca263-6fdd-4e43-b179-5bba2f370a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:18.090083 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 910/1824] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:18.090659 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a1248-94bb-450e-b64b-3c49ccb854bb None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:18.181584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fca263-6fdd-4e43-b179-5bba2f370a8c admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:18.187651 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a683aa-1e13-41c0-8ef6-2446d3e3c691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:18.188317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a683aa-1e13-41c0-8ef6-2446d3e3c691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:18.188597 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a683aa-1e13-41c0-8ef6-2446d3e3c691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:18.188872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a683aa-1e13-41c0-8ef6-2446d3e3c691 admin admin] PATH_INFO: `/v3/users/bb17a0fa47eb472780b19284f45a413a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:18.190156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a683aa-1e13-41c0-8ef6-2446d3e3c691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb17a0fa47eb472780b19284f45a413a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:18.193280 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a683aa-1e13-41c0-8ef6-2446d3e3c691 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:18.194788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a1248-94bb-450e-b64b-3c49ccb854bb None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:18.204758 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f68726-7339-4e3a-bcbe-cdc69616dc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:18.205611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68726-7339-4e3a-bcbe-cdc69616dc73 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:18.206102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68726-7339-4e3a-bcbe-cdc69616dc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:18.207125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68726-7339-4e3a-bcbe-cdc69616dc73 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:18.207125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f68726-7339-4e3a-bcbe-cdc69616dc73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:18.209459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f68726-7339-4e3a-bcbe-cdc69616dc73 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:18.326867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:18.339747 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 911/1825] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:18 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:18.339747 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f68726-7339-4e3a-bcbe-cdc69616dc73 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:18.369183 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f68726-7339-4e3a-bcbe-cdc69616dc73 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:18.383894 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5c081-d6d8-44ee-9a7d-faa78b29d09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:18.384755 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5c081-d6d8-44ee-9a7d-faa78b29d09b admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:18.385391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5c081-d6d8-44ee-9a7d-faa78b29d09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:18.389419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5c081-d6d8-44ee-9a7d-faa78b29d09b admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:18.389419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5c081-d6d8-44ee-9a7d-faa78b29d09b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:18.389976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5c081-d6d8-44ee-9a7d-faa78b29d09b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:18.446757 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-a8a683aa-1e13-41c0-8ef6-2446d3e3c691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb17a0fa47eb472780b19284f45a413a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:18.557682 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 912/1826] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:18 2022] POST /identity/v3/projects => generated 379 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:18.558558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5c081-d6d8-44ee-9a7d-faa78b29d09b admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:18.561475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-a8a683aa-1e13-41c0-8ef6-2446d3e3c691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb17a0fa47eb472780b19284f45a413a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:18.562341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-a8a683aa-1e13-41c0-8ef6-2446d3e3c691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb17a0fa47eb472780b19284f45a413a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:18.564153 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-a8a683aa-1e13-41c0-8ef6-2446d3e3c691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb17a0fa47eb472780b19284f45a413a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:18.585200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-a8a683aa-1e13-41c0-8ef6-2446d3e3c691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb17a0fa47eb472780b19284f45a413a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:18.615976 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 915/1827] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:18 2022] DELETE /identity/v3/users/bb17a0fa47eb472780b19284f45a413a => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:18.616696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a683aa-1e13-41c0-8ef6-2446d3e3c691 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:18.618444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a8a683aa-1e13-41c0-8ef6-2446d3e3c691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:18.690627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5c081-d6d8-44ee-9a7d-faa78b29d09b admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:18.760735 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a683aa-1e13-41c0-8ef6-2446d3e3c691 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:18.767357 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3603ac6-35f6-41e8-83d0-4170ffc47aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:18.768062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3603ac6-35f6-41e8-83d0-4170ffc47aac admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:18.768416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3603ac6-35f6-41e8-83d0-4170ffc47aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:18.768699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3603ac6-35f6-41e8-83d0-4170ffc47aac admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:18.774037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3603ac6-35f6-41e8-83d0-4170ffc47aac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:18.774037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3603ac6-35f6-41e8-83d0-4170ffc47aac admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:18.820303 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92b91a-9313-4bc0-84f5-f5e3268de43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:18.821142 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92b91a-9313-4bc0-84f5-f5e3268de43e admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:18.821607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92b91a-9313-4bc0-84f5-f5e3268de43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:18.822060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92b91a-9313-4bc0-84f5-f5e3268de43e admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:18.823004 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92b91a-9313-4bc0-84f5-f5e3268de43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:18.824981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92b91a-9313-4bc0-84f5-f5e3268de43e admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:18.841375 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 913/1828] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:18.844324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bb13c-d956-4685-bb27-4f907ac443ab None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:18.844324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bb13c-d956-4685-bb27-4f907ac443ab None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:18.844669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bb13c-d956-4685-bb27-4f907ac443ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:18.882414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-a34bb13c-d956-4685-bb27-4f907ac443ab None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:18.884027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a34bb13c-d956-4685-bb27-4f907ac443ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:18.884697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 916/1829] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:18 2022] POST /identity/v3/users => generated 296 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:18.886318 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3603ac6-35f6-41e8-83d0-4170ffc47aac admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:18.890428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b3603ac6-35f6-41e8-83d0-4170ffc47aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:18.896951 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 914/1830] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:18.898118 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34bb13c-d956-4685-bb27-4f907ac443ab None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:18.913355 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3603ac6-35f6-41e8-83d0-4170ffc47aac admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:18.919384 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34bb13c-d956-4685-bb27-4f907ac443ab None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:18.925504 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba495cc9-dcad-43b1-9791-28dbc9863643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:18.926546 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba495cc9-dcad-43b1-9791-28dbc9863643 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:18.927206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba495cc9-dcad-43b1-9791-28dbc9863643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:18.927835 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba495cc9-dcad-43b1-9791-28dbc9863643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:18.929143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba495cc9-dcad-43b1-9791-28dbc9863643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:18.931436 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068f5d1-fa3b-491c-b328-55d6ad13d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:18.932384 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068f5d1-fa3b-491c-b328-55d6ad13d317 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:18.932672 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068f5d1-fa3b-491c-b328-55d6ad13d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:18.934241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba495cc9-dcad-43b1-9791-28dbc9863643 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:18.936845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068f5d1-fa3b-491c-b328-55d6ad13d317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:18.938143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068f5d1-fa3b-491c-b328-55d6ad13d317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:18.940857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068f5d1-fa3b-491c-b328-55d6ad13d317 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:18.955086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 915/1831] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:18.956115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068f5d1-fa3b-491c-b328-55d6ad13d317 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:18.961239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 917/1832] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:18.962689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-6068f5d1-fa3b-491c-b328-55d6ad13d317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:18.964328 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba495cc9-dcad-43b1-9791-28dbc9863643 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:18.977775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba495cc9-dcad-43b1-9791-28dbc9863643 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:18.992656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad026e9-f758-415b-92a8-9b91dd61c195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:18.992656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad026e9-f758-415b-92a8-9b91dd61c195 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:18.992656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad026e9-f758-415b-92a8-9b91dd61c195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:18.992656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad026e9-f758-415b-92a8-9b91dd61c195 admin admin] PATH_INFO: `/v3/projects/780704ca51ac4b17b7c448c7338f8ddd/users/cf304b594eec4e49971eee0db3b6c774/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:19.013401 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad026e9-f758-415b-92a8-9b91dd61c195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=780704ca51ac4b17b7c448c7338f8ddd, user_id=cf304b594eec4e49971eee0db3b6c774, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:19.016734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad026e9-f758-415b-92a8-9b91dd61c195 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:19.059673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068f5d1-fa3b-491c-b328-55d6ad13d317 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:19.065569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44954d4c-c1af-4b7b-a9f5-f91d98f466a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:19.066360 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44954d4c-c1af-4b7b-a9f5-f91d98f466a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:19.066702 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44954d4c-c1af-4b7b-a9f5-f91d98f466a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:19.067052 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44954d4c-c1af-4b7b-a9f5-f91d98f466a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:19.074109 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:19.090479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44954d4c-c1af-4b7b-a9f5-f91d98f466a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:19.093608 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44954d4c-c1af-4b7b-a9f5-f91d98f466a5 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:19.112342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 916/1833] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:19.114422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44954d4c-c1af-4b7b-a9f5-f91d98f466a5 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:19.120653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 918/1834] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:18 2022] PUT /identity/v3/projects/780704ca51ac4b17b7c448c7338f8ddd/users/cf304b594eec4e49971eee0db3b6c774/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:19.129217 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad026e9-f758-415b-92a8-9b91dd61c195 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:19.135149 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44954d4c-c1af-4b7b-a9f5-f91d98f466a5 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:19.227391 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad026e9-f758-415b-92a8-9b91dd61c195 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:19.235727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560aba7a-f6e2-42a6-aa59-3febca816d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:19.236819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560aba7a-f6e2-42a6-aa59-3febca816d09 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:19.237257 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560aba7a-f6e2-42a6-aa59-3febca816d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:19.237671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560aba7a-f6e2-42a6-aa59-3febca816d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:19.238690 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560aba7a-f6e2-42a6-aa59-3febca816d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:19.241431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560aba7a-f6e2-42a6-aa59-3febca816d09 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:19.256413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e451ae7-ef68-46a5-9b61-ac8860a3e90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:19.256766 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 919/1835] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:19.257426 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e451ae7-ef68-46a5-9b61-ac8860a3e90f admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:19.257898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e451ae7-ef68-46a5-9b61-ac8860a3e90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:19.258426 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e451ae7-ef68-46a5-9b61-ac8860a3e90f admin admin] PATH_INFO: `/v3/projects/facee60315b946d393f2e8b22f6552e2/users/bf79a6a6e2ef4048982d17f012cc8bf6/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:19.262087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560aba7a-f6e2-42a6-aa59-3febca816d09 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:19.288969 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e451ae7-ef68-46a5-9b61-ac8860a3e90f admin admin] RBAC: Authorizing `identity:create_grant(project_id=facee60315b946d393f2e8b22f6552e2, user_id=bf79a6a6e2ef4048982d17f012cc8bf6, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:19.292139 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560aba7a-f6e2-42a6-aa59-3febca816d09 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:19.293167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e451ae7-ef68-46a5-9b61-ac8860a3e90f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:19.311665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d899e95-75b0-446c-b915-06d573f7ce9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:19.314025 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d899e95-75b0-446c-b915-06d573f7ce9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:19.314625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d899e95-75b0-446c-b915-06d573f7ce9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:19.315129 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d899e95-75b0-446c-b915-06d573f7ce9d admin admin] PATH_INFO: `/v3/projects/780704ca51ac4b17b7c448c7338f8ddd/users/cf304b594eec4e49971eee0db3b6c774/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:19.319898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d899e95-75b0-446c-b915-06d573f7ce9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=780704ca51ac4b17b7c448c7338f8ddd, user_id=cf304b594eec4e49971eee0db3b6c774, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:19.324785 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d899e95-75b0-446c-b915-06d573f7ce9d admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:19.343543 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 920/1836] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:19 2022] PUT /identity/v3/projects/780704ca51ac4b17b7c448c7338f8ddd/users/cf304b594eec4e49971eee0db3b6c774/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:19.356660 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7c4fb-1408-4df4-b285-6f7fe1a55676 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:19.356945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7c4fb-1408-4df4-b285-6f7fe1a55676 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:19.357306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7c4fb-1408-4df4-b285-6f7fe1a55676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:19.394331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-e6c7c4fb-1408-4df4-b285-6f7fe1a55676 None None] MFA Rules not processed for user `cf304b594eec4e49971eee0db3b6c774`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:19.395332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e6c7c4fb-1408-4df4-b285-6f7fe1a55676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:19.507530 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 917/1837] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:19 2022] PUT /identity/v3/projects/facee60315b946d393f2e8b22f6552e2/users/bf79a6a6e2ef4048982d17f012cc8bf6/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:19.516958 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde43dbf-a6f6-459e-b796-60f2794483a5 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:19.517404 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde43dbf-a6f6-459e-b796-60f2794483a5 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:19.517824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde43dbf-a6f6-459e-b796-60f2794483a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:19.544536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 921/1838] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:19.554828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7c4fb-1408-4df4-b285-6f7fe1a55676 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:19.558089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e6c7c4fb-1408-4df4-b285-6f7fe1a55676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:19.605855 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-bde43dbf-a6f6-459e-b796-60f2794483a5 None None] MFA Rules not processed for user `bf79a6a6e2ef4048982d17f012cc8bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:19.608818 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-bde43dbf-a6f6-459e-b796-60f2794483a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:19.718294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7c4fb-1408-4df4-b285-6f7fe1a55676 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:19.811190 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 918/1839] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:19.831641 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde43dbf-a6f6-459e-b796-60f2794483a5 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:19.848371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c619675-4704-41c1-a0db-811f80de0249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:19.849565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c619675-4704-41c1-a0db-811f80de0249 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:19.849565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c619675-4704-41c1-a0db-811f80de0249 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:19.849943 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c619675-4704-41c1-a0db-811f80de0249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:19.930814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde43dbf-a6f6-459e-b796-60f2794483a5 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:19.937739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66543af7-f35e-4089-a89f-7fbb01a2ee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:19.938573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66543af7-f35e-4089-a89f-7fbb01a2ee60 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:19.938945 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66543af7-f35e-4089-a89f-7fbb01a2ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:19.939307 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66543af7-f35e-4089-a89f-7fbb01a2ee60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:19.940273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66543af7-f35e-4089-a89f-7fbb01a2ee60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:19.942681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66543af7-f35e-4089-a89f-7fbb01a2ee60 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:19.943767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c619675-4704-41c1-a0db-811f80de0249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:19.945996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c619675-4704-41c1-a0db-811f80de0249 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:19.967950 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 922/1840] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:51:20.217961 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 919/1841] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:19 2022] POST /identity/v3/projects => generated 393 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:20.218985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c619675-4704-41c1-a0db-811f80de0249 service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:20.234366 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c619675-4704-41c1-a0db-811f80de0249 service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:20.429816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b58d3c-a86e-4336-bd43-ac4171efbf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:20.430831 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b58d3c-a86e-4336-bd43-ac4171efbf6a admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:20.430831 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b58d3c-a86e-4336-bd43-ac4171efbf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:20.431050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b58d3c-a86e-4336-bd43-ac4171efbf6a admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:20.431833 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b58d3c-a86e-4336-bd43-ac4171efbf6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:20.437232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b58d3c-a86e-4336-bd43-ac4171efbf6a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:20.508874 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66543af7-f35e-4089-a89f-7fbb01a2ee60 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:20.510664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-66543af7-f35e-4089-a89f-7fbb01a2ee60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:20.528101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66543af7-f35e-4089-a89f-7fbb01a2ee60 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:20.546748 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604b767-3d62-4199-b92a-536deb4d584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:20.548321 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604b767-3d62-4199-b92a-536deb4d584a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:20.548614 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604b767-3d62-4199-b92a-536deb4d584a admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:20.548893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604b767-3d62-4199-b92a-536deb4d584a admin admin] PATH_INFO: `/v3/projects/efd1a52bcfdf45d09f3f0e11034196f2` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:20.550191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604b767-3d62-4199-b92a-536deb4d584a admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd1a52bcfdf45d09f3f0e11034196f2)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:20.553097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604b767-3d62-4199-b92a-536deb4d584a admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:20.616498 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 923/1842] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:20 2022] POST /identity/v3/users => generated 303 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:20.623787 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b58d3c-a86e-4336-bd43-ac4171efbf6a admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:20.636177 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b58d3c-a86e-4336-bd43-ac4171efbf6a admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:20.643434 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4eae4-fc44-4813-9d8d-b6389fb84a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:20.644398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4eae4-fc44-4813-9d8d-b6389fb84a53 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:20.644802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4eae4-fc44-4813-9d8d-b6389fb84a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:20.645384 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4eae4-fc44-4813-9d8d-b6389fb84a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:20.646431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4eae4-fc44-4813-9d8d-b6389fb84a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:20.648880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4eae4-fc44-4813-9d8d-b6389fb84a53 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:20.668621 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 924/1843] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:20.669592 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4eae4-fc44-4813-9d8d-b6389fb84a53 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:20.680930 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4eae4-fc44-4813-9d8d-b6389fb84a53 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:20.686439 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481755b6-33e3-4d3c-ba37-73ce74d9eced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:20.687194 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481755b6-33e3-4d3c-ba37-73ce74d9eced admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:20.687619 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481755b6-33e3-4d3c-ba37-73ce74d9eced admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:20.687990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481755b6-33e3-4d3c-ba37-73ce74d9eced admin admin] PATH_INFO: `/v3/projects/043e9735ab8542efbabcae109213fb69/users/dd2bcc3c546440ecadf4ab996b1703f0/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:20.707844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481755b6-33e3-4d3c-ba37-73ce74d9eced admin admin] RBAC: Authorizing `identity:create_grant(project_id=043e9735ab8542efbabcae109213fb69, user_id=dd2bcc3c546440ecadf4ab996b1703f0, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:20.710605 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481755b6-33e3-4d3c-ba37-73ce74d9eced admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:20.860555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 925/1844] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:20 2022] PUT /identity/v3/projects/043e9735ab8542efbabcae109213fb69/users/dd2bcc3c546440ecadf4ab996b1703f0/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:20.864403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481755b6-33e3-4d3c-ba37-73ce74d9eced admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:20.874459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0604b767-3d62-4199-b92a-536deb4d584a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd1a52bcfdf45d09f3f0e11034196f2', 'request_id': 'req-0604b767-3d62-4199-b92a-536deb4d584a'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:20.899768 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:21.032393 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481755b6-33e3-4d3c-ba37-73ce74d9eced admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:21.037065 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722e95a-97f3-462b-96a4-cb4d5b23c62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:21.037709 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722e95a-97f3-462b-96a4-cb4d5b23c62b admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:21.037985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722e95a-97f3-462b-96a4-cb4d5b23c62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:21.038256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722e95a-97f3-462b-96a4-cb4d5b23c62b admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:21.039860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722e95a-97f3-462b-96a4-cb4d5b23c62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:21.044512 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722e95a-97f3-462b-96a4-cb4d5b23c62b admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:21.064479 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 926/1845] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:21.069636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722e95a-97f3-462b-96a4-cb4d5b23c62b admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:21.081435 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722e95a-97f3-462b-96a4-cb4d5b23c62b admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:21.106743 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee3c81-1cc3-418b-acef-9044003dd599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:21.106743 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee3c81-1cc3-418b-acef-9044003dd599 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:21.106743 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee3c81-1cc3-418b-acef-9044003dd599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:21.106743 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee3c81-1cc3-418b-acef-9044003dd599 admin admin] PATH_INFO: `/v3/projects/043e9735ab8542efbabcae109213fb69/users/dd2bcc3c546440ecadf4ab996b1703f0/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:21.107848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee3c81-1cc3-418b-acef-9044003dd599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=043e9735ab8542efbabcae109213fb69, user_id=dd2bcc3c546440ecadf4ab996b1703f0, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:21.107848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee3c81-1cc3-418b-acef-9044003dd599 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:21.121456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 927/1846] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:21 2022] PUT /identity/v3/projects/043e9735ab8542efbabcae109213fb69/users/dd2bcc3c546440ecadf4ab996b1703f0/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:21.131980 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed2e3-cc5d-4d59-88bb-5dc0f2ba7f56 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:21.132253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed2e3-cc5d-4d59-88bb-5dc0f2ba7f56 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:21.132523 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed2e3-cc5d-4d59-88bb-5dc0f2ba7f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:21.140564 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0604b767-3d62-4199-b92a-536deb4d584a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd1a52bcfdf45d09f3f0e11034196f2', 'request_id': 'req-0604b767-3d62-4199-b92a-536deb4d584a'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:21.158668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0604b767-3d62-4199-b92a-536deb4d584a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd1a52bcfdf45d09f3f0e11034196f2', 'request_id': 'req-0604b767-3d62-4199-b92a-536deb4d584a'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:21.163690 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-b90ed2e3-cc5d-4d59-88bb-5dc0f2ba7f56 None None] MFA Rules not processed for user `dd2bcc3c546440ecadf4ab996b1703f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:21.165000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b90ed2e3-cc5d-4d59-88bb-5dc0f2ba7f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:21.173041 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0604b767-3d62-4199-b92a-536deb4d584a admin admin] The token cache is being invalidate because project efd1a52bcfdf45d09f3f0e11034196f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:21.173430 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0604b767-3d62-4199-b92a-536deb4d584a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:21.174426 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0604b767-3d62-4199-b92a-536deb4d584a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:21.176342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 920/1847] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:20 2022] DELETE /identity/v3/projects/efd1a52bcfdf45d09f3f0e11034196f2 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:21.180373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604b767-3d62-4199-b92a-536deb4d584a admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:21.182302 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0604b767-3d62-4199-b92a-536deb4d584a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:21.247795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 928/1848] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:21 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:21.265494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604b767-3d62-4199-b92a-536deb4d584a admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:21.335437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0b0fb-9327-4ab4-9086-3ec4c3ddba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:21.336136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0b0fb-9327-4ab4-9086-3ec4c3ddba90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:21.336418 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0b0fb-9327-4ab4-9086-3ec4c3ddba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:21.336696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0b0fb-9327-4ab4-9086-3ec4c3ddba90 admin admin] PATH_INFO: `/v3/users/b5578e07017845f6914b396f20524a79` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:21.337856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0b0fb-9327-4ab4-9086-3ec4c3ddba90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5578e07017845f6914b396f20524a79)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:21.340163 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0b0fb-9327-4ab4-9086-3ec4c3ddba90 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:21.401648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ed2e3-cc5d-4d59-88bb-5dc0f2ba7f56 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:21.405081 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b90ed2e3-cc5d-4d59-88bb-5dc0f2ba7f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:21.474610 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ed2e3-cc5d-4d59-88bb-5dc0f2ba7f56 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:21.486897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b1f6c-19d6-4742-932b-c36c928f02de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:21.488045 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b1f6c-19d6-4742-932b-c36c928f02de service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:21.488122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b1f6c-19d6-4742-932b-c36c928f02de service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:21.488452 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b1f6c-19d6-4742-932b-c36c928f02de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:21.510447 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b1f6c-19d6-4742-932b-c36c928f02de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:21.512036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b1f6c-19d6-4742-932b-c36c928f02de service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:21.526219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 929/1849] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:21.641026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b1f6c-19d6-4742-932b-c36c928f02de service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:21.652625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b1f6c-19d6-4742-932b-c36c928f02de service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:21.661026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7cc38-c8af-4d71-8b06-406909968289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:21.662213 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7cc38-c8af-4d71-8b06-406909968289 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:21.662656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7cc38-c8af-4d71-8b06-406909968289 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:21.663087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7cc38-c8af-4d71-8b06-406909968289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:21.665585 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-36e7cc38-c8af-4d71-8b06-406909968289 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:21.752295 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4ce0b0fb-9327-4ab4-9086-3ec4c3ddba90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5578e07017845f6914b396f20524a79'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:21.753235 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4ce0b0fb-9327-4ab4-9086-3ec4c3ddba90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5578e07017845f6914b396f20524a79'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:21.769722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7cc38-c8af-4d71-8b06-406909968289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:21.769722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7cc38-c8af-4d71-8b06-406909968289 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:21.771713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 930/1850] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:21.778424 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4ce0b0fb-9327-4ab4-9086-3ec4c3ddba90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5578e07017845f6914b396f20524a79'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:21.799393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4ce0b0fb-9327-4ab4-9086-3ec4c3ddba90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5578e07017845f6914b396f20524a79'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:21.810096 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4ce0b0fb-9327-4ab4-9086-3ec4c3ddba90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5578e07017845f6914b396f20524a79'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:21.933337 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 921/1851] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:21 2022] DELETE /identity/v3/users/b5578e07017845f6914b396f20524a79 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:22.219539 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7cc38-c8af-4d71-8b06-406909968289 service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:22.222598 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-36e7cc38-c8af-4d71-8b06-406909968289 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:22.231086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0b0fb-9327-4ab4-9086-3ec4c3ddba90 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:22.233964 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4ce0b0fb-9327-4ab4-9086-3ec4c3ddba90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:22.360841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7cc38-c8af-4d71-8b06-406909968289 service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:22.362920 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0b0fb-9327-4ab4-9086-3ec4c3ddba90 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:22.372088 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475c889-7db5-4ef8-83e0-fa0cdee4b8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:22.373469 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c889-7db5-4ef8-83e0-fa0cdee4b8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:22.374618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c889-7db5-4ef8-83e0-fa0cdee4b8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:22.374912 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c889-7db5-4ef8-83e0-fa0cdee4b8e7 admin admin] PATH_INFO: `/v3/users/5c3da99dd2b2428b92d323332bd412de` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:22.376776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475c889-7db5-4ef8-83e0-fa0cdee4b8e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3da99dd2b2428b92d323332bd412de)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:22.378994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475c889-7db5-4ef8-83e0-fa0cdee4b8e7 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:22.431860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306124c-8045-4fb8-b27b-e849b4852678 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf304b594eec4e49971eee0db3b6c774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '780704ca51ac4b17b7c448c7338f8ddd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:22.432479 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306124c-8045-4fb8-b27b-e849b4852678 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:22.432772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306124c-8045-4fb8-b27b-e849b4852678 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:22.433107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306124c-8045-4fb8-b27b-e849b4852678 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:22.433918 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306124c-8045-4fb8-b27b-e849b4852678 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:51:22.434403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306124c-8045-4fb8-b27b-e849b4852678 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:22.436745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306124c-8045-4fb8-b27b-e849b4852678 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:22.453634 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 931/1852] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:51:22.458008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306124c-8045-4fb8-b27b-e849b4852678 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:22.460476 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8306124c-8045-4fb8-b27b-e849b4852678 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:22.485153 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306124c-8045-4fb8-b27b-e849b4852678 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:22.487016 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adcb6c-5513-407a-900e-327213bcb647 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf304b594eec4e49971eee0db3b6c774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '780704ca51ac4b17b7c448c7338f8ddd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:22.487992 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adcb6c-5513-407a-900e-327213bcb647 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:22.488200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adcb6c-5513-407a-900e-327213bcb647 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:22.488477 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adcb6c-5513-407a-900e-327213bcb647 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:22.489132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adcb6c-5513-407a-900e-327213bcb647 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:22.491149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adcb6c-5513-407a-900e-327213bcb647 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:22.637834 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f475c889-7db5-4ef8-83e0-fa0cdee4b8e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3da99dd2b2428b92d323332bd412de'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:22.639274 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f475c889-7db5-4ef8-83e0-fa0cdee4b8e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3da99dd2b2428b92d323332bd412de'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:22.647570 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f475c889-7db5-4ef8-83e0-fa0cdee4b8e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3da99dd2b2428b92d323332bd412de'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:22.666122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f475c889-7db5-4ef8-83e0-fa0cdee4b8e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3da99dd2b2428b92d323332bd412de'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:22.667856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f475c889-7db5-4ef8-83e0-fa0cdee4b8e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3da99dd2b2428b92d323332bd412de'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:22.701406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 932/1853] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:22 2022] POST /identity/v3/projects => generated 354 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:22.701406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adcb6c-5513-407a-900e-327213bcb647 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:22.701406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-88adcb6c-5513-407a-900e-327213bcb647 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:22.783347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 922/1854] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:22 2022] DELETE /identity/v3/users/5c3da99dd2b2428b92d323332bd412de => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:22.787325 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb896a-f154-4fde-8c53-7c2a0d260745 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:22.787703 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb896a-f154-4fde-8c53-7c2a0d260745 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:22.787974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb896a-f154-4fde-8c53-7c2a0d260745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:22.806461 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adcb6c-5513-407a-900e-327213bcb647 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:22.831645 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-29fb896a-f154-4fde-8c53-7c2a0d260745 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:22.832918 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-29fb896a-f154-4fde-8c53-7c2a0d260745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:22.931456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:22.964059 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f873c8-97a0-4d56-8c6f-0574c757da77 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf304b594eec4e49971eee0db3b6c774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '780704ca51ac4b17b7c448c7338f8ddd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:22.965803 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f873c8-97a0-4d56-8c6f-0574c757da77 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:22.966235 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f873c8-97a0-4d56-8c6f-0574c757da77 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:22.967644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f873c8-97a0-4d56-8c6f-0574c757da77 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:22.968705 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f873c8-97a0-4d56-8c6f-0574c757da77 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:51:22.969167 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f873c8-97a0-4d56-8c6f-0574c757da77 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:22.970930 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f873c8-97a0-4d56-8c6f-0574c757da77 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:23.009018 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 933/1855] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:51:23.010293 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f873c8-97a0-4d56-8c6f-0574c757da77 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:23.012104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-30f873c8-97a0-4d56-8c6f-0574c757da77 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:23.021837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 923/1856] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:23.041282 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb896a-f154-4fde-8c53-7c2a0d260745 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:23.043427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-29fb896a-f154-4fde-8c53-7c2a0d260745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:23.062117 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f873c8-97a0-4d56-8c6f-0574c757da77 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:23.073769 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa420dc-1edd-4818-841b-c07e1cecf77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:23.074500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa420dc-1edd-4818-841b-c07e1cecf77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:23.074787 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa420dc-1edd-4818-841b-c07e1cecf77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:23.075068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa420dc-1edd-4818-841b-c07e1cecf77c admin admin] PATH_INFO: `/v3/projects/b4ea67e4f36941c3adfc1ce993fe76bf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:23.081932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa420dc-1edd-4818-841b-c07e1cecf77c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ea67e4f36941c3adfc1ce993fe76bf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:23.084079 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa420dc-1edd-4818-841b-c07e1cecf77c admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:23.143800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb896a-f154-4fde-8c53-7c2a0d260745 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:23.148810 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea54d7-442f-4bfe-b179-3594e9417ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:23.149543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea54d7-442f-4bfe-b179-3594e9417ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:23.149944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea54d7-442f-4bfe-b179-3594e9417ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:23.150234 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea54d7-442f-4bfe-b179-3594e9417ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:23.167692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea54d7-442f-4bfe-b179-3594e9417ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:23.171008 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea54d7-442f-4bfe-b179-3594e9417ec0 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:23.186609 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 924/1857] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:51:23.188330 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea54d7-442f-4bfe-b179-3594e9417ec0 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:23.208111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea54d7-442f-4bfe-b179-3594e9417ec0 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:23.216044 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c301a-836a-4476-86f2-c55839f640d7 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf304b594eec4e49971eee0db3b6c774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '780704ca51ac4b17b7c448c7338f8ddd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:23.217631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c301a-836a-4476-86f2-c55839f640d7 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:23.218132 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c301a-836a-4476-86f2-c55839f640d7 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:23.218618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c301a-836a-4476-86f2-c55839f640d7 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] PATH_INFO: `/v3/projects/3c9041f818064d24a1b5a3cdd64c56b6` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:23.220743 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c301a-836a-4476-86f2-c55839f640d7 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3c9041f818064d24a1b5a3cdd64c56b6)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:23.224306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c301a-836a-4476-86f2-c55839f640d7 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:23.267448 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-2fa420dc-1edd-4818-841b-c07e1cecf77c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ea67e4f36941c3adfc1ce993fe76bf', 'request_id': 'req-2fa420dc-1edd-4818-841b-c07e1cecf77c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:23.277762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-2fa420dc-1edd-4818-841b-c07e1cecf77c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ea67e4f36941c3adfc1ce993fe76bf', 'request_id': 'req-2fa420dc-1edd-4818-841b-c07e1cecf77c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:23.402391 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-2fa420dc-1edd-4818-841b-c07e1cecf77c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ea67e4f36941c3adfc1ce993fe76bf', 'request_id': 'req-2fa420dc-1edd-4818-841b-c07e1cecf77c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:23.415530 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-2fa420dc-1edd-4818-841b-c07e1cecf77c admin admin] The token cache is being invalidate because project b4ea67e4f36941c3adfc1ce993fe76bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:23.416069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-2fa420dc-1edd-4818-841b-c07e1cecf77c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:23.418882 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-2fa420dc-1edd-4818-841b-c07e1cecf77c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:23.421104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 934/1858] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:23 2022] DELETE /identity/v3/projects/b4ea67e4f36941c3adfc1ce993fe76bf => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:23.426103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa86d5-48b9-4150-8ebf-3993762d5ea1 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:23.426611 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa86d5-48b9-4150-8ebf-3993762d5ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:23.427030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa86d5-48b9-4150-8ebf-3993762d5ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:23.463276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d67c301a-836a-4476-86f2-c55839f640d7 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c9041f818064d24a1b5a3cdd64c56b6', 'request_id': 'req-d67c301a-836a-4476-86f2-c55839f640d7'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:23.476516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-4ffa86d5-48b9-4150-8ebf-3993762d5ea1 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:23.478009 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-4ffa86d5-48b9-4150-8ebf-3993762d5ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:23.560273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d67c301a-836a-4476-86f2-c55839f640d7 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c9041f818064d24a1b5a3cdd64c56b6', 'request_id': 'req-d67c301a-836a-4476-86f2-c55839f640d7'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:23.573660 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 935/1859] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:23.581514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19260f53-071f-407c-969d-63287d7b3f46 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:23.581796 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19260f53-071f-407c-969d-63287d7b3f46 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:23.582098 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19260f53-071f-407c-969d-63287d7b3f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:23.595791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d67c301a-836a-4476-86f2-c55839f640d7 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c9041f818064d24a1b5a3cdd64c56b6', 'request_id': 'req-d67c301a-836a-4476-86f2-c55839f640d7'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:23.614510 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d67c301a-836a-4476-86f2-c55839f640d7 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] The token cache is being invalidate because project 3c9041f818064d24a1b5a3cdd64c56b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:23.615105 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d67c301a-836a-4476-86f2-c55839f640d7 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:23.616403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d67c301a-836a-4476-86f2-c55839f640d7 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:23.619768 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 925/1860] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:23 2022] DELETE /identity/v3/projects/3c9041f818064d24a1b5a3cdd64c56b6 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:23.636607 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-19260f53-071f-407c-969d-63287d7b3f46 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:23.638203 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-19260f53-071f-407c-969d-63287d7b3f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:23.649876 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 936/1861] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:23.659811 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c301a-836a-4476-86f2-c55839f640d7 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:23.689456 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c301a-836a-4476-86f2-c55839f640d7 tempest-VolumeQuotaClassesTest-509949676 tempest-VolumeQuotaClassesTest-509949676-project-admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:23.689456 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16a22f-9fa5-4886-b4a9-e0a0d0ced481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:23.689456 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16a22f-9fa5-4886-b4a9-e0a0d0ced481 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:23.689718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16a22f-9fa5-4886-b4a9-e0a0d0ced481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:23.689718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16a22f-9fa5-4886-b4a9-e0a0d0ced481 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:23.689718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16a22f-9fa5-4886-b4a9-e0a0d0ced481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:51:23.689718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16a22f-9fa5-4886-b4a9-e0a0d0ced481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:23.690013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16a22f-9fa5-4886-b4a9-e0a0d0ced481 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:23.718633 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 926/1862] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:51:23.723125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19260f53-071f-407c-969d-63287d7b3f46 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:23.737748 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19260f53-071f-407c-969d-63287d7b3f46 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:23.750504 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9ff33-ac9e-4f1a-864e-aa2be2575218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:23.751647 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9ff33-ac9e-4f1a-864e-aa2be2575218 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:23.752071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9ff33-ac9e-4f1a-864e-aa2be2575218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:23.752483 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9ff33-ac9e-4f1a-864e-aa2be2575218 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:23.754056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9ff33-ac9e-4f1a-864e-aa2be2575218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:23.757085 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9ff33-ac9e-4f1a-864e-aa2be2575218 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:23.782740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16a22f-9fa5-4886-b4a9-e0a0d0ced481 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:23.783817 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2d16a22f-9fa5-4886-b4a9-e0a0d0ced481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:23.803039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16a22f-9fa5-4886-b4a9-e0a0d0ced481 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:23.810180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a48e1-9d29-4cbc-afc4-508064ab29fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:23.811565 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a48e1-9d29-4cbc-afc4-508064ab29fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:23.812134 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a48e1-9d29-4cbc-afc4-508064ab29fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:23.812631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a48e1-9d29-4cbc-afc4-508064ab29fc admin admin] PATH_INFO: `/v3/projects/85cc90af73344d1aa2a916a27b3850b5` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:23.814081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a48e1-9d29-4cbc-afc4-508064ab29fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=85cc90af73344d1aa2a916a27b3850b5)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:23.816346 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a48e1-9d29-4cbc-afc4-508064ab29fc admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:23.964093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 937/1863] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:23 2022] POST /identity/v3/projects => generated 373 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:23.968753 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9ff33-ac9e-4f1a-864e-aa2be2575218 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:23.977816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d44a48e1-9d29-4cbc-afc4-508064ab29fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85cc90af73344d1aa2a916a27b3850b5', 'request_id': 'req-d44a48e1-9d29-4cbc-afc4-508064ab29fc'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:24.035848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9ff33-ac9e-4f1a-864e-aa2be2575218 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:24.040930 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943582b-0150-485d-a4f7-4f65b709d3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:24.041595 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943582b-0150-485d-a4f7-4f65b709d3ee admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:24.041858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943582b-0150-485d-a4f7-4f65b709d3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:24.042132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943582b-0150-485d-a4f7-4f65b709d3ee admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:24.042768 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943582b-0150-485d-a4f7-4f65b709d3ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:24.045985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943582b-0150-485d-a4f7-4f65b709d3ee admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:24.117988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d44a48e1-9d29-4cbc-afc4-508064ab29fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85cc90af73344d1aa2a916a27b3850b5', 'request_id': 'req-d44a48e1-9d29-4cbc-afc4-508064ab29fc'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:24.126854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d44a48e1-9d29-4cbc-afc4-508064ab29fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85cc90af73344d1aa2a916a27b3850b5', 'request_id': 'req-d44a48e1-9d29-4cbc-afc4-508064ab29fc'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:24.143633 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d44a48e1-9d29-4cbc-afc4-508064ab29fc admin admin] The token cache is being invalidate because project 85cc90af73344d1aa2a916a27b3850b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:24.144227 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d44a48e1-9d29-4cbc-afc4-508064ab29fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:24.145797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d44a48e1-9d29-4cbc-afc4-508064ab29fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:24.147957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 927/1864] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:23 2022] DELETE /identity/v3/projects/85cc90af73344d1aa2a916a27b3850b5 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:24.152223 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a48e1-9d29-4cbc-afc4-508064ab29fc admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:24.153669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d44a48e1-9d29-4cbc-afc4-508064ab29fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:24.298879 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a48e1-9d29-4cbc-afc4-508064ab29fc admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:24.304187 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7aa870-5051-402c-a6cc-7cd3d1b20eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:24.304982 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aa870-5051-402c-a6cc-7cd3d1b20eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:24.305477 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aa870-5051-402c-a6cc-7cd3d1b20eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:24.306918 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aa870-5051-402c-a6cc-7cd3d1b20eca admin admin] PATH_INFO: `/v3/users/84d5dd4269ac46b5a72cb7f502d931e9` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:24.308488 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7aa870-5051-402c-a6cc-7cd3d1b20eca admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d5dd4269ac46b5a72cb7f502d931e9)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:24.310821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7aa870-5051-402c-a6cc-7cd3d1b20eca admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:24.346251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 938/1865] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:23 2022] POST /identity/v3/users => generated 287 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:51:24.360712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943582b-0150-485d-a4f7-4f65b709d3ee admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:24.365297 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-0943582b-0150-485d-a4f7-4f65b709d3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:24.382620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943582b-0150-485d-a4f7-4f65b709d3ee admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:24.389430 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e71c0-0bf3-44f4-ba03-c885559b5d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:24.390204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e71c0-0bf3-44f4-ba03-c885559b5d23 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:24.390319 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e71c0-0bf3-44f4-ba03-c885559b5d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:24.390594 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e71c0-0bf3-44f4-ba03-c885559b5d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:24.391254 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e71c0-0bf3-44f4-ba03-c885559b5d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:24.393537 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e71c0-0bf3-44f4-ba03-c885559b5d23 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:24.409580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 939/1866] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:24.414392 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e71c0-0bf3-44f4-ba03-c885559b5d23 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:24.427650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e71c0-0bf3-44f4-ba03-c885559b5d23 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:24.436571 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6a56c-6bdd-47af-b9c6-479b38a01b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:24.437209 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6a56c-6bdd-47af-b9c6-479b38a01b92 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:24.437484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6a56c-6bdd-47af-b9c6-479b38a01b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:24.437754 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6a56c-6bdd-47af-b9c6-479b38a01b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:24.438459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6a56c-6bdd-47af-b9c6-479b38a01b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:24.440235 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6a56c-6bdd-47af-b9c6-479b38a01b92 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:24.590559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 940/1867] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:24.590559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6a56c-6bdd-47af-b9c6-479b38a01b92 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:24.590559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6a56c-6bdd-47af-b9c6-479b38a01b92 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:24.590559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9150ad2-e13e-43f3-abf4-de7e5954b16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:24.592777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9150ad2-e13e-43f3-abf4-de7e5954b16a admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:24.592777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9150ad2-e13e-43f3-abf4-de7e5954b16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:24.592777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9150ad2-e13e-43f3-abf4-de7e5954b16a admin admin] PATH_INFO: `/v3/projects/3f3bf609ee944c058a4f15a7087108e7/users/87b96c193609456c9bc596c6048e5f8d/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:24.592777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9150ad2-e13e-43f3-abf4-de7e5954b16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3bf609ee944c058a4f15a7087108e7, user_id=87b96c193609456c9bc596c6048e5f8d, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:24.592777 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9150ad2-e13e-43f3-abf4-de7e5954b16a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:24.734449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2c7aa870-5051-402c-a6cc-7cd3d1b20eca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d5dd4269ac46b5a72cb7f502d931e9'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:24.735615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2c7aa870-5051-402c-a6cc-7cd3d1b20eca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d5dd4269ac46b5a72cb7f502d931e9'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:24.752116 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2c7aa870-5051-402c-a6cc-7cd3d1b20eca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d5dd4269ac46b5a72cb7f502d931e9'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:24.780819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2c7aa870-5051-402c-a6cc-7cd3d1b20eca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d5dd4269ac46b5a72cb7f502d931e9'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:24.781612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2c7aa870-5051-402c-a6cc-7cd3d1b20eca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d5dd4269ac46b5a72cb7f502d931e9'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:24.815916 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 941/1868] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:24 2022] PUT /identity/v3/projects/3f3bf609ee944c058a4f15a7087108e7/users/87b96c193609456c9bc596c6048e5f8d/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:24.818532 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279d1a5-ab4e-488f-bdf4-ab85595707a3 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:24.819007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279d1a5-ab4e-488f-bdf4-ab85595707a3 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:24.819513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279d1a5-ab4e-488f-bdf4-ab85595707a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:24.879535 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8279d1a5-ab4e-488f-bdf4-ab85595707a3 None None] MFA Rules not processed for user `87b96c193609456c9bc596c6048e5f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:24.879535 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8279d1a5-ab4e-488f-bdf4-ab85595707a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:24.909815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 928/1869] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:24 2022] DELETE /identity/v3/users/84d5dd4269ac46b5a72cb7f502d931e9 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:24.979444 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7aa870-5051-402c-a6cc-7cd3d1b20eca admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:24.983269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2c7aa870-5051-402c-a6cc-7cd3d1b20eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:25.000918 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 942/1870] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:25.009921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279d1a5-ab4e-488f-bdf4-ab85595707a3 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:25.019669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8279d1a5-ab4e-488f-bdf4-ab85595707a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:25.088974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7aa870-5051-402c-a6cc-7cd3d1b20eca admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:25.097114 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60855d-69f6-43f3-bf09-a2ba027bd393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:25.097879 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60855d-69f6-43f3-bf09-a2ba027bd393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:25.098161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60855d-69f6-43f3-bf09-a2ba027bd393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:25.098438 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60855d-69f6-43f3-bf09-a2ba027bd393 admin admin] PATH_INFO: `/v3/users/cc0493c686ac4556a3c5be603e869a99` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:25.099889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60855d-69f6-43f3-bf09-a2ba027bd393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc0493c686ac4556a3c5be603e869a99)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:25.126219 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60855d-69f6-43f3-bf09-a2ba027bd393 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:25.138479 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279d1a5-ab4e-488f-bdf4-ab85595707a3 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:25.144627 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be11432-ee4e-4194-948d-28f2c89d92d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:25.145376 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be11432-ee4e-4194-948d-28f2c89d92d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:25.145695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be11432-ee4e-4194-948d-28f2c89d92d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:25.146035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be11432-ee4e-4194-948d-28f2c89d92d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:25.146795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be11432-ee4e-4194-948d-28f2c89d92d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:25.149588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be11432-ee4e-4194-948d-28f2c89d92d8 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:25.247194 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 943/1871] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:25 2022] POST /identity/v3/projects => generated 373 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:25.249179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be11432-ee4e-4194-948d-28f2c89d92d8 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:25.261608 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:25.351161 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be11432-ee4e-4194-948d-28f2c89d92d8 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:25.370275 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f294adb-834f-48bb-b054-17e544d44627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:25.373429 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f294adb-834f-48bb-b054-17e544d44627 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:25.374131 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f294adb-834f-48bb-b054-17e544d44627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:25.374613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f294adb-834f-48bb-b054-17e544d44627 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:25.375962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f294adb-834f-48bb-b054-17e544d44627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:25.378753 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f294adb-834f-48bb-b054-17e544d44627 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:25.410200 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2b60855d-69f6-43f3-bf09-a2ba027bd393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc0493c686ac4556a3c5be603e869a99'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:25.411327 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2b60855d-69f6-43f3-bf09-a2ba027bd393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc0493c686ac4556a3c5be603e869a99'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:25.420661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2b60855d-69f6-43f3-bf09-a2ba027bd393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc0493c686ac4556a3c5be603e869a99'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:25.440690 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2b60855d-69f6-43f3-bf09-a2ba027bd393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc0493c686ac4556a3c5be603e869a99'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:25.459676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2b60855d-69f6-43f3-bf09-a2ba027bd393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc0493c686ac4556a3c5be603e869a99'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:25.662978 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 944/1872] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:25 2022] POST /identity/v3/users => generated 293 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:25.667950 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f294adb-834f-48bb-b054-17e544d44627 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:25.671441 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-4f294adb-834f-48bb-b054-17e544d44627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:25.691224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 929/1873] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:24 2022] DELETE /identity/v3/users/cc0493c686ac4556a3c5be603e869a99 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:25.697622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6472d-f30f-4cdb-ab88-141cb5742168 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:25.700122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6472d-f30f-4cdb-ab88-141cb5742168 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:25.711816 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6472d-f30f-4cdb-ab88-141cb5742168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:25.715876 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f294adb-834f-48bb-b054-17e544d44627 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:25.744525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-abb6472d-f30f-4cdb-ab88-141cb5742168 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:25.747127 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-abb6472d-f30f-4cdb-ab88-141cb5742168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:25.894041 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 930/1874] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:25.921082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6472d-f30f-4cdb-ab88-141cb5742168 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:25.925336 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-abb6472d-f30f-4cdb-ab88-141cb5742168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:25.957396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918396fa-7b9a-4659-a4b7-9b7e2560b290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:25.957396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918396fa-7b9a-4659-a4b7-9b7e2560b290 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:25.957396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918396fa-7b9a-4659-a4b7-9b7e2560b290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:25.957396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918396fa-7b9a-4659-a4b7-9b7e2560b290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:25.957697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918396fa-7b9a-4659-a4b7-9b7e2560b290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:25.963125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918396fa-7b9a-4659-a4b7-9b7e2560b290 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:25.986609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 945/1875] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:25.988337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918396fa-7b9a-4659-a4b7-9b7e2560b290 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:26.009609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918396fa-7b9a-4659-a4b7-9b7e2560b290 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:26.019061 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc610f-f756-401d-a272-9d32dee91e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:26.020161 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc610f-f756-401d-a272-9d32dee91e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:26.020330 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc610f-f756-401d-a272-9d32dee91e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:26.020679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc610f-f756-401d-a272-9d32dee91e74 admin admin] PATH_INFO: `/v3/projects/82dcb44ad41f42bbb27bd53eca2aff2c/users/eabe15a2359c4ba5bd36d975afec75f7/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:26.053440 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc610f-f756-401d-a272-9d32dee91e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82dcb44ad41f42bbb27bd53eca2aff2c, user_id=eabe15a2359c4ba5bd36d975afec75f7, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:26.059718 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc610f-f756-401d-a272-9d32dee91e74 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:26.077286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6472d-f30f-4cdb-ab88-141cb5742168 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:26.086907 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a87ac7-b88e-4f2b-9f83-2b3dbd766616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:26.088155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a87ac7-b88e-4f2b-9f83-2b3dbd766616 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:26.088701 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a87ac7-b88e-4f2b-9f83-2b3dbd766616 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:26.089191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a87ac7-b88e-4f2b-9f83-2b3dbd766616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:26.104535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a87ac7-b88e-4f2b-9f83-2b3dbd766616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:26.106690 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a87ac7-b88e-4f2b-9f83-2b3dbd766616 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:26.150512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 931/1876] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:26.153039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a87ac7-b88e-4f2b-9f83-2b3dbd766616 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:26.155283 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 946/1877] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:25 2022] PUT /identity/v3/projects/82dcb44ad41f42bbb27bd53eca2aff2c/users/eabe15a2359c4ba5bd36d975afec75f7/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:26.160703 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc610f-f756-401d-a272-9d32dee91e74 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:26.164651 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b3a87ac7-b88e-4f2b-9f83-2b3dbd766616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:26.196553 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a87ac7-b88e-4f2b-9f83-2b3dbd766616 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:26.345572 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ad645-a626-4689-bcd3-795c9ff224bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:26.346571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ad645-a626-4689-bcd3-795c9ff224bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:26.346972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ad645-a626-4689-bcd3-795c9ff224bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:26.347944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ad645-a626-4689-bcd3-795c9ff224bd admin admin] PATH_INFO: `/v3/projects/1803c97333e742928baaeafd54b9f48e` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:26.349789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ad645-a626-4689-bcd3-795c9ff224bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1803c97333e742928baaeafd54b9f48e)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:26.351906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ad645-a626-4689-bcd3-795c9ff224bd admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:26.403738 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc610f-f756-401d-a272-9d32dee91e74 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:26.403738 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a28b5-f422-4e0a-bf58-ede850dbf58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:26.403738 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a28b5-f422-4e0a-bf58-ede850dbf58c admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:26.403738 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a28b5-f422-4e0a-bf58-ede850dbf58c admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:26.404747 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a28b5-f422-4e0a-bf58-ede850dbf58c admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:26.405126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a28b5-f422-4e0a-bf58-ede850dbf58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:26.408019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a28b5-f422-4e0a-bf58-ede850dbf58c admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:26.420000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 947/1878] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:26.425473 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a28b5-f422-4e0a-bf58-ede850dbf58c admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:26.442206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a28b5-f422-4e0a-bf58-ede850dbf58c admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:26.444979 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e5241-1566-415b-9e5f-18839a4a5ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:26.445656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e5241-1566-415b-9e5f-18839a4a5ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:26.446122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e5241-1566-415b-9e5f-18839a4a5ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:26.446406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e5241-1566-415b-9e5f-18839a4a5ad6 admin admin] PATH_INFO: `/v3/projects/82dcb44ad41f42bbb27bd53eca2aff2c/users/eabe15a2359c4ba5bd36d975afec75f7/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:26.448552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e5241-1566-415b-9e5f-18839a4a5ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82dcb44ad41f42bbb27bd53eca2aff2c, user_id=eabe15a2359c4ba5bd36d975afec75f7, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:26.451279 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e5241-1566-415b-9e5f-18839a4a5ad6 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:26.463080 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 948/1879] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:26 2022] PUT /identity/v3/projects/82dcb44ad41f42bbb27bd53eca2aff2c/users/eabe15a2359c4ba5bd36d975afec75f7/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:26.481252 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2abf8c-bd75-4c22-b9f9-61e68820ff21 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:26.481664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2abf8c-bd75-4c22-b9f9-61e68820ff21 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:26.482903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2abf8c-bd75-4c22-b9f9-61e68820ff21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:26.525004 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8a3ad645-a626-4689-bcd3-795c9ff224bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1803c97333e742928baaeafd54b9f48e', 'request_id': 'req-8a3ad645-a626-4689-bcd3-795c9ff224bd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:26.526082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-3e2abf8c-bd75-4c22-b9f9-61e68820ff21 None None] MFA Rules not processed for user `eabe15a2359c4ba5bd36d975afec75f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:26.528486 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3e2abf8c-bd75-4c22-b9f9-61e68820ff21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:26.623437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 949/1880] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:26.635333 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2abf8c-bd75-4c22-b9f9-61e68820ff21 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:26.636889 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3e2abf8c-bd75-4c22-b9f9-61e68820ff21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:26.647205 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8a3ad645-a626-4689-bcd3-795c9ff224bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1803c97333e742928baaeafd54b9f48e', 'request_id': 'req-8a3ad645-a626-4689-bcd3-795c9ff224bd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:26.661311 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8a3ad645-a626-4689-bcd3-795c9ff224bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1803c97333e742928baaeafd54b9f48e', 'request_id': 'req-8a3ad645-a626-4689-bcd3-795c9ff224bd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:26.675020 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8a3ad645-a626-4689-bcd3-795c9ff224bd admin admin] The token cache is being invalidate because project 1803c97333e742928baaeafd54b9f48e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:26.675224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8a3ad645-a626-4689-bcd3-795c9ff224bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:26.675959 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8a3ad645-a626-4689-bcd3-795c9ff224bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:26.677789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 932/1881] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:26 2022] DELETE /identity/v3/projects/1803c97333e742928baaeafd54b9f48e => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:26.683409 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc5d17-1fa9-4ba3-8714-51ad3055d4df None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:26.683669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc5d17-1fa9-4ba3-8714-51ad3055d4df None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:26.683992 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc5d17-1fa9-4ba3-8714-51ad3055d4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:26.706160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2abf8c-bd75-4c22-b9f9-61e68820ff21 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:26.706827 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-effc5d17-1fa9-4ba3-8714-51ad3055d4df None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:26.708326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-effc5d17-1fa9-4ba3-8714-51ad3055d4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:26.713334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4936d-4e72-4ffa-af89-8d6778c62c92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:26.713334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4936d-4e72-4ffa-af89-8d6778c62c92 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:26.713334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4936d-4e72-4ffa-af89-8d6778c62c92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:26.713334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4936d-4e72-4ffa-af89-8d6778c62c92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:26.713971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-72b4936d-4e72-4ffa-af89-8d6778c62c92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:26.728445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4936d-4e72-4ffa-af89-8d6778c62c92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:26.730355 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4936d-4e72-4ffa-af89-8d6778c62c92 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:26.743921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 950/1882] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:51:26.800062 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 933/1883] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:26.809059 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb63b45-b6b3-4434-9be1-953646221a1e None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:26.809464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb63b45-b6b3-4434-9be1-953646221a1e None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:26.809620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb63b45-b6b3-4434-9be1-953646221a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:26.840589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-9eb63b45-b6b3-4434-9be1-953646221a1e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:26.842039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9eb63b45-b6b3-4434-9be1-953646221a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:26.849566 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:26.861290 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 951/1884] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:26.867823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc5d17-1fa9-4ba3-8714-51ad3055d4df None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:26.881263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc5d17-1fa9-4ba3-8714-51ad3055d4df None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:26.888425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6481a7-c413-4e0b-abd9-bea94f4078bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:26.897326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6481a7-c413-4e0b-abd9-bea94f4078bd admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:26.897326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6481a7-c413-4e0b-abd9-bea94f4078bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:26.897326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6481a7-c413-4e0b-abd9-bea94f4078bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:26.897326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6481a7-c413-4e0b-abd9-bea94f4078bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:51:26.897326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6481a7-c413-4e0b-abd9-bea94f4078bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:26.898377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6481a7-c413-4e0b-abd9-bea94f4078bd admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:26.928255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 934/1885] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:51:26.932041 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb63b45-b6b3-4434-9be1-953646221a1e None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:26.953444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb63b45-b6b3-4434-9be1-953646221a1e None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:26.960707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191c359-2f76-46d9-ad70-d23ad2da7346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:26.962869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191c359-2f76-46d9-ad70-d23ad2da7346 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:26.962869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191c359-2f76-46d9-ad70-d23ad2da7346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:26.963548 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191c359-2f76-46d9-ad70-d23ad2da7346 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:26.964388 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191c359-2f76-46d9-ad70-d23ad2da7346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:26.970914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191c359-2f76-46d9-ad70-d23ad2da7346 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:27.115514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 952/1886] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:26 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:27.126033 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6481a7-c413-4e0b-abd9-bea94f4078bd admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:27.139858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191c359-2f76-46d9-ad70-d23ad2da7346 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:27.144781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a191c359-2f76-46d9-ad70-d23ad2da7346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:27.148122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6481a7-c413-4e0b-abd9-bea94f4078bd admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:27.347131 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c59bf5-9cdd-4473-9ee3-7f077bb7d137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:27.347802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c59bf5-9cdd-4473-9ee3-7f077bb7d137 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:27.348139 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c59bf5-9cdd-4473-9ee3-7f077bb7d137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:27.348417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c59bf5-9cdd-4473-9ee3-7f077bb7d137 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:27.349085 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c59bf5-9cdd-4473-9ee3-7f077bb7d137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:27.351129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c59bf5-9cdd-4473-9ee3-7f077bb7d137 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:27.381769 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191c359-2f76-46d9-ad70-d23ad2da7346 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:27.387898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca7758-c297-4e7c-819f-57b39c81e01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:27.389922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca7758-c297-4e7c-819f-57b39c81e01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:27.389922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca7758-c297-4e7c-819f-57b39c81e01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:27.389922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca7758-c297-4e7c-819f-57b39c81e01a admin admin] PATH_INFO: `/v3/projects/2ae0c8aa3b244cb883a5626fbac6d6ca` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:27.391451 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca7758-c297-4e7c-819f-57b39c81e01a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae0c8aa3b244cb883a5626fbac6d6ca)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:27.394653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca7758-c297-4e7c-819f-57b39c81e01a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:27.481384 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 935/1887] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:27 2022] POST /identity/v3/users => generated 289 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:27.488604 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c59bf5-9cdd-4473-9ee3-7f077bb7d137 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:27.540166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c59bf5-9cdd-4473-9ee3-7f077bb7d137 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:27.549212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b2ca7758-c297-4e7c-819f-57b39c81e01a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae0c8aa3b244cb883a5626fbac6d6ca', 'request_id': 'req-b2ca7758-c297-4e7c-819f-57b39c81e01a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:27.559041 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b2ca7758-c297-4e7c-819f-57b39c81e01a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae0c8aa3b244cb883a5626fbac6d6ca', 'request_id': 'req-b2ca7758-c297-4e7c-819f-57b39c81e01a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:27.661978 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b2ca7758-c297-4e7c-819f-57b39c81e01a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae0c8aa3b244cb883a5626fbac6d6ca', 'request_id': 'req-b2ca7758-c297-4e7c-819f-57b39c81e01a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:27.677942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ea515-8827-43b8-b2fc-9a8892654beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:27.679224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ea515-8827-43b8-b2fc-9a8892654beb admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:27.679611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ea515-8827-43b8-b2fc-9a8892654beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:27.680138 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ea515-8827-43b8-b2fc-9a8892654beb admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:27.681613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ea515-8827-43b8-b2fc-9a8892654beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:27.684554 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ea515-8827-43b8-b2fc-9a8892654beb admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:27.690961 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b2ca7758-c297-4e7c-819f-57b39c81e01a admin admin] The token cache is being invalidate because project 2ae0c8aa3b244cb883a5626fbac6d6ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:27.697226 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b2ca7758-c297-4e7c-819f-57b39c81e01a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:27.697226 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b2ca7758-c297-4e7c-819f-57b39c81e01a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:27.697226 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 953/1888] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:27 2022] DELETE /identity/v3/projects/2ae0c8aa3b244cb883a5626fbac6d6ca => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:27.702309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca7758-c297-4e7c-819f-57b39c81e01a admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:27.710185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b2ca7758-c297-4e7c-819f-57b39c81e01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:27.718093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 936/1889] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:27.730589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ea515-8827-43b8-b2fc-9a8892654beb admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:27.736037 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b07ea515-8827-43b8-b2fc-9a8892654beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:27.744716 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca7758-c297-4e7c-819f-57b39c81e01a admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:27.754438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c38283-aa44-43d8-9fde-7ff6623a871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:27.760993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c38283-aa44-43d8-9fde-7ff6623a871b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:27.760993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c38283-aa44-43d8-9fde-7ff6623a871b admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:27.760993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c38283-aa44-43d8-9fde-7ff6623a871b admin admin] PATH_INFO: `/v3/users/cf304b594eec4e49971eee0db3b6c774` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:27.760993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c38283-aa44-43d8-9fde-7ff6623a871b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf304b594eec4e49971eee0db3b6c774)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:27.760993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c38283-aa44-43d8-9fde-7ff6623a871b admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:27.777320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ea515-8827-43b8-b2fc-9a8892654beb admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:27.790663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553e4b-7af8-4138-a042-152f2cd3de19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:27.791815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553e4b-7af8-4138-a042-152f2cd3de19 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:27.792432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553e4b-7af8-4138-a042-152f2cd3de19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:27.793304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553e4b-7af8-4138-a042-152f2cd3de19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:27.796215 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64553e4b-7af8-4138-a042-152f2cd3de19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:27.799573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64553e4b-7af8-4138-a042-152f2cd3de19 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:27.838210 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 937/1890] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:27.840464 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553e4b-7af8-4138-a042-152f2cd3de19 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:27.859750 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553e4b-7af8-4138-a042-152f2cd3de19 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:27.868959 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89ea17-6a36-486a-91cb-246f3be7c854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:27.870021 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89ea17-6a36-486a-91cb-246f3be7c854 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:27.870423 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89ea17-6a36-486a-91cb-246f3be7c854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:27.870717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89ea17-6a36-486a-91cb-246f3be7c854 admin admin] PATH_INFO: `/v3/projects/587ac1111b724b17946ed1d333b12019/users/511b31a29c9e4e588484e3e3bf9c0afc/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:27.924292 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89ea17-6a36-486a-91cb-246f3be7c854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=587ac1111b724b17946ed1d333b12019, user_id=511b31a29c9e4e588484e3e3bf9c0afc, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:27.933117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89ea17-6a36-486a-91cb-246f3be7c854 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:28.056809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 938/1891] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:27 2022] PUT /identity/v3/projects/587ac1111b724b17946ed1d333b12019/users/511b31a29c9e4e588484e3e3bf9c0afc/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:28.068511 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d2c38283-aa44-43d8-9fde-7ff6623a871b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf304b594eec4e49971eee0db3b6c774'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:28.069388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fd7a3-dc4e-41d0-9d6c-679f8e09eff4 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:28.069738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fd7a3-dc4e-41d0-9d6c-679f8e09eff4 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:28.070078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fd7a3-dc4e-41d0-9d6c-679f8e09eff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:28.109586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-cd6fd7a3-dc4e-41d0-9d6c-679f8e09eff4 None None] MFA Rules not processed for user `511b31a29c9e4e588484e3e3bf9c0afc`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:28.111267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-cd6fd7a3-dc4e-41d0-9d6c-679f8e09eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:28.195802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 939/1892] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:28.196881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fd7a3-dc4e-41d0-9d6c-679f8e09eff4 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:28.198232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-cd6fd7a3-dc4e-41d0-9d6c-679f8e09eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:28.210030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d2c38283-aa44-43d8-9fde-7ff6623a871b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf304b594eec4e49971eee0db3b6c774'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:28.211091 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d2c38283-aa44-43d8-9fde-7ff6623a871b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf304b594eec4e49971eee0db3b6c774'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:28.212149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d2c38283-aa44-43d8-9fde-7ff6623a871b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf304b594eec4e49971eee0db3b6c774'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:28.226106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d2c38283-aa44-43d8-9fde-7ff6623a871b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf304b594eec4e49971eee0db3b6c774'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:28.274872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 954/1893] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:27 2022] DELETE /identity/v3/users/cf304b594eec4e49971eee0db3b6c774 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:28.275947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c38283-aa44-43d8-9fde-7ff6623a871b admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:28.278719 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-d2c38283-aa44-43d8-9fde-7ff6623a871b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:28.388009 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:28.392592 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fd7a3-dc4e-41d0-9d6c-679f8e09eff4 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:28.406426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c38283-aa44-43d8-9fde-7ff6623a871b admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:28.412450 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809549e-ff43-4e26-88c5-04245544715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:28.412956 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d0830-6895-4722-b9f8-70929b3ff533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:28.413574 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809549e-ff43-4e26-88c5-04245544715a admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:28.413996 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d0830-6895-4722-b9f8-70929b3ff533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:28.414225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809549e-ff43-4e26-88c5-04245544715a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:28.414466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d0830-6895-4722-b9f8-70929b3ff533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:28.414793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809549e-ff43-4e26-88c5-04245544715a admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:28.414906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d0830-6895-4722-b9f8-70929b3ff533 admin admin] PATH_INFO: `/v3/users/bf79a6a6e2ef4048982d17f012cc8bf6` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:28.415719 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809549e-ff43-4e26-88c5-04245544715a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:28.419020 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d0830-6895-4722-b9f8-70929b3ff533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf79a6a6e2ef4048982d17f012cc8bf6)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:28.419445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809549e-ff43-4e26-88c5-04245544715a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:28.425506 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d0830-6895-4722-b9f8-70929b3ff533 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:28.567924 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 955/1894] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:28 2022] POST /identity/v3/projects => generated 375 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:28.569358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809549e-ff43-4e26-88c5-04245544715a admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:28.571756 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a809549e-ff43-4e26-88c5-04245544715a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:28.674478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809549e-ff43-4e26-88c5-04245544715a admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:28.681882 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215d5da-9208-49a2-80e9-9ad9126a95a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:28.687207 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215d5da-9208-49a2-80e9-9ad9126a95a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:28.687207 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215d5da-9208-49a2-80e9-9ad9126a95a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:28.687207 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215d5da-9208-49a2-80e9-9ad9126a95a5 admin admin] PATH_INFO: `/v3/users/87b96c193609456c9bc596c6048e5f8d` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:28.701148 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215d5da-9208-49a2-80e9-9ad9126a95a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b96c193609456c9bc596c6048e5f8d)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:28.705101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215d5da-9208-49a2-80e9-9ad9126a95a5 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:28.792079 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-366d0830-6895-4722-b9f8-70929b3ff533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf79a6a6e2ef4048982d17f012cc8bf6'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:28.795803 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-366d0830-6895-4722-b9f8-70929b3ff533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf79a6a6e2ef4048982d17f012cc8bf6'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:28.812703 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-366d0830-6895-4722-b9f8-70929b3ff533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf79a6a6e2ef4048982d17f012cc8bf6'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:28.851563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-366d0830-6895-4722-b9f8-70929b3ff533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf79a6a6e2ef4048982d17f012cc8bf6'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:28.852754 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-366d0830-6895-4722-b9f8-70929b3ff533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf79a6a6e2ef4048982d17f012cc8bf6'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:28.975606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 940/1895] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:28 2022] DELETE /identity/v3/users/bf79a6a6e2ef4048982d17f012cc8bf6 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:28.977050 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d0830-6895-4722-b9f8-70929b3ff533 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:28.980379 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-366d0830-6895-4722-b9f8-70929b3ff533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:29.016634 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4215d5da-9208-49a2-80e9-9ad9126a95a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b96c193609456c9bc596c6048e5f8d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:29.132757 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d0830-6895-4722-b9f8-70929b3ff533 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:29.138408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277aae90-f3af-4cef-b839-207929e140fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:29.139624 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aae90-f3af-4cef-b839-207929e140fb admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:29.139910 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aae90-f3af-4cef-b839-207929e140fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:29.140181 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aae90-f3af-4cef-b839-207929e140fb admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:29.140851 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277aae90-f3af-4cef-b839-207929e140fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:29.143070 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277aae90-f3af-4cef-b839-207929e140fb admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:29.184690 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4215d5da-9208-49a2-80e9-9ad9126a95a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b96c193609456c9bc596c6048e5f8d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:29.186264 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4215d5da-9208-49a2-80e9-9ad9126a95a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b96c193609456c9bc596c6048e5f8d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:29.187830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4215d5da-9208-49a2-80e9-9ad9126a95a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b96c193609456c9bc596c6048e5f8d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:29.201825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4215d5da-9208-49a2-80e9-9ad9126a95a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b96c193609456c9bc596c6048e5f8d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:29.245013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 956/1896] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:28 2022] DELETE /identity/v3/users/87b96c193609456c9bc596c6048e5f8d => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:29.246586 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b90330-3913-4643-8474-4bc483bafc44 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:29.246873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b90330-3913-4643-8474-4bc483bafc44 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:29.251864 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b90330-3913-4643-8474-4bc483bafc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:29.272933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-97b90330-3913-4643-8474-4bc483bafc44 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:29.274485 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-97b90330-3913-4643-8474-4bc483bafc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:29.288169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 941/1897] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:28 2022] POST /identity/v3/users => generated 294 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:29.294126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277aae90-f3af-4cef-b839-207929e140fb admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:29.298797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-277aae90-f3af-4cef-b839-207929e140fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:29.322351 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277aae90-f3af-4cef-b839-207929e140fb admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:29.373340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 957/1898] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:29.373340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00c847-9b59-4274-8b0a-2807b788566d None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:29.373340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00c847-9b59-4274-8b0a-2807b788566d None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:29.373340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00c847-9b59-4274-8b0a-2807b788566d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:29.398649 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-1a00c847-9b59-4274-8b0a-2807b788566d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:29.398649 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1a00c847-9b59-4274-8b0a-2807b788566d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:29.412987 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 958/1899] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:29.414614 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00c847-9b59-4274-8b0a-2807b788566d None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:29.416797 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1a00c847-9b59-4274-8b0a-2807b788566d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:29.430650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00c847-9b59-4274-8b0a-2807b788566d None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:29.437521 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f07b8-1997-4133-8c36-bc0a1cd85b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:29.438142 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f07b8-1997-4133-8c36-bc0a1cd85b1e admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:29.438484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f07b8-1997-4133-8c36-bc0a1cd85b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:29.438758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f07b8-1997-4133-8c36-bc0a1cd85b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:29.439531 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f07b8-1997-4133-8c36-bc0a1cd85b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:29.441145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f07b8-1997-4133-8c36-bc0a1cd85b1e admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:29.458253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 959/1900] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:29.458253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f07b8-1997-4133-8c36-bc0a1cd85b1e admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:29.458253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9d6f07b8-1997-4133-8c36-bc0a1cd85b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:29.465867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21615139-4b0b-480f-b332-257300b5f1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:29.465867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615139-4b0b-480f-b332-257300b5f1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:29.465867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615139-4b0b-480f-b332-257300b5f1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:29.465867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615139-4b0b-480f-b332-257300b5f1fd admin admin] PATH_INFO: `/v3/projects/780704ca51ac4b17b7c448c7338f8ddd` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:29.466387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21615139-4b0b-480f-b332-257300b5f1fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=780704ca51ac4b17b7c448c7338f8ddd)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:29.470008 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21615139-4b0b-480f-b332-257300b5f1fd admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:29.488733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:29.548090 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f07b8-1997-4133-8c36-bc0a1cd85b1e admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:29.552483 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0a2e3-c4a7-420b-b27e-51630f5b8a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:29.553097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0a2e3-c4a7-420b-b27e-51630f5b8a0d service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:29.553370 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0a2e3-c4a7-420b-b27e-51630f5b8a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:29.553689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0a2e3-c4a7-420b-b27e-51630f5b8a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:29.564067 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0a2e3-c4a7-420b-b27e-51630f5b8a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:29.565656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0a2e3-c4a7-420b-b27e-51630f5b8a0d service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:29.580507 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 960/1901] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:29.581275 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0a2e3-c4a7-420b-b27e-51630f5b8a0d service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:29.583284 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-eec0a2e3-c4a7-420b-b27e-51630f5b8a0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:29.600809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-21615139-4b0b-480f-b332-257300b5f1fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '780704ca51ac4b17b7c448c7338f8ddd', 'request_id': 'req-21615139-4b0b-480f-b332-257300b5f1fd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:29.601323 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0a2e3-c4a7-420b-b27e-51630f5b8a0d service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:29.674934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b884a9-4ff9-4968-8999-b59e81d1f4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:29.677102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b884a9-4ff9-4968-8999-b59e81d1f4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:29.678337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b884a9-4ff9-4968-8999-b59e81d1f4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:29.679175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b884a9-4ff9-4968-8999-b59e81d1f4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:29.690088 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-21615139-4b0b-480f-b332-257300b5f1fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '780704ca51ac4b17b7c448c7338f8ddd', 'request_id': 'req-21615139-4b0b-480f-b332-257300b5f1fd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:29.707445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-21615139-4b0b-480f-b332-257300b5f1fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '780704ca51ac4b17b7c448c7338f8ddd', 'request_id': 'req-21615139-4b0b-480f-b332-257300b5f1fd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:29.785469 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-21615139-4b0b-480f-b332-257300b5f1fd admin admin] The token cache is being invalidate because project 780704ca51ac4b17b7c448c7338f8ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:29.786211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-21615139-4b0b-480f-b332-257300b5f1fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:29.788190 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-21615139-4b0b-480f-b332-257300b5f1fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:29.795692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b884a9-4ff9-4968-8999-b59e81d1f4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:29.795692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b884a9-4ff9-4968-8999-b59e81d1f4f9 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:29.795936 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 942/1902] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:29 2022] DELETE /identity/v3/projects/780704ca51ac4b17b7c448c7338f8ddd => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:29.795936 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21615139-4b0b-480f-b332-257300b5f1fd admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:29.799702 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-21615139-4b0b-480f-b332-257300b5f1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:29.811997 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 961/1903] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:29.814619 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a05a46-6528-4d09-83f5-2b07614be1cb None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:29.814909 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a05a46-6528-4d09-83f5-2b07614be1cb None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:29.815175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a05a46-6528-4d09-83f5-2b07614be1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:29.851373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21615139-4b0b-480f-b332-257300b5f1fd admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:29.862331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-d9a05a46-6528-4d09-83f5-2b07614be1cb None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:29.865383 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-d9a05a46-6528-4d09-83f5-2b07614be1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:29.865932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb2675-bb47-425c-ae72-91d4822bcf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:29.867509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb2675-bb47-425c-ae72-91d4822bcf99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:29.867918 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb2675-bb47-425c-ae72-91d4822bcf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:29.868299 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb2675-bb47-425c-ae72-91d4822bcf99 admin admin] PATH_INFO: `/v3/projects/f9c4d7f488e040fcac49477a11af9b67/users/34f4dc2d138a4729ac7cfebabaf6653d/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:29.881495 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 962/1904] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:29.892219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa127fd-8403-418c-947f-7548fc50dca5 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:29.892730 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa127fd-8403-418c-947f-7548fc50dca5 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:29.894731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb2675-bb47-425c-ae72-91d4822bcf99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c4d7f488e040fcac49477a11af9b67, user_id=34f4dc2d138a4729ac7cfebabaf6653d, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:29.895613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa127fd-8403-418c-947f-7548fc50dca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:29.900459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb2675-bb47-425c-ae72-91d4822bcf99 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:29.908191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:29.963113 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-daa127fd-8403-418c-947f-7548fc50dca5 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:29.967727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-daa127fd-8403-418c-947f-7548fc50dca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:29.976342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 963/1905] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:29.983107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa127fd-8403-418c-947f-7548fc50dca5 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:30.008378 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa127fd-8403-418c-947f-7548fc50dca5 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:30.009400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 943/1906] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:29 2022] PUT /identity/v3/projects/f9c4d7f488e040fcac49477a11af9b67/users/34f4dc2d138a4729ac7cfebabaf6653d/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:30.017166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb2675-bb47-425c-ae72-91d4822bcf99 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:30.088991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182a94f-43a2-48ec-a827-f0d5e96bd1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:30.089936 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182a94f-43a2-48ec-a827-f0d5e96bd1ec admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:30.090087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182a94f-43a2-48ec-a827-f0d5e96bd1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:30.090339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182a94f-43a2-48ec-a827-f0d5e96bd1ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:30.091242 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182a94f-43a2-48ec-a827-f0d5e96bd1ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:51:30.092435 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182a94f-43a2-48ec-a827-f0d5e96bd1ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:30.094790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182a94f-43a2-48ec-a827-f0d5e96bd1ec admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:30.115740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb2675-bb47-425c-ae72-91d4822bcf99 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:30.125775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 964/1907] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:51:30.126928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182a94f-43a2-48ec-a827-f0d5e96bd1ec admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:30.129020 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd016d-c2fa-429e-ac0c-d6a4d22f4174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:30.129640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd016d-c2fa-429e-ac0c-d6a4d22f4174 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:30.129924 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd016d-c2fa-429e-ac0c-d6a4d22f4174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:30.130198 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd016d-c2fa-429e-ac0c-d6a4d22f4174 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:30.136360 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd016d-c2fa-429e-ac0c-d6a4d22f4174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:30.138846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd016d-c2fa-429e-ac0c-d6a4d22f4174 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:30.163518 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182a94f-43a2-48ec-a827-f0d5e96bd1ec admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:30.173501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 944/1908] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:30.181556 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3810d7e-9820-4dba-8b68-7b4edd4ccf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:30.183299 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3810d7e-9820-4dba-8b68-7b4edd4ccf6b admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:30.185669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3810d7e-9820-4dba-8b68-7b4edd4ccf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:30.188899 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3810d7e-9820-4dba-8b68-7b4edd4ccf6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:30.189741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3810d7e-9820-4dba-8b68-7b4edd4ccf6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:30.190150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd016d-c2fa-429e-ac0c-d6a4d22f4174 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:30.193068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3810d7e-9820-4dba-8b68-7b4edd4ccf6b admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:30.260953 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd016d-c2fa-429e-ac0c-d6a4d22f4174 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:30.273817 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294221b2-5b36-4890-be19-d23ec0c8c270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:30.275129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294221b2-5b36-4890-be19-d23ec0c8c270 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:30.275668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294221b2-5b36-4890-be19-d23ec0c8c270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:30.276130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294221b2-5b36-4890-be19-d23ec0c8c270 admin admin] PATH_INFO: `/v3/projects/f9c4d7f488e040fcac49477a11af9b67/users/34f4dc2d138a4729ac7cfebabaf6653d/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:30.284541 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294221b2-5b36-4890-be19-d23ec0c8c270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c4d7f488e040fcac49477a11af9b67, user_id=34f4dc2d138a4729ac7cfebabaf6653d, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:30.292512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294221b2-5b36-4890-be19-d23ec0c8c270 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:30.328143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 945/1909] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:30 2022] PUT /identity/v3/projects/f9c4d7f488e040fcac49477a11af9b67/users/34f4dc2d138a4729ac7cfebabaf6653d/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:30.337774 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2377b-b4f4-408e-b294-eb29ed3ebd87 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:30.338494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2377b-b4f4-408e-b294-eb29ed3ebd87 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:30.338912 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2377b-b4f4-408e-b294-eb29ed3ebd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:30.395625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 965/1910] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:30 2022] POST /identity/v3/projects => generated 383 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:30.400225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3810d7e-9820-4dba-8b68-7b4edd4ccf6b admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:30.417410 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-2bd2377b-b4f4-408e-b294-eb29ed3ebd87 None None] MFA Rules not processed for user `34f4dc2d138a4729ac7cfebabaf6653d`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:30.421558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2bd2377b-b4f4-408e-b294-eb29ed3ebd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:30.574009 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3810d7e-9820-4dba-8b68-7b4edd4ccf6b admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:30.582742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2f7c4-2246-4d9b-9e37-d2306fd09f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:30.584123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f7c4-2246-4d9b-9e37-d2306fd09f65 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:30.584508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f7c4-2246-4d9b-9e37-d2306fd09f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:30.584883 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f7c4-2246-4d9b-9e37-d2306fd09f65 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:30.585800 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2f7c4-2246-4d9b-9e37-d2306fd09f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:30.588173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2f7c4-2246-4d9b-9e37-d2306fd09f65 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:30.623830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 946/1911] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:30.636103 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2377b-b4f4-408e-b294-eb29ed3ebd87 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:30.637470 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2bd2377b-b4f4-408e-b294-eb29ed3ebd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:30.702913 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 966/1912] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:30 2022] POST /identity/v3/users => generated 292 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:30.708070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2f7c4-2246-4d9b-9e37-d2306fd09f65 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:30.721062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2f7c4-2246-4d9b-9e37-d2306fd09f65 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:30.722113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2377b-b4f4-408e-b294-eb29ed3ebd87 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:30.730001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69af88-a06b-4a14-a318-b3e5006a53e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:30.730862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69af88-a06b-4a14-a318-b3e5006a53e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:30.731946 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69af88-a06b-4a14-a318-b3e5006a53e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:30.733001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69af88-a06b-4a14-a318-b3e5006a53e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:30.733832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69af88-a06b-4a14-a318-b3e5006a53e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:30.740669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69af88-a06b-4a14-a318-b3e5006a53e2 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:30.755080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35585954-0d45-4ea1-a87a-1f1845942888 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:30.755291 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35585954-0d45-4ea1-a87a-1f1845942888 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:30.756305 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35585954-0d45-4ea1-a87a-1f1845942888 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:30.756668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35585954-0d45-4ea1-a87a-1f1845942888 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:30.760968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-35585954-0d45-4ea1-a87a-1f1845942888 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:30.765745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 967/1913] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:30.782048 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69af88-a06b-4a14-a318-b3e5006a53e2 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:30.809641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69af88-a06b-4a14-a318-b3e5006a53e2 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:30.835617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058136d-669c-4734-9c6b-ddb5be78a086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:30.835617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058136d-669c-4734-9c6b-ddb5be78a086 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:30.835617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058136d-669c-4734-9c6b-ddb5be78a086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:30.835617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058136d-669c-4734-9c6b-ddb5be78a086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:30.836040 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058136d-669c-4734-9c6b-ddb5be78a086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:30.836040 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058136d-669c-4734-9c6b-ddb5be78a086 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:30.839334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 968/1914] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:30.844390 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058136d-669c-4734-9c6b-ddb5be78a086 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:30.856914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058136d-669c-4734-9c6b-ddb5be78a086 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:30.868342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35585954-0d45-4ea1-a87a-1f1845942888 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:30.868342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35585954-0d45-4ea1-a87a-1f1845942888 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:30.869740 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb9e21-79cc-43b5-913c-7ee7b5e9d2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:30.869740 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb9e21-79cc-43b5-913c-7ee7b5e9d2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:30.869740 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb9e21-79cc-43b5-913c-7ee7b5e9d2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:30.870087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb9e21-79cc-43b5-913c-7ee7b5e9d2bf admin admin] PATH_INFO: `/v3/projects/6845c51828334f94b17c04375d5eb65b/users/0f7a6a77cac840f8ad38a783772b0290/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:30.892209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 947/1915] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:30.898808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb9e21-79cc-43b5-913c-7ee7b5e9d2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6845c51828334f94b17c04375d5eb65b, user_id=0f7a6a77cac840f8ad38a783772b0290, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:30.914973 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb9e21-79cc-43b5-913c-7ee7b5e9d2bf admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:30.915067 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35585954-0d45-4ea1-a87a-1f1845942888 service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:30.915067 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-35585954-0d45-4ea1-a87a-1f1845942888 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:30.932939 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35585954-0d45-4ea1-a87a-1f1845942888 service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:30.955304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d141b2-b868-4bd8-a0c8-9c8df047c46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:30.956238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d141b2-b868-4bd8-a0c8-9c8df047c46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:30.956526 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d141b2-b868-4bd8-a0c8-9c8df047c46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:30.956804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d141b2-b868-4bd8-a0c8-9c8df047c46b admin admin] PATH_INFO: `/v3/projects/facee60315b946d393f2e8b22f6552e2` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:30.970209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d141b2-b868-4bd8-a0c8-9c8df047c46b admin admin] RBAC: Authorizing `identity:delete_project(project_id=facee60315b946d393f2e8b22f6552e2)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:30.972411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d141b2-b868-4bd8-a0c8-9c8df047c46b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:31.079649 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 969/1916] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:30 2022] PUT /identity/v3/projects/6845c51828334f94b17c04375d5eb65b/users/0f7a6a77cac840f8ad38a783772b0290/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:31.090677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb9e21-79cc-43b5-913c-7ee7b5e9d2bf admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:31.094976 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ffdb9e21-79cc-43b5-913c-7ee7b5e9d2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:31.204234 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c9d141b2-b868-4bd8-a0c8-9c8df047c46b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'facee60315b946d393f2e8b22f6552e2', 'request_id': 'req-c9d141b2-b868-4bd8-a0c8-9c8df047c46b'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:31.219845 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb9e21-79cc-43b5-913c-7ee7b5e9d2bf admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:31.267194 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c9d141b2-b868-4bd8-a0c8-9c8df047c46b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'facee60315b946d393f2e8b22f6552e2', 'request_id': 'req-c9d141b2-b868-4bd8-a0c8-9c8df047c46b'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:31.276987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c9d141b2-b868-4bd8-a0c8-9c8df047c46b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'facee60315b946d393f2e8b22f6552e2', 'request_id': 'req-c9d141b2-b868-4bd8-a0c8-9c8df047c46b'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:31.301464 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c9d141b2-b868-4bd8-a0c8-9c8df047c46b admin admin] The token cache is being invalidate because project facee60315b946d393f2e8b22f6552e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:31.302117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c9d141b2-b868-4bd8-a0c8-9c8df047c46b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:31.304260 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c9d141b2-b868-4bd8-a0c8-9c8df047c46b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:31.304593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67818106-7222-423b-842c-0b33641902bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:31.305710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67818106-7222-423b-842c-0b33641902bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:31.305994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67818106-7222-423b-842c-0b33641902bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:31.306272 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67818106-7222-423b-842c-0b33641902bf admin admin] PATH_INFO: `/v3/projects/3f3bf609ee944c058a4f15a7087108e7` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:31.307542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 948/1917] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:30 2022] DELETE /identity/v3/projects/facee60315b946d393f2e8b22f6552e2 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:31.310052 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e528b5e-afd4-4e25-b8c6-054179bcfa99 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:31.311097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e528b5e-afd4-4e25-b8c6-054179bcfa99 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:31.311381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67818106-7222-423b-842c-0b33641902bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3bf609ee944c058a4f15a7087108e7)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:31.311667 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e528b5e-afd4-4e25-b8c6-054179bcfa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:31.313597 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67818106-7222-423b-842c-0b33641902bf admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:31.365840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-2e528b5e-afd4-4e25-b8c6-054179bcfa99 None None] MFA Rules not processed for user `0f7a6a77cac840f8ad38a783772b0290`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:31.368055 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2e528b5e-afd4-4e25-b8c6-054179bcfa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:31.481507 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-67818106-7222-423b-842c-0b33641902bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3bf609ee944c058a4f15a7087108e7', 'request_id': 'req-67818106-7222-423b-842c-0b33641902bf'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:31.488849 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 949/1918] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:31.489361 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-67818106-7222-423b-842c-0b33641902bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3bf609ee944c058a4f15a7087108e7', 'request_id': 'req-67818106-7222-423b-842c-0b33641902bf'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:31.490318 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e528b5e-afd4-4e25-b8c6-054179bcfa99 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:31.492144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2e528b5e-afd4-4e25-b8c6-054179bcfa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:31.511738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e528b5e-afd4-4e25-b8c6-054179bcfa99 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:31.617225 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b79901-1cb8-4627-8a97-819e3b44ae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:31.618329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b79901-1cb8-4627-8a97-819e3b44ae13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:31.619677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b79901-1cb8-4627-8a97-819e3b44ae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:31.621151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b79901-1cb8-4627-8a97-819e3b44ae13 admin admin] PATH_INFO: `/v3/users/dd2bcc3c546440ecadf4ab996b1703f0` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:31.633787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b79901-1cb8-4627-8a97-819e3b44ae13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2bcc3c546440ecadf4ab996b1703f0)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:31.637406 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b79901-1cb8-4627-8a97-819e3b44ae13 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:31.644160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-67818106-7222-423b-842c-0b33641902bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3bf609ee944c058a4f15a7087108e7', 'request_id': 'req-67818106-7222-423b-842c-0b33641902bf'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:31.662078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-67818106-7222-423b-842c-0b33641902bf admin admin] The token cache is being invalidate because project 3f3bf609ee944c058a4f15a7087108e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:31.662752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-67818106-7222-423b-842c-0b33641902bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:31.663706 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-67818106-7222-423b-842c-0b33641902bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:31.670913 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 970/1919] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:31 2022] DELETE /identity/v3/projects/3f3bf609ee944c058a4f15a7087108e7 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:31.677327 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67818106-7222-423b-842c-0b33641902bf admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:31.679200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-67818106-7222-423b-842c-0b33641902bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:31.695332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67818106-7222-423b-842c-0b33641902bf admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:31.703151 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b13980-3007-4b74-a539-2fcd6318b79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:31.707411 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b13980-3007-4b74-a539-2fcd6318b79a admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:31.707411 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b13980-3007-4b74-a539-2fcd6318b79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:31.707411 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b13980-3007-4b74-a539-2fcd6318b79a admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:31.707411 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b13980-3007-4b74-a539-2fcd6318b79a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:31.708383 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b13980-3007-4b74-a539-2fcd6318b79a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:31.851179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 971/1920] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:31 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:31.852202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b13980-3007-4b74-a539-2fcd6318b79a admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:31.856126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c2b13980-3007-4b74-a539-2fcd6318b79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:31.924721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-e6b79901-1cb8-4627-8a97-819e3b44ae13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2bcc3c546440ecadf4ab996b1703f0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:31.938202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-e6b79901-1cb8-4627-8a97-819e3b44ae13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2bcc3c546440ecadf4ab996b1703f0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:31.958304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-e6b79901-1cb8-4627-8a97-819e3b44ae13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2bcc3c546440ecadf4ab996b1703f0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:31.967383 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b13980-3007-4b74-a539-2fcd6318b79a admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:31.973428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808878c-7238-4b75-afd3-0c0d3acf847f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:31.974290 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808878c-7238-4b75-afd3-0c0d3acf847f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:31.974444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808878c-7238-4b75-afd3-0c0d3acf847f admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:31.974715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808878c-7238-4b75-afd3-0c0d3acf847f admin admin] PATH_INFO: `/v3/users/eabe15a2359c4ba5bd36d975afec75f7` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:31.977642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808878c-7238-4b75-afd3-0c0d3acf847f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eabe15a2359c4ba5bd36d975afec75f7)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:31.981802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808878c-7238-4b75-afd3-0c0d3acf847f admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:31.984185 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-e6b79901-1cb8-4627-8a97-819e3b44ae13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2bcc3c546440ecadf4ab996b1703f0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:31.984995 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-e6b79901-1cb8-4627-8a97-819e3b44ae13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2bcc3c546440ecadf4ab996b1703f0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:32.122218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 950/1921] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:31 2022] DELETE /identity/v3/users/dd2bcc3c546440ecadf4ab996b1703f0 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:32.122218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b79901-1cb8-4627-8a97-819e3b44ae13 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:32.122218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-e6b79901-1cb8-4627-8a97-819e3b44ae13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:32.265821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:32.272855 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b79901-1cb8-4627-8a97-819e3b44ae13 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:32.280311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-1808878c-7238-4b75-afd3-0c0d3acf847f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eabe15a2359c4ba5bd36d975afec75f7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:32.284296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccd31d-c94a-4c80-8657-7bc216939513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:32.285373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccd31d-c94a-4c80-8657-7bc216939513 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:32.285727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccd31d-c94a-4c80-8657-7bc216939513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:32.286066 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccd31d-c94a-4c80-8657-7bc216939513 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:32.286770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acccd31d-c94a-4c80-8657-7bc216939513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:32.288778 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acccd31d-c94a-4c80-8657-7bc216939513 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:32.385318 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-1808878c-7238-4b75-afd3-0c0d3acf847f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eabe15a2359c4ba5bd36d975afec75f7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:32.385792 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-1808878c-7238-4b75-afd3-0c0d3acf847f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eabe15a2359c4ba5bd36d975afec75f7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:32.386478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-1808878c-7238-4b75-afd3-0c0d3acf847f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eabe15a2359c4ba5bd36d975afec75f7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:32.395583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 951/1922] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:32 2022] POST /identity/v3/users => generated 297 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:32.396565 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccd31d-c94a-4c80-8657-7bc216939513 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:32.398718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-acccd31d-c94a-4c80-8657-7bc216939513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:32.399200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-1808878c-7238-4b75-afd3-0c0d3acf847f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eabe15a2359c4ba5bd36d975afec75f7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:32.415315 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccd31d-c94a-4c80-8657-7bc216939513 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:32.431674 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5b77f-5d7e-4ac9-bdd5-1bc161c20649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:32.434591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5b77f-5d7e-4ac9-bdd5-1bc161c20649 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:32.434591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5b77f-5d7e-4ac9-bdd5-1bc161c20649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:32.434591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5b77f-5d7e-4ac9-bdd5-1bc161c20649 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:32.434591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5b77f-5d7e-4ac9-bdd5-1bc161c20649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:32.436912 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 972/1923] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:31 2022] DELETE /identity/v3/users/eabe15a2359c4ba5bd36d975afec75f7 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:32.443275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5b77f-5d7e-4ac9-bdd5-1bc161c20649 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:32.469401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 952/1924] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:32.473774 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808878c-7238-4b75-afd3-0c0d3acf847f admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:32.563157 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808878c-7238-4b75-afd3-0c0d3acf847f admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:32.575176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d4906-1804-4f29-b3c1-d09b53fddb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:32.577318 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d4906-1804-4f29-b3c1-d09b53fddb3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:32.577602 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d4906-1804-4f29-b3c1-d09b53fddb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:32.578023 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d4906-1804-4f29-b3c1-d09b53fddb3d admin admin] PATH_INFO: `/v3/projects/a4517b880a0f49019ca45a91b6b786a0/users/2dcdf47dd44344e4b9015aa04801d7fa/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:32.599537 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d4906-1804-4f29-b3c1-d09b53fddb3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4517b880a0f49019ca45a91b6b786a0, user_id=2dcdf47dd44344e4b9015aa04801d7fa, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:32.602870 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d4906-1804-4f29-b3c1-d09b53fddb3d admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:32.610575 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:32.746994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5b77f-5d7e-4ac9-bdd5-1bc161c20649 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:32.747142 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 973/1925] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:32 2022] PUT /identity/v3/projects/a4517b880a0f49019ca45a91b6b786a0/users/2dcdf47dd44344e4b9015aa04801d7fa/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:32.748053 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b6c5b77f-5d7e-4ac9-bdd5-1bc161c20649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:32.749354 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d4906-1804-4f29-b3c1-d09b53fddb3d admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:32.775633 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5b77f-5d7e-4ac9-bdd5-1bc161c20649 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:32.858577 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d4906-1804-4f29-b3c1-d09b53fddb3d admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:32.864371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d74082-9d27-49a8-823b-4bb64a3762c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:32.865014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d74082-9d27-49a8-823b-4bb64a3762c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:32.865295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d74082-9d27-49a8-823b-4bb64a3762c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:32.865586 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d74082-9d27-49a8-823b-4bb64a3762c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:32.866239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d74082-9d27-49a8-823b-4bb64a3762c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:32.868222 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d74082-9d27-49a8-823b-4bb64a3762c0 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:32.887537 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 974/1926] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:32.890253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d74082-9d27-49a8-823b-4bb64a3762c0 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:32.894115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa149725-df75-4bb0-b9a3-65f14533a0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:32.894896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa149725-df75-4bb0-b9a3-65f14533a0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:32.895170 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa149725-df75-4bb0-b9a3-65f14533a0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:32.895721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa149725-df75-4bb0-b9a3-65f14533a0d6 admin admin] PATH_INFO: `/v3/projects/043e9735ab8542efbabcae109213fb69` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:32.897629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa149725-df75-4bb0-b9a3-65f14533a0d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=043e9735ab8542efbabcae109213fb69)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:32.899939 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa149725-df75-4bb0-b9a3-65f14533a0d6 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:32.900955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d74082-9d27-49a8-823b-4bb64a3762c0 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:32.906986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e90444-a4fd-48b2-9e9d-2a1e3baf670d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:32.907915 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e90444-a4fd-48b2-9e9d-2a1e3baf670d admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:32.908164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e90444-a4fd-48b2-9e9d-2a1e3baf670d admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:32.908516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e90444-a4fd-48b2-9e9d-2a1e3baf670d admin admin] PATH_INFO: `/v3/projects/a4517b880a0f49019ca45a91b6b786a0/users/2dcdf47dd44344e4b9015aa04801d7fa/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:32.910573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e90444-a4fd-48b2-9e9d-2a1e3baf670d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4517b880a0f49019ca45a91b6b786a0, user_id=2dcdf47dd44344e4b9015aa04801d7fa, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:32.913363 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e90444-a4fd-48b2-9e9d-2a1e3baf670d admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:32.928364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 975/1927] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:32 2022] PUT /identity/v3/projects/a4517b880a0f49019ca45a91b6b786a0/users/2dcdf47dd44344e4b9015aa04801d7fa/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:32.948857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2263352-b602-46b3-a401-119910f8a287 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:32.953101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2263352-b602-46b3-a401-119910f8a287 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:32.953101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2263352-b602-46b3-a401-119910f8a287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:33.022766 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-e2263352-b602-46b3-a401-119910f8a287 None None] MFA Rules not processed for user `2dcdf47dd44344e4b9015aa04801d7fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:33.030590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e2263352-b602-46b3-a401-119910f8a287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:33.051609 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-fa149725-df75-4bb0-b9a3-65f14533a0d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043e9735ab8542efbabcae109213fb69', 'request_id': 'req-fa149725-df75-4bb0-b9a3-65f14533a0d6'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:33.178235 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-fa149725-df75-4bb0-b9a3-65f14533a0d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043e9735ab8542efbabcae109213fb69', 'request_id': 'req-fa149725-df75-4bb0-b9a3-65f14533a0d6'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:33.189733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-fa149725-df75-4bb0-b9a3-65f14533a0d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043e9735ab8542efbabcae109213fb69', 'request_id': 'req-fa149725-df75-4bb0-b9a3-65f14533a0d6'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:33.213913 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-fa149725-df75-4bb0-b9a3-65f14533a0d6 admin admin] The token cache is being invalidate because project 043e9735ab8542efbabcae109213fb69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:33.214742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-fa149725-df75-4bb0-b9a3-65f14533a0d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:33.215827 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-fa149725-df75-4bb0-b9a3-65f14533a0d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:33.218743 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 953/1928] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:32 2022] DELETE /identity/v3/projects/043e9735ab8542efbabcae109213fb69 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:33.225283 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 976/1929] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:33.227402 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e41cb-a8a0-45b8-9036-612336fe9d6b None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:33.227979 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e41cb-a8a0-45b8-9036-612336fe9d6b None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:33.228602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e41cb-a8a0-45b8-9036-612336fe9d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:33.241015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2263352-b602-46b3-a401-119910f8a287 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:33.243559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e2263352-b602-46b3-a401-119910f8a287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:33.286880 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-7d4e41cb-a8a0-45b8-9036-612336fe9d6b None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:33.288584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-7d4e41cb-a8a0-45b8-9036-612336fe9d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:33.335289 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2263352-b602-46b3-a401-119910f8a287 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:33.341414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba874c-4204-483f-9b45-9f8750bb8754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:33.342751 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba874c-4204-483f-9b45-9f8750bb8754 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:33.343255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba874c-4204-483f-9b45-9f8750bb8754 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:33.343768 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba874c-4204-483f-9b45-9f8750bb8754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:33.346469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-32ba874c-4204-483f-9b45-9f8750bb8754 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:33.361224 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba874c-4204-483f-9b45-9f8750bb8754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:33.366670 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba874c-4204-483f-9b45-9f8750bb8754 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:33.377459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 977/1930] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:33.452835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 954/1931] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:33.467134 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d599666-3795-4dbc-85d6-2ddab6e47746 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:33.467921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d599666-3795-4dbc-85d6-2ddab6e47746 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:33.468387 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d599666-3795-4dbc-85d6-2ddab6e47746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:33.508986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-4d599666-3795-4dbc-85d6-2ddab6e47746 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:33.510497 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-4d599666-3795-4dbc-85d6-2ddab6e47746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:33.519676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 978/1932] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:33.525900 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e41cb-a8a0-45b8-9036-612336fe9d6b None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:33.543512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e41cb-a8a0-45b8-9036-612336fe9d6b None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:33.549300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac6bdd-7109-4c10-aa77-23930485e6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:33.549938 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac6bdd-7109-4c10-aa77-23930485e6fe admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:33.550218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac6bdd-7109-4c10-aa77-23930485e6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:33.550487 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac6bdd-7109-4c10-aa77-23930485e6fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:33.551138 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac6bdd-7109-4c10-aa77-23930485e6fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:51:33.551467 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac6bdd-7109-4c10-aa77-23930485e6fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:33.553149 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac6bdd-7109-4c10-aa77-23930485e6fe admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:33.571406 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 955/1933] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:51:33.577185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d599666-3795-4dbc-85d6-2ddab6e47746 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:33.605558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d599666-3795-4dbc-85d6-2ddab6e47746 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:33.614721 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea4f07-7a82-4f52-b15a-c8748e7d1d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:33.615469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea4f07-7a82-4f52-b15a-c8748e7d1d45 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:33.615875 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea4f07-7a82-4f52-b15a-c8748e7d1d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:33.616251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea4f07-7a82-4f52-b15a-c8748e7d1d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:33.617088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea4f07-7a82-4f52-b15a-c8748e7d1d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:33.618419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac6bdd-7109-4c10-aa77-23930485e6fe admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:33.619310 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea4f07-7a82-4f52-b15a-c8748e7d1d45 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:33.620456 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b8ac6bdd-7109-4c10-aa77-23930485e6fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:33.641514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac6bdd-7109-4c10-aa77-23930485e6fe admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:33.645432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf4ae3-d2e4-42df-9ef5-b71540802c8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:33.646058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf4ae3-d2e4-42df-9ef5-b71540802c8b service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:33.646350 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf4ae3-d2e4-42df-9ef5-b71540802c8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:33.646615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf4ae3-d2e4-42df-9ef5-b71540802c8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:33.648716 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-dfcf4ae3-d2e4-42df-9ef5-b71540802c8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:33.725429 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 979/1934] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:33 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:51:33.726739 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea4f07-7a82-4f52-b15a-c8748e7d1d45 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:33.738993 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf4ae3-d2e4-42df-9ef5-b71540802c8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:33.741649 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf4ae3-d2e4-42df-9ef5-b71540802c8b service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:33.757392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 956/1935] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:51:33.818274 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea4f07-7a82-4f52-b15a-c8748e7d1d45 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:33.823458 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3225784-7438-4f71-8ce4-d4de0afa0c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:33.824108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225784-7438-4f71-8ce4-d4de0afa0c47 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:33.824394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225784-7438-4f71-8ce4-d4de0afa0c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:33.825349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225784-7438-4f71-8ce4-d4de0afa0c47 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:33.826638 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3225784-7438-4f71-8ce4-d4de0afa0c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:33.828644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3225784-7438-4f71-8ce4-d4de0afa0c47 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:33.899975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf4ae3-d2e4-42df-9ef5-b71540802c8b service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:33.902347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-dfcf4ae3-d2e4-42df-9ef5-b71540802c8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:33.921770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf4ae3-d2e4-42df-9ef5-b71540802c8b service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:33.930092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25f279-bfae-46fa-b32b-b2634ef96afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:33.930797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25f279-bfae-46fa-b32b-b2634ef96afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:33.931077 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25f279-bfae-46fa-b32b-b2634ef96afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:33.931371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25f279-bfae-46fa-b32b-b2634ef96afe admin admin] PATH_INFO: `/v3/projects/82dcb44ad41f42bbb27bd53eca2aff2c` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:33.932561 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25f279-bfae-46fa-b32b-b2634ef96afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=82dcb44ad41f42bbb27bd53eca2aff2c)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:33.936262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25f279-bfae-46fa-b32b-b2634ef96afe admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:33.992234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 980/1936] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:33 2022] POST /identity/v3/users => generated 291 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:33.996337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3225784-7438-4f71-8ce4-d4de0afa0c47 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:34.012302 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3225784-7438-4f71-8ce4-d4de0afa0c47 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:34.024124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1e1f5-d848-4eb9-9d35-596da5e8ac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:34.024124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1e1f5-d848-4eb9-9d35-596da5e8ac90 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:34.024124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1e1f5-d848-4eb9-9d35-596da5e8ac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:34.024124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1e1f5-d848-4eb9-9d35-596da5e8ac90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:34.024665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1e1f5-d848-4eb9-9d35-596da5e8ac90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:34.024665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1e1f5-d848-4eb9-9d35-596da5e8ac90 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:34.039515 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 981/1937] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:34.046410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1e1f5-d848-4eb9-9d35-596da5e8ac90 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:34.063792 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1e1f5-d848-4eb9-9d35-596da5e8ac90 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:34.086832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec70977-fb66-418e-882e-5a2fffe80983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:34.086832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec70977-fb66-418e-882e-5a2fffe80983 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:34.086832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec70977-fb66-418e-882e-5a2fffe80983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:34.086832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec70977-fb66-418e-882e-5a2fffe80983 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:34.087177 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec70977-fb66-418e-882e-5a2fffe80983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:34.087177 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec70977-fb66-418e-882e-5a2fffe80983 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:34.096076 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 982/1938] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:34.100411 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec70977-fb66-418e-882e-5a2fffe80983 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:34.113819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec70977-fb66-418e-882e-5a2fffe80983 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:34.121147 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bb6ae-2ea3-4348-bb1b-cc573c71ff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:34.121740 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bb6ae-2ea3-4348-bb1b-cc573c71ff7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:34.122022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bb6ae-2ea3-4348-bb1b-cc573c71ff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:34.122717 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bb6ae-2ea3-4348-bb1b-cc573c71ff7b admin admin] PATH_INFO: `/v3/projects/64ba5080e110487d887d6f9a4e5a2135/users/a8ef2ddb003447058053013a0d2bb9fb/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:34.140752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bb6ae-2ea3-4348-bb1b-cc573c71ff7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ba5080e110487d887d6f9a4e5a2135, user_id=a8ef2ddb003447058053013a0d2bb9fb, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:34.143802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bb6ae-2ea3-4348-bb1b-cc573c71ff7b admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:34.278748 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:34.302717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4a25f279-bfae-46fa-b32b-b2634ef96afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82dcb44ad41f42bbb27bd53eca2aff2c', 'request_id': 'req-4a25f279-bfae-46fa-b32b-b2634ef96afe'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:34.306108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 983/1939] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:34 2022] PUT /identity/v3/projects/64ba5080e110487d887d6f9a4e5a2135/users/a8ef2ddb003447058053013a0d2bb9fb/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:34.318443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61358a-bbbb-4c6e-a801-efce00fbc540 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:34.319034 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61358a-bbbb-4c6e-a801-efce00fbc540 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:34.319580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61358a-bbbb-4c6e-a801-efce00fbc540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:34.384674 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-1f61358a-bbbb-4c6e-a801-efce00fbc540 None None] MFA Rules not processed for user `a8ef2ddb003447058053013a0d2bb9fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:34.384674 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1f61358a-bbbb-4c6e-a801-efce00fbc540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:34.470501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4a25f279-bfae-46fa-b32b-b2634ef96afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82dcb44ad41f42bbb27bd53eca2aff2c', 'request_id': 'req-4a25f279-bfae-46fa-b32b-b2634ef96afe'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:34.483251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4a25f279-bfae-46fa-b32b-b2634ef96afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82dcb44ad41f42bbb27bd53eca2aff2c', 'request_id': 'req-4a25f279-bfae-46fa-b32b-b2634ef96afe'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:34.510434 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4a25f279-bfae-46fa-b32b-b2634ef96afe admin admin] The token cache is being invalidate because project 82dcb44ad41f42bbb27bd53eca2aff2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:34.512076 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4a25f279-bfae-46fa-b32b-b2634ef96afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:34.512577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4a25f279-bfae-46fa-b32b-b2634ef96afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:34.536152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 957/1940] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:33 2022] DELETE /identity/v3/projects/82dcb44ad41f42bbb27bd53eca2aff2c => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:34.547767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa1ead-b15c-44f9-94dd-edb3683aa4f3 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:34.548292 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa1ead-b15c-44f9-94dd-edb3683aa4f3 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:34.548715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa1ead-b15c-44f9-94dd-edb3683aa4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:34.554678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 984/1941] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:34.573605 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61358a-bbbb-4c6e-a801-efce00fbc540 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:34.578474 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-f5fa1ead-b15c-44f9-94dd-edb3683aa4f3 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:34.580139 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f5fa1ead-b15c-44f9-94dd-edb3683aa4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:34.740181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61358a-bbbb-4c6e-a801-efce00fbc540 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:34.755253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39379d7-8e39-4a4d-acbe-136474fc6cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:34.756746 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39379d7-8e39-4a4d-acbe-136474fc6cab admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:34.757968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 958/1942] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:34.764473 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39379d7-8e39-4a4d-acbe-136474fc6cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:34.764823 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39379d7-8e39-4a4d-acbe-136474fc6cab admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:34.766070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39379d7-8e39-4a4d-acbe-136474fc6cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:34.770759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a075e-e9ea-47f9-9e70-2f3de79bde97 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:34.771311 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a075e-e9ea-47f9-9e70-2f3de79bde97 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:34.771722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a075e-e9ea-47f9-9e70-2f3de79bde97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:34.774346 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39379d7-8e39-4a4d-acbe-136474fc6cab admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:34.816438 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-f42a075e-e9ea-47f9-9e70-2f3de79bde97 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:34.818560 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f42a075e-e9ea-47f9-9e70-2f3de79bde97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:34.850758 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 959/1943] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:34.851852 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a075e-e9ea-47f9-9e70-2f3de79bde97 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:34.853494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f42a075e-e9ea-47f9-9e70-2f3de79bde97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:34.869637 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a075e-e9ea-47f9-9e70-2f3de79bde97 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:34.876440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738bc30-296b-4437-aa74-ff0234127c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:34.877634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738bc30-296b-4437-aa74-ff0234127c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:34.877634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738bc30-296b-4437-aa74-ff0234127c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:34.877634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738bc30-296b-4437-aa74-ff0234127c47 admin admin] PATH_INFO: `/v3/users/0f7a6a77cac840f8ad38a783772b0290` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:34.879416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738bc30-296b-4437-aa74-ff0234127c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f7a6a77cac840f8ad38a783772b0290)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:34.881443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738bc30-296b-4437-aa74-ff0234127c47 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:34.948573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 985/1944] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:34 2022] POST /identity/v3/projects => generated 381 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:34.949841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39379d7-8e39-4a4d-acbe-136474fc6cab admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:35.034363 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39379d7-8e39-4a4d-acbe-136474fc6cab admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:35.041635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788b990-68bb-40a7-a99a-38ed7af87c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:35.041635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788b990-68bb-40a7-a99a-38ed7af87c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:35.041635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788b990-68bb-40a7-a99a-38ed7af87c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:35.041635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788b990-68bb-40a7-a99a-38ed7af87c88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:35.042223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788b990-68bb-40a7-a99a-38ed7af87c88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:51:35.042223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788b990-68bb-40a7-a99a-38ed7af87c88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:35.043282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788b990-68bb-40a7-a99a-38ed7af87c88 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:35.066714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 986/1945] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:51:35.067795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788b990-68bb-40a7-a99a-38ed7af87c88 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:35.069757 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9788b990-68bb-40a7-a99a-38ed7af87c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:35.085512 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788b990-68bb-40a7-a99a-38ed7af87c88 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:35.091008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7884db-aa2e-4643-90bc-498f2d8cf563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:35.092933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7884db-aa2e-4643-90bc-498f2d8cf563 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:35.093435 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7884db-aa2e-4643-90bc-498f2d8cf563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:35.093689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7884db-aa2e-4643-90bc-498f2d8cf563 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:35.094288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7884db-aa2e-4643-90bc-498f2d8cf563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:35.096942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7884db-aa2e-4643-90bc-498f2d8cf563 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:35.117448 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2738bc30-296b-4437-aa74-ff0234127c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f7a6a77cac840f8ad38a783772b0290'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:35.118613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2738bc30-296b-4437-aa74-ff0234127c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f7a6a77cac840f8ad38a783772b0290'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:35.134854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2738bc30-296b-4437-aa74-ff0234127c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f7a6a77cac840f8ad38a783772b0290'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:35.155419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2738bc30-296b-4437-aa74-ff0234127c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f7a6a77cac840f8ad38a783772b0290'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:35.156970 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2738bc30-296b-4437-aa74-ff0234127c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f7a6a77cac840f8ad38a783772b0290'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:35.225881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 987/1946] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:35 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:35.229955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7884db-aa2e-4643-90bc-498f2d8cf563 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:35.231845 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-bb7884db-aa2e-4643-90bc-498f2d8cf563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:35.255421 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 960/1947] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:34 2022] DELETE /identity/v3/users/0f7a6a77cac840f8ad38a783772b0290 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:35.257843 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738bc30-296b-4437-aa74-ff0234127c47 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:35.260051 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2738bc30-296b-4437-aa74-ff0234127c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:35.316127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7884db-aa2e-4643-90bc-498f2d8cf563 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:35.338658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:35.412310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738bc30-296b-4437-aa74-ff0234127c47 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:35.420242 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d3c08-26d9-4420-8928-02acc24f618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:35.420817 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d3c08-26d9-4420-8928-02acc24f618e admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:35.421177 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d3c08-26d9-4420-8928-02acc24f618e admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:35.421530 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d3c08-26d9-4420-8928-02acc24f618e admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:35.422343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d3c08-26d9-4420-8928-02acc24f618e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:35.425314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d3c08-26d9-4420-8928-02acc24f618e admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:35.428892 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de349ad-178e-479e-a647-06b067b6fb91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:35.430958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de349ad-178e-479e-a647-06b067b6fb91 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:35.431991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de349ad-178e-479e-a647-06b067b6fb91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:35.432737 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de349ad-178e-479e-a647-06b067b6fb91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:35.438932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1de349ad-178e-479e-a647-06b067b6fb91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:35.529987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 961/1948] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:35 2022] POST /identity/v3/projects => generated 363 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:35.531377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d3c08-26d9-4420-8928-02acc24f618e admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:35.533769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-725d3c08-26d9-4420-8928-02acc24f618e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:35.612813 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de349ad-178e-479e-a647-06b067b6fb91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:35.614317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de349ad-178e-479e-a647-06b067b6fb91 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:35.631545 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 988/1949] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:35.645068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea139d3a-dbf9-42d2-861c-b68666c86c4b None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:35.645350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea139d3a-dbf9-42d2-861c-b68666c86c4b None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:35.645627 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea139d3a-dbf9-42d2-861c-b68666c86c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:35.656108 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d3c08-26d9-4420-8928-02acc24f618e admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:35.679601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd0d00-f467-4cdb-a0df-bc0772a0cd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:35.679601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0d00-f467-4cdb-a0df-bc0772a0cd14 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:35.679899 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0d00-f467-4cdb-a0df-bc0772a0cd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:35.680247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0d00-f467-4cdb-a0df-bc0772a0cd14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:35.681920 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd0d00-f467-4cdb-a0df-bc0772a0cd14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:35.688738 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-ea139d3a-dbf9-42d2-861c-b68666c86c4b None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:35.689011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd0d00-f467-4cdb-a0df-bc0772a0cd14 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:35.690049 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ea139d3a-dbf9-42d2-861c-b68666c86c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:35.699026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 989/1950] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:35.700157 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea139d3a-dbf9-42d2-861c-b68666c86c4b None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:35.720499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 962/1951] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:35.725252 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea139d3a-dbf9-42d2-861c-b68666c86c4b None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:35.729311 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd0d00-f467-4cdb-a0df-bc0772a0cd14 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:35.730848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2ff22-33b5-4dd4-b2b1-a2dfe0bcb44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:35.735359 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2ff22-33b5-4dd4-b2b1-a2dfe0bcb44b admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:35.735359 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2ff22-33b5-4dd4-b2b1-a2dfe0bcb44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:35.735359 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2ff22-33b5-4dd4-b2b1-a2dfe0bcb44b admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:35.735359 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2ff22-33b5-4dd4-b2b1-a2dfe0bcb44b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:35.736127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2ff22-33b5-4dd4-b2b1-a2dfe0bcb44b admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:35.753981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd0d00-f467-4cdb-a0df-bc0772a0cd14 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:35.761281 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5119436-d3ad-46a8-afcf-7d5f68751a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:35.762837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5119436-d3ad-46a8-afcf-7d5f68751a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:35.763192 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5119436-d3ad-46a8-afcf-7d5f68751a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:35.764376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5119436-d3ad-46a8-afcf-7d5f68751a73 admin admin] PATH_INFO: `/v3/projects/3b05ec80cbc44384a84a3075a8a35293/users/c4d52a833f31417e94c13f92f2c940ad/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:35.790342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5119436-d3ad-46a8-afcf-7d5f68751a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b05ec80cbc44384a84a3075a8a35293, user_id=c4d52a833f31417e94c13f92f2c940ad, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:35.795964 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5119436-d3ad-46a8-afcf-7d5f68751a73 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:35.835658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 990/1952] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:35 2022] POST /identity/v3/users => generated 282 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:35.835658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2ff22-33b5-4dd4-b2b1-a2dfe0bcb44b admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:35.840684 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e0a2ff22-33b5-4dd4-b2b1-a2dfe0bcb44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:35.929421 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 963/1953] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:35 2022] PUT /identity/v3/projects/3b05ec80cbc44384a84a3075a8a35293/users/c4d52a833f31417e94c13f92f2c940ad/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:35.931726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5119436-d3ad-46a8-afcf-7d5f68751a73 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:35.945826 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:36.033471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5119436-d3ad-46a8-afcf-7d5f68751a73 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:36.041483 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c9ab2-279d-48de-be59-e04bd7189f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:36.042447 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c9ab2-279d-48de-be59-e04bd7189f74 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:36.042919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c9ab2-279d-48de-be59-e04bd7189f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:36.043408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c9ab2-279d-48de-be59-e04bd7189f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:36.045852 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c9ab2-279d-48de-be59-e04bd7189f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:36.047901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c9ab2-279d-48de-be59-e04bd7189f74 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:36.055793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2ff22-33b5-4dd4-b2b1-a2dfe0bcb44b admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:36.062189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 964/1954] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:36.063817 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c9ab2-279d-48de-be59-e04bd7189f74 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:36.077015 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c9ab2-279d-48de-be59-e04bd7189f74 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:36.083007 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa4488-3642-4eab-a5bd-0037df51ea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:36.083846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa4488-3642-4eab-a5bd-0037df51ea74 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:36.084228 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa4488-3642-4eab-a5bd-0037df51ea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:36.084609 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa4488-3642-4eab-a5bd-0037df51ea74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:36.085400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa4488-3642-4eab-a5bd-0037df51ea74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:36.087272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa4488-3642-4eab-a5bd-0037df51ea74 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:36.112657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 965/1955] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:36.114309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa4488-3642-4eab-a5bd-0037df51ea74 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:36.136120 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa4488-3642-4eab-a5bd-0037df51ea74 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:36.137123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c3fb1-3d93-4a73-91ca-1d72b0b09fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:36.137955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c3fb1-3d93-4a73-91ca-1d72b0b09fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:36.138991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c3fb1-3d93-4a73-91ca-1d72b0b09fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:36.139745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c3fb1-3d93-4a73-91ca-1d72b0b09fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:36.147608 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac2983-59fc-42ed-a59f-c6854b07ef02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:36.148491 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2983-59fc-42ed-a59f-c6854b07ef02 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:36.149434 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2983-59fc-42ed-a59f-c6854b07ef02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:36.149434 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2983-59fc-42ed-a59f-c6854b07ef02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:36.150537 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac2983-59fc-42ed-a59f-c6854b07ef02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:36.155126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac2983-59fc-42ed-a59f-c6854b07ef02 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:36.155952 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c3fb1-3d93-4a73-91ca-1d72b0b09fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:36.158309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c3fb1-3d93-4a73-91ca-1d72b0b09fb2 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:36.187728 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 991/1956] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:36.187728 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c3fb1-3d93-4a73-91ca-1d72b0b09fb2 service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:36.193736 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c3fb1-3d93-4a73-91ca-1d72b0b09fb2 service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:36.202388 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b1721-deb3-4fac-9f79-d28cb9e3183e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:36.203420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b1721-deb3-4fac-9f79-d28cb9e3183e admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:36.203917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b1721-deb3-4fac-9f79-d28cb9e3183e admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:36.204362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b1721-deb3-4fac-9f79-d28cb9e3183e admin admin] PATH_INFO: `/v3/projects/3b05ec80cbc44384a84a3075a8a35293/users/c4d52a833f31417e94c13f92f2c940ad/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:36.209783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 966/1957] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:36.211024 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac2983-59fc-42ed-a59f-c6854b07ef02 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:36.213080 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b1721-deb3-4fac-9f79-d28cb9e3183e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b05ec80cbc44384a84a3075a8a35293, user_id=c4d52a833f31417e94c13f92f2c940ad, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:36.216379 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b1721-deb3-4fac-9f79-d28cb9e3183e admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:36.235443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 992/1958] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:36 2022] PUT /identity/v3/projects/3b05ec80cbc44384a84a3075a8a35293/users/c4d52a833f31417e94c13f92f2c940ad/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:36.240826 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac2983-59fc-42ed-a59f-c6854b07ef02 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:36.260365 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98ed6f-df50-4b3c-98d3-8d00c9a901e3 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:36.260895 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98ed6f-df50-4b3c-98d3-8d00c9a901e3 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:36.261324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98ed6f-df50-4b3c-98d3-8d00c9a901e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:36.321929 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8c98ed6f-df50-4b3c-98d3-8d00c9a901e3 None None] MFA Rules not processed for user `c4d52a833f31417e94c13f92f2c940ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:36.325137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8c98ed6f-df50-4b3c-98d3-8d00c9a901e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:36.418055 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf92e0-8b3f-4ab0-9311-1c96b1d04457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:36.420454 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf92e0-8b3f-4ab0-9311-1c96b1d04457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:36.421024 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf92e0-8b3f-4ab0-9311-1c96b1d04457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:36.421639 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf92e0-8b3f-4ab0-9311-1c96b1d04457 admin admin] PATH_INFO: `/v3/projects/1422490d2ee644dbb307686da8e22396/users/0017c51598094459a50687dc5bf3ea11/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:36.448527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf92e0-8b3f-4ab0-9311-1c96b1d04457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1422490d2ee644dbb307686da8e22396, user_id=0017c51598094459a50687dc5bf3ea11, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:36.452758 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf92e0-8b3f-4ab0-9311-1c96b1d04457 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:36.509885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 993/1959] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:36.515445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98ed6f-df50-4b3c-98d3-8d00c9a901e3 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:36.521215 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8c98ed6f-df50-4b3c-98d3-8d00c9a901e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:36.605797 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98ed6f-df50-4b3c-98d3-8d00c9a901e3 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:36.607834 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 967/1960] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:36 2022] PUT /identity/v3/projects/1422490d2ee644dbb307686da8e22396/users/0017c51598094459a50687dc5bf3ea11/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:36.620398 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec84cd-833d-42d1-b31d-e0d2e3e4a1ea None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:36.620976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec84cd-833d-42d1-b31d-e0d2e3e4a1ea None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:36.620976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec84cd-833d-42d1-b31d-e0d2e3e4a1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:36.663060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-d1ec84cd-833d-42d1-b31d-e0d2e3e4a1ea None None] MFA Rules not processed for user `0017c51598094459a50687dc5bf3ea11`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:36.665031 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d1ec84cd-833d-42d1-b31d-e0d2e3e4a1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:36.677139 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867ac95-18b8-4bfd-81f5-25c39617c375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:36.677768 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867ac95-18b8-4bfd-81f5-25c39617c375 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:36.678045 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867ac95-18b8-4bfd-81f5-25c39617c375 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:36.678313 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867ac95-18b8-4bfd-81f5-25c39617c375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:36.781165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867ac95-18b8-4bfd-81f5-25c39617c375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:36.783625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867ac95-18b8-4bfd-81f5-25c39617c375 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:36.793775 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 968/1961] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:36.800501 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 994/1962] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:51:36.801093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec84cd-833d-42d1-b31d-e0d2e3e4a1ea None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:36.855149 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:36.987196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec84cd-833d-42d1-b31d-e0d2e3e4a1ea None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:37.005532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f512f1-9322-4181-975b-b653444c4dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:37.006880 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f512f1-9322-4181-975b-b653444c4dea admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:37.007452 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f512f1-9322-4181-975b-b653444c4dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:37.007955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f512f1-9322-4181-975b-b653444c4dea admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:37.008665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f512f1-9322-4181-975b-b653444c4dea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:37.010865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f512f1-9322-4181-975b-b653444c4dea admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:37.079152 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867ac95-18b8-4bfd-81f5-25c39617c375 service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:37.083337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1867ac95-18b8-4bfd-81f5-25c39617c375 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:37.124847 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867ac95-18b8-4bfd-81f5-25c39617c375 service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:37.129092 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ed944-f7c7-4816-ad90-9329c4384828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:37.129754 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ed944-f7c7-4816-ad90-9329c4384828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:37.130029 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ed944-f7c7-4816-ad90-9329c4384828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:37.130303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ed944-f7c7-4816-ad90-9329c4384828 admin admin] PATH_INFO: `/v3/projects/6845c51828334f94b17c04375d5eb65b` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:37.131584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ed944-f7c7-4816-ad90-9329c4384828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6845c51828334f94b17c04375d5eb65b)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:37.134296 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ed944-f7c7-4816-ad90-9329c4384828 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:37.183286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 969/1963] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:36 2022] POST /identity/v3/projects => generated 365 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:37.186630 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f512f1-9322-4181-975b-b653444c4dea admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:37.335964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d67ed944-f7c7-4816-ad90-9329c4384828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6845c51828334f94b17c04375d5eb65b', 'request_id': 'req-d67ed944-f7c7-4816-ad90-9329c4384828'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:37.354458 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d67ed944-f7c7-4816-ad90-9329c4384828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6845c51828334f94b17c04375d5eb65b', 'request_id': 'req-d67ed944-f7c7-4816-ad90-9329c4384828'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:37.357541 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f512f1-9322-4181-975b-b653444c4dea admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:37.463086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf2b2f-6ac9-45e9-ba86-54c953498663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:37.468158 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf2b2f-6ac9-45e9-ba86-54c953498663 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:37.469531 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf2b2f-6ac9-45e9-ba86-54c953498663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:37.470501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf2b2f-6ac9-45e9-ba86-54c953498663 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:37.472227 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf2b2f-6ac9-45e9-ba86-54c953498663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:37.477276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf2b2f-6ac9-45e9-ba86-54c953498663 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:37.488068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d67ed944-f7c7-4816-ad90-9329c4384828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6845c51828334f94b17c04375d5eb65b', 'request_id': 'req-d67ed944-f7c7-4816-ad90-9329c4384828'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:37.512984 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d67ed944-f7c7-4816-ad90-9329c4384828 admin admin] The token cache is being invalidate because project 6845c51828334f94b17c04375d5eb65b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:37.514194 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d67ed944-f7c7-4816-ad90-9329c4384828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:37.514680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d67ed944-f7c7-4816-ad90-9329c4384828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:37.516553 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 995/1964] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:37 2022] DELETE /identity/v3/projects/6845c51828334f94b17c04375d5eb65b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:37.521933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ed944-f7c7-4816-ad90-9329c4384828 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:37.525082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-d67ed944-f7c7-4816-ad90-9329c4384828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:37.546671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ed944-f7c7-4816-ad90-9329c4384828 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:37.554729 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770f867-9bad-49d5-94a2-7759d931115a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:37.555841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770f867-9bad-49d5-94a2-7759d931115a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:37.556323 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770f867-9bad-49d5-94a2-7759d931115a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:37.556820 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770f867-9bad-49d5-94a2-7759d931115a admin admin] PATH_INFO: `/v3/users/2dcdf47dd44344e4b9015aa04801d7fa` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:37.558970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770f867-9bad-49d5-94a2-7759d931115a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dcdf47dd44344e4b9015aa04801d7fa)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:37.563303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770f867-9bad-49d5-94a2-7759d931115a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:37.655678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 970/1965] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:37 2022] POST /identity/v3/users => generated 289 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:37.658193 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf2b2f-6ac9-45e9-ba86-54c953498663 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:37.659103 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-27bf2b2f-6ac9-45e9-ba86-54c953498663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:37.672847 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf2b2f-6ac9-45e9-ba86-54c953498663 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:37.678324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84bbf3-f9ac-44b9-8c28-0c573019f4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:37.678946 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84bbf3-f9ac-44b9-8c28-0c573019f4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:37.679220 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84bbf3-f9ac-44b9-8c28-0c573019f4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:37.679506 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84bbf3-f9ac-44b9-8c28-0c573019f4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:37.680174 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84bbf3-f9ac-44b9-8c28-0c573019f4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:37.681892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84bbf3-f9ac-44b9-8c28-0c573019f4f3 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:37.695601 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 971/1966] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:37.703715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84bbf3-f9ac-44b9-8c28-0c573019f4f3 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:37.716280 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84bbf3-f9ac-44b9-8c28-0c573019f4f3 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:37.732727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5bfa6-f685-4e3e-b35f-45b710dc3305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:37.732727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5bfa6-f685-4e3e-b35f-45b710dc3305 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:37.732727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5bfa6-f685-4e3e-b35f-45b710dc3305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:37.732727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5bfa6-f685-4e3e-b35f-45b710dc3305 admin admin] PATH_INFO: `/v3/projects/600cc2fab14d44c8b011ba144c82d0ce/users/991ff4722e32473584b1c4245ce30bf0/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:37.745522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5bfa6-f685-4e3e-b35f-45b710dc3305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=600cc2fab14d44c8b011ba144c82d0ce, user_id=991ff4722e32473584b1c4245ce30bf0, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:37.748363 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5bfa6-f685-4e3e-b35f-45b710dc3305 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:37.858633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b770f867-9bad-49d5-94a2-7759d931115a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dcdf47dd44344e4b9015aa04801d7fa'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:37.901180 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:37.908650 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 972/1967] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:37 2022] PUT /identity/v3/projects/600cc2fab14d44c8b011ba144c82d0ce/users/991ff4722e32473584b1c4245ce30bf0/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:37.909626 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5bfa6-f685-4e3e-b35f-45b710dc3305 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:37.911263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-40e5bfa6-f685-4e3e-b35f-45b710dc3305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:37.958269 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b770f867-9bad-49d5-94a2-7759d931115a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dcdf47dd44344e4b9015aa04801d7fa'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:37.959250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b770f867-9bad-49d5-94a2-7759d931115a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dcdf47dd44344e4b9015aa04801d7fa'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:37.960374 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b770f867-9bad-49d5-94a2-7759d931115a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dcdf47dd44344e4b9015aa04801d7fa'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:37.973676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b770f867-9bad-49d5-94a2-7759d931115a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dcdf47dd44344e4b9015aa04801d7fa'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:37.995612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5bfa6-f685-4e3e-b35f-45b710dc3305 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:37.997341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 996/1968] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:37 2022] DELETE /identity/v3/users/2dcdf47dd44344e4b9015aa04801d7fa => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:38.001713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770f867-9bad-49d5-94a2-7759d931115a admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:38.003227 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b770f867-9bad-49d5-94a2-7759d931115a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:38.092104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770f867-9bad-49d5-94a2-7759d931115a admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:38.098491 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea383368-4479-4c7c-a817-195ba37ed4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:38.103282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a890a-44fa-41ae-b4c3-c9726632973d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:38.103873 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea383368-4479-4c7c-a817-195ba37ed4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:38.104033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a890a-44fa-41ae-b4c3-c9726632973d admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:38.104185 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea383368-4479-4c7c-a817-195ba37ed4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:38.104335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a890a-44fa-41ae-b4c3-c9726632973d admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:38.104501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea383368-4479-4c7c-a817-195ba37ed4ca admin admin] PATH_INFO: `/v3/users/a8ef2ddb003447058053013a0d2bb9fb` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:38.104652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a890a-44fa-41ae-b4c3-c9726632973d admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:38.104652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a890a-44fa-41ae-b4c3-c9726632973d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:38.104927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea383368-4479-4c7c-a817-195ba37ed4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ef2ddb003447058053013a0d2bb9fb)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:38.105077 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a890a-44fa-41ae-b4c3-c9726632973d admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:38.105238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea383368-4479-4c7c-a817-195ba37ed4ca admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:38.121549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 997/1969] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:38.126259 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a890a-44fa-41ae-b4c3-c9726632973d admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:38.141524 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a890a-44fa-41ae-b4c3-c9726632973d admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:38.158920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47616d0-f5d6-41d0-b409-b6d8c1c9c887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:38.158920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47616d0-f5d6-41d0-b409-b6d8c1c9c887 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:38.158920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47616d0-f5d6-41d0-b409-b6d8c1c9c887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:38.158920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47616d0-f5d6-41d0-b409-b6d8c1c9c887 admin admin] PATH_INFO: `/v3/projects/600cc2fab14d44c8b011ba144c82d0ce/users/991ff4722e32473584b1c4245ce30bf0/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:38.159707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47616d0-f5d6-41d0-b409-b6d8c1c9c887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=600cc2fab14d44c8b011ba144c82d0ce, user_id=991ff4722e32473584b1c4245ce30bf0, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:38.159707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47616d0-f5d6-41d0-b409-b6d8c1c9c887 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:38.182279 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 998/1970] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:38 2022] PUT /identity/v3/projects/600cc2fab14d44c8b011ba144c82d0ce/users/991ff4722e32473584b1c4245ce30bf0/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:38.202413 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6f61b-2bae-41b5-9de7-b6d198e60ea0 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:38.203336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6f61b-2bae-41b5-9de7-b6d198e60ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:38.203954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6f61b-2bae-41b5-9de7-b6d198e60ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:38.241374 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-49d6f61b-2bae-41b5-9de7-b6d198e60ea0 None None] MFA Rules not processed for user `991ff4722e32473584b1c4245ce30bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:38.242790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-49d6f61b-2bae-41b5-9de7-b6d198e60ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:38.354994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 999/1971] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:38.380689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6f61b-2bae-41b5-9de7-b6d198e60ea0 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:38.382593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-49d6f61b-2bae-41b5-9de7-b6d198e60ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:38.401683 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:38.421607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ea383368-4479-4c7c-a817-195ba37ed4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ef2ddb003447058053013a0d2bb9fb'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:38.427735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ea383368-4479-4c7c-a817-195ba37ed4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ef2ddb003447058053013a0d2bb9fb'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:38.459202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ea383368-4479-4c7c-a817-195ba37ed4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ef2ddb003447058053013a0d2bb9fb'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:38.498676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ea383368-4479-4c7c-a817-195ba37ed4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ef2ddb003447058053013a0d2bb9fb'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:38.500394 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ea383368-4479-4c7c-a817-195ba37ed4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ef2ddb003447058053013a0d2bb9fb'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:38.547617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6f61b-2bae-41b5-9de7-b6d198e60ea0 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:38.562609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279def75-c270-4889-abba-20a28f8c36f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:38.563434 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279def75-c270-4889-abba-20a28f8c36f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:38.563839 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279def75-c270-4889-abba-20a28f8c36f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:38.564212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279def75-c270-4889-abba-20a28f8c36f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:38.572843 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-279def75-c270-4889-abba-20a28f8c36f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:38.595212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279def75-c270-4889-abba-20a28f8c36f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:38.597483 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279def75-c270-4889-abba-20a28f8c36f6 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:38.611229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 973/1972] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:37 2022] DELETE /identity/v3/users/a8ef2ddb003447058053013a0d2bb9fb => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:38.617565 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066dc20-3144-48a9-ac85-d4ae98bb3f4d None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:38.618138 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066dc20-3144-48a9-ac85-d4ae98bb3f4d None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:38.618645 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066dc20-3144-48a9-ac85-d4ae98bb3f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:38.620616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1000/1973] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:51:38.649581 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-8066dc20-3144-48a9-ac85-d4ae98bb3f4d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:38.656390 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-8066dc20-3144-48a9-ac85-d4ae98bb3f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:38.950331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 974/1974] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:38.952096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279def75-c270-4889-abba-20a28f8c36f6 service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:38.952096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-279def75-c270-4889-abba-20a28f8c36f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:38.952096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279def75-c270-4889-abba-20a28f8c36f6 service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:38.952570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ba8c4-8e8e-44da-b97f-785a32ca275d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:38.952570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ba8c4-8e8e-44da-b97f-785a32ca275d service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:38.952570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ba8c4-8e8e-44da-b97f-785a32ca275d service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:38.952570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ba8c4-8e8e-44da-b97f-785a32ca275d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:38.953143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ba8c4-8e8e-44da-b97f-785a32ca275d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:38.953143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ba8c4-8e8e-44da-b97f-785a32ca275d service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:38.953143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1001/1975] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:38.997784 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066dc20-3144-48a9-ac85-d4ae98bb3f4d None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:38.998301 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-8066dc20-3144-48a9-ac85-d4ae98bb3f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:39.011721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066dc20-3144-48a9-ac85-d4ae98bb3f4d None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:39.025960 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6991c5-c8cf-4a6e-8f67-c4a78fe26564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:39.031993 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6991c5-c8cf-4a6e-8f67-c4a78fe26564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:39.031993 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6991c5-c8cf-4a6e-8f67-c4a78fe26564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:39.031993 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6991c5-c8cf-4a6e-8f67-c4a78fe26564 admin admin] PATH_INFO: `/v3/projects/a4517b880a0f49019ca45a91b6b786a0` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:39.031993 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6991c5-c8cf-4a6e-8f67-c4a78fe26564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4517b880a0f49019ca45a91b6b786a0)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:39.035264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6991c5-c8cf-4a6e-8f67-c4a78fe26564 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:39.057816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ba8c4-8e8e-44da-b97f-785a32ca275d service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:39.059409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-956ba8c4-8e8e-44da-b97f-785a32ca275d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:39.120997 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:39.135425 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ba8c4-8e8e-44da-b97f-785a32ca275d service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:39.139848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590f568-76d3-4364-b3e0-572d647472ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:39.140478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590f568-76d3-4364-b3e0-572d647472ba service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:39.140759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590f568-76d3-4364-b3e0-572d647472ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:39.141031 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590f568-76d3-4364-b3e0-572d647472ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:39.142967 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a590f568-76d3-4364-b3e0-572d647472ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:39.211813 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590f568-76d3-4364-b3e0-572d647472ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:39.213288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590f568-76d3-4364-b3e0-572d647472ba service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:39.224861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1002/1976] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:51:39.237515 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ba6991c5-c8cf-4a6e-8f67-c4a78fe26564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4517b880a0f49019ca45a91b6b786a0', 'request_id': 'req-ba6991c5-c8cf-4a6e-8f67-c4a78fe26564'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:39.379058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ba6991c5-c8cf-4a6e-8f67-c4a78fe26564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4517b880a0f49019ca45a91b6b786a0', 'request_id': 'req-ba6991c5-c8cf-4a6e-8f67-c4a78fe26564'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:39.390703 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ba6991c5-c8cf-4a6e-8f67-c4a78fe26564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4517b880a0f49019ca45a91b6b786a0', 'request_id': 'req-ba6991c5-c8cf-4a6e-8f67-c4a78fe26564'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:39.413356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ba6991c5-c8cf-4a6e-8f67-c4a78fe26564 admin admin] The token cache is being invalidate because project a4517b880a0f49019ca45a91b6b786a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:39.417281 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ba6991c5-c8cf-4a6e-8f67-c4a78fe26564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:39.417281 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ba6991c5-c8cf-4a6e-8f67-c4a78fe26564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:39.422285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 975/1977] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:38 2022] DELETE /identity/v3/projects/a4517b880a0f49019ca45a91b6b786a0 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:39.426235 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bb4e3-f2ec-44c0-895e-81eba239aa4e None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:39.426683 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bb4e3-f2ec-44c0-895e-81eba239aa4e None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:39.427102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bb4e3-f2ec-44c0-895e-81eba239aa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:39.468199 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-028bb4e3-f2ec-44c0-895e-81eba239aa4e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:39.471509 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-028bb4e3-f2ec-44c0-895e-81eba239aa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:39.590484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1003/1978] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:39.600205 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc83c6d-a20e-49e6-8fd3-327cda6c4834 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:39.600205 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc83c6d-a20e-49e6-8fd3-327cda6c4834 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:39.603122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc83c6d-a20e-49e6-8fd3-327cda6c4834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:39.625263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-8cc83c6d-a20e-49e6-8fd3-327cda6c4834 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:39.626587 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-8cc83c6d-a20e-49e6-8fd3-327cda6c4834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:39.635289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 976/1979] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:39.647888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bb4e3-f2ec-44c0-895e-81eba239aa4e None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:39.652918 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bb4e3-f2ec-44c0-895e-81eba239aa4e None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:39.660415 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d8cfb-b85b-4a3e-b1f1-6a833f34f5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:39.661697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d8cfb-b85b-4a3e-b1f1-6a833f34f5fc admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:39.662179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d8cfb-b85b-4a3e-b1f1-6a833f34f5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:39.662920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d8cfb-b85b-4a3e-b1f1-6a833f34f5fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:39.664023 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d8cfb-b85b-4a3e-b1f1-6a833f34f5fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:51:39.664507 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d8cfb-b85b-4a3e-b1f1-6a833f34f5fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:39.667402 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d8cfb-b85b-4a3e-b1f1-6a833f34f5fc admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:39.699056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1004/1980] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:51:39.702542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc83c6d-a20e-49e6-8fd3-327cda6c4834 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:39.712405 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc83c6d-a20e-49e6-8fd3-327cda6c4834 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:39.718519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c510e-82ba-41b8-bbeb-3936a9e9d77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:39.719220 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c510e-82ba-41b8-bbeb-3936a9e9d77b admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:39.719527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c510e-82ba-41b8-bbeb-3936a9e9d77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:39.719809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c510e-82ba-41b8-bbeb-3936a9e9d77b admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:39.720471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c510e-82ba-41b8-bbeb-3936a9e9d77b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:39.722356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c510e-82ba-41b8-bbeb-3936a9e9d77b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:39.739368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d8cfb-b85b-4a3e-b1f1-6a833f34f5fc admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:39.741561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-230d8cfb-b85b-4a3e-b1f1-6a833f34f5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:39.756988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d8cfb-b85b-4a3e-b1f1-6a833f34f5fc admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:39.761944 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88922c70-9e37-4d70-b629-9f5f52736df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:39.762635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88922c70-9e37-4d70-b629-9f5f52736df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:39.762964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88922c70-9e37-4d70-b629-9f5f52736df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:39.763317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88922c70-9e37-4d70-b629-9f5f52736df7 admin admin] PATH_INFO: `/v3/projects/64ba5080e110487d887d6f9a4e5a2135` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:39.765005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88922c70-9e37-4d70-b629-9f5f52736df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ba5080e110487d887d6f9a4e5a2135)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:39.766938 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88922c70-9e37-4d70-b629-9f5f52736df7 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:39.944055 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 977/1981] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:39 2022] POST /identity/v3/projects => generated 383 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:39.952180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c510e-82ba-41b8-bbeb-3936a9e9d77b admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:39.959970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-88922c70-9e37-4d70-b629-9f5f52736df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ba5080e110487d887d6f9a4e5a2135', 'request_id': 'req-88922c70-9e37-4d70-b629-9f5f52736df7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:39.967791 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-88922c70-9e37-4d70-b629-9f5f52736df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ba5080e110487d887d6f9a4e5a2135', 'request_id': 'req-88922c70-9e37-4d70-b629-9f5f52736df7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:40.049772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-88922c70-9e37-4d70-b629-9f5f52736df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ba5080e110487d887d6f9a4e5a2135', 'request_id': 'req-88922c70-9e37-4d70-b629-9f5f52736df7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:40.065865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c510e-82ba-41b8-bbeb-3936a9e9d77b admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:40.072280 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-88922c70-9e37-4d70-b629-9f5f52736df7 admin admin] The token cache is being invalidate because project 64ba5080e110487d887d6f9a4e5a2135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:40.072691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-88922c70-9e37-4d70-b629-9f5f52736df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:40.077535 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-88922c70-9e37-4d70-b629-9f5f52736df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:40.079595 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4310f76-fbb8-4716-bf0f-99dd54afabd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:40.080195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1005/1982] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:39 2022] DELETE /identity/v3/projects/64ba5080e110487d887d6f9a4e5a2135 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:40.080666 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4310f76-fbb8-4716-bf0f-99dd54afabd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:40.081423 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4310f76-fbb8-4716-bf0f-99dd54afabd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:40.082086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4310f76-fbb8-4716-bf0f-99dd54afabd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:40.084211 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88922c70-9e37-4d70-b629-9f5f52736df7 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:40.085354 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4310f76-fbb8-4716-bf0f-99dd54afabd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:40.086300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-88922c70-9e37-4d70-b629-9f5f52736df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:40.089434 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4310f76-fbb8-4716-bf0f-99dd54afabd4 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:40.191791 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88922c70-9e37-4d70-b629-9f5f52736df7 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:40.198511 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fb83c-7138-4aac-95ea-0d6b988bf63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:40.199589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fb83c-7138-4aac-95ea-0d6b988bf63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:40.200103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fb83c-7138-4aac-95ea-0d6b988bf63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:40.209888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fb83c-7138-4aac-95ea-0d6b988bf63e admin admin] PATH_INFO: `/v3/users/c4d52a833f31417e94c13f92f2c940ad` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:40.209888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fb83c-7138-4aac-95ea-0d6b988bf63e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d52a833f31417e94c13f92f2c940ad)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:40.209888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fb83c-7138-4aac-95ea-0d6b988bf63e admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:40.224397 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 978/1983] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:39 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:40.229454 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4310f76-fbb8-4716-bf0f-99dd54afabd4 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:40.232342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-e4310f76-fbb8-4716-bf0f-99dd54afabd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:40.249214 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4310f76-fbb8-4716-bf0f-99dd54afabd4 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:40.259020 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479e4ad-5744-4257-b894-804ed0fdf0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:40.259727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:40.260368 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479e4ad-5744-4257-b894-804ed0fdf0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:40.260588 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479e4ad-5744-4257-b894-804ed0fdf0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:40.260922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479e4ad-5744-4257-b894-804ed0fdf0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:40.261758 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479e4ad-5744-4257-b894-804ed0fdf0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:40.267243 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479e4ad-5744-4257-b894-804ed0fdf0e4 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:40.275697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 979/1984] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:40.279811 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479e4ad-5744-4257-b894-804ed0fdf0e4 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:40.289943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479e4ad-5744-4257-b894-804ed0fdf0e4 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:40.295390 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a37a8-4f41-4246-a35e-5f4343181844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:40.296251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a37a8-4f41-4246-a35e-5f4343181844 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:40.296687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a37a8-4f41-4246-a35e-5f4343181844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:40.296970 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a37a8-4f41-4246-a35e-5f4343181844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:40.297662 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a37a8-4f41-4246-a35e-5f4343181844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:40.299298 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a37a8-4f41-4246-a35e-5f4343181844 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:40.312599 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 980/1985] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:40.322799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a37a8-4f41-4246-a35e-5f4343181844 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:40.336320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a37a8-4f41-4246-a35e-5f4343181844 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:40.342332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4287c-1274-44e4-8032-fddd36f96d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:40.343309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4287c-1274-44e4-8032-fddd36f96d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:40.343786 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4287c-1274-44e4-8032-fddd36f96d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:40.344196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4287c-1274-44e4-8032-fddd36f96d46 admin admin] PATH_INFO: `/v3/projects/0efcc1fbeaff480c82c8d6a747777998/users/e84c314f43724c4ba7d983ac6e72ec66/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:40.362614 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4287c-1274-44e4-8032-fddd36f96d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0efcc1fbeaff480c82c8d6a747777998, user_id=e84c314f43724c4ba7d983ac6e72ec66, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:40.366029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4287c-1274-44e4-8032-fddd36f96d46 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:40.475631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 981/1986] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:40 2022] PUT /identity/v3/projects/0efcc1fbeaff480c82c8d6a747777998/users/e84c314f43724c4ba7d983ac6e72ec66/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:40.481294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c01fb83c-7138-4aac-95ea-0d6b988bf63e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d52a833f31417e94c13f92f2c940ad'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:40.481715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffb24b-6543-40e2-b51e-73db818abfcb None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:40.483851 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffb24b-6543-40e2-b51e-73db818abfcb None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:40.484217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffb24b-6543-40e2-b51e-73db818abfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:40.521611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-c3ffb24b-6543-40e2-b51e-73db818abfcb None None] MFA Rules not processed for user `e84c314f43724c4ba7d983ac6e72ec66`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:40.522879 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c3ffb24b-6543-40e2-b51e-73db818abfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:40.601320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 982/1987] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:40.606058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffb24b-6543-40e2-b51e-73db818abfcb None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:40.620419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c01fb83c-7138-4aac-95ea-0d6b988bf63e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d52a833f31417e94c13f92f2c940ad'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:40.624013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c01fb83c-7138-4aac-95ea-0d6b988bf63e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d52a833f31417e94c13f92f2c940ad'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:40.624013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c01fb83c-7138-4aac-95ea-0d6b988bf63e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d52a833f31417e94c13f92f2c940ad'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:40.632409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c01fb83c-7138-4aac-95ea-0d6b988bf63e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d52a833f31417e94c13f92f2c940ad'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:40.652422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1006/1988] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:40 2022] DELETE /identity/v3/users/c4d52a833f31417e94c13f92f2c940ad => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:40.687951 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffb24b-6543-40e2-b51e-73db818abfcb None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:40.789613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b28a3-f15e-43e8-beb3-4844f089c1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:40.790780 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b28a3-f15e-43e8-beb3-4844f089c1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:40.791181 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b28a3-f15e-43e8-beb3-4844f089c1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:40.791615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b28a3-f15e-43e8-beb3-4844f089c1c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:40.792649 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b28a3-f15e-43e8-beb3-4844f089c1c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:40.796332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b28a3-f15e-43e8-beb3-4844f089c1c7 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:40.917692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 983/1989] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:40 2022] POST /identity/v3/projects => generated 385 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:51:40.922334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fb83c-7138-4aac-95ea-0d6b988bf63e admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:40.924023 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c01fb83c-7138-4aac-95ea-0d6b988bf63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:40.939679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fb83c-7138-4aac-95ea-0d6b988bf63e admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:41.022487 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338d998-0a8b-48be-b058-67d0648dd3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:41.023237 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338d998-0a8b-48be-b058-67d0648dd3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:41.023675 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338d998-0a8b-48be-b058-67d0648dd3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:41.023954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338d998-0a8b-48be-b058-67d0648dd3a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:41.024643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338d998-0a8b-48be-b058-67d0648dd3a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:41.026662 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338d998-0a8b-48be-b058-67d0648dd3a8 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:41.207528 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1007/1990] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:40 2022] POST /identity/v3/users => generated 299 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:51:41.210679 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b28a3-f15e-43e8-beb3-4844f089c1c7 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:41.227668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b28a3-f15e-43e8-beb3-4844f089c1c7 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:41.234676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d8475-f41f-4051-9ac1-777baf9295ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:41.235701 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d8475-f41f-4051-9ac1-777baf9295ae admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:41.236076 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d8475-f41f-4051-9ac1-777baf9295ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:41.236500 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d8475-f41f-4051-9ac1-777baf9295ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:41.237436 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d8475-f41f-4051-9ac1-777baf9295ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:41.239361 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d8475-f41f-4051-9ac1-777baf9295ae admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:41.265789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 984/1991] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:41.271785 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338d998-0a8b-48be-b058-67d0648dd3a8 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:41.272095 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d8475-f41f-4051-9ac1-777baf9295ae admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:41.275165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-6338d998-0a8b-48be-b058-67d0648dd3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:41.293169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d8475-f41f-4051-9ac1-777baf9295ae admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:41.307350 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b171c67-eb92-4692-b3bc-ea4af268db74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:41.309763 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171c67-eb92-4692-b3bc-ea4af268db74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:41.309763 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171c67-eb92-4692-b3bc-ea4af268db74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:41.309763 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171c67-eb92-4692-b3bc-ea4af268db74 admin admin] PATH_INFO: `/v3/projects/baf0291351b246f58815f1190d67c6af/users/4545face9b5e4c1898438beb57856d05/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:41.328168 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338d998-0a8b-48be-b058-67d0648dd3a8 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:41.344398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739d6aa-ae10-4710-88b6-f48f8d103b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:41.344398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739d6aa-ae10-4710-88b6-f48f8d103b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:41.344398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739d6aa-ae10-4710-88b6-f48f8d103b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:41.344398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739d6aa-ae10-4710-88b6-f48f8d103b91 admin admin] PATH_INFO: `/v3/projects/3b05ec80cbc44384a84a3075a8a35293` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:41.349603 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739d6aa-ae10-4710-88b6-f48f8d103b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b05ec80cbc44384a84a3075a8a35293)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:41.350429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b171c67-eb92-4692-b3bc-ea4af268db74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baf0291351b246f58815f1190d67c6af, user_id=4545face9b5e4c1898438beb57856d05, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:41.350571 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739d6aa-ae10-4710-88b6-f48f8d103b91 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:41.354491 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b171c67-eb92-4692-b3bc-ea4af268db74 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:41.480679 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 985/1992] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:41 2022] PUT /identity/v3/projects/baf0291351b246f58815f1190d67c6af/users/4545face9b5e4c1898438beb57856d05/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:41.488417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b171c67-eb92-4692-b3bc-ea4af268db74 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:41.559126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d739d6aa-ae10-4710-88b6-f48f8d103b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b05ec80cbc44384a84a3075a8a35293', 'request_id': 'req-d739d6aa-ae10-4710-88b6-f48f8d103b91'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:41.571603 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d739d6aa-ae10-4710-88b6-f48f8d103b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b05ec80cbc44384a84a3075a8a35293', 'request_id': 'req-d739d6aa-ae10-4710-88b6-f48f8d103b91'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:41.596586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b171c67-eb92-4692-b3bc-ea4af268db74 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:41.659620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d739d6aa-ae10-4710-88b6-f48f8d103b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b05ec80cbc44384a84a3075a8a35293', 'request_id': 'req-d739d6aa-ae10-4710-88b6-f48f8d103b91'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:41.679258 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d739d6aa-ae10-4710-88b6-f48f8d103b91 admin admin] The token cache is being invalidate because project 3b05ec80cbc44384a84a3075a8a35293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:41.679824 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d739d6aa-ae10-4710-88b6-f48f8d103b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:41.680935 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d739d6aa-ae10-4710-88b6-f48f8d103b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:41.683152 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1008/1993] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:41 2022] DELETE /identity/v3/projects/3b05ec80cbc44384a84a3075a8a35293 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:41.689168 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4a0db-6008-4d70-bdc4-f40e765ef550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:41.689937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84756e09-fdf4-433a-add2-9fb8ed2152d5 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:41.690104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84756e09-fdf4-433a-add2-9fb8ed2152d5 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:41.690236 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4a0db-6008-4d70-bdc4-f40e765ef550 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:41.690659 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84756e09-fdf4-433a-add2-9fb8ed2152d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:41.690815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4a0db-6008-4d70-bdc4-f40e765ef550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:41.691179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4a0db-6008-4d70-bdc4-f40e765ef550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:41.692444 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4a0db-6008-4d70-bdc4-f40e765ef550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:41.695307 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4a0db-6008-4d70-bdc4-f40e765ef550 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:41.710286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:41.717631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-84756e09-fdf4-433a-add2-9fb8ed2152d5 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:41.721599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-84756e09-fdf4-433a-add2-9fb8ed2152d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:41.721743 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 986/1994] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:41.726349 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4a0db-6008-4d70-bdc4-f40e765ef550 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:41.728727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-78a4a0db-6008-4d70-bdc4-f40e765ef550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:41.734228 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1009/1995] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:41.743975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0ce20-2bb0-475d-8854-46cfcf6ecf42 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:41.744257 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0ce20-2bb0-475d-8854-46cfcf6ecf42 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:41.744588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0ce20-2bb0-475d-8854-46cfcf6ecf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:41.745136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4a0db-6008-4d70-bdc4-f40e765ef550 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:41.759076 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017d47f-f8a0-4e81-84fe-ea48ff3d8abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:41.759797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017d47f-f8a0-4e81-84fe-ea48ff3d8abb admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:41.760142 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017d47f-f8a0-4e81-84fe-ea48ff3d8abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:41.760427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017d47f-f8a0-4e81-84fe-ea48ff3d8abb admin admin] PATH_INFO: `/v3/projects/baf0291351b246f58815f1190d67c6af/users/4545face9b5e4c1898438beb57856d05/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:41.762629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017d47f-f8a0-4e81-84fe-ea48ff3d8abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=baf0291351b246f58815f1190d67c6af, user_id=4545face9b5e4c1898438beb57856d05, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:41.766126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017d47f-f8a0-4e81-84fe-ea48ff3d8abb admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:41.780228 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 987/1996] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:41 2022] PUT /identity/v3/projects/baf0291351b246f58815f1190d67c6af/users/4545face9b5e4c1898438beb57856d05/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:41.792441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739a28d-3fea-4fd1-a022-3c1f972706e9 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:41.792797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739a28d-3fea-4fd1-a022-3c1f972706e9 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:41.793136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739a28d-3fea-4fd1-a022-3c1f972706e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:41.799033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-52c0ce20-2bb0-475d-8854-46cfcf6ecf42 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:41.801833 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-52c0ce20-2bb0-475d-8854-46cfcf6ecf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:41.845126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-9739a28d-3fea-4fd1-a022-3c1f972706e9 None None] MFA Rules not processed for user `4545face9b5e4c1898438beb57856d05`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:41.847161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-9739a28d-3fea-4fd1-a022-3c1f972706e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:41.954500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1010/1997] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:41.961328 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0ce20-2bb0-475d-8854-46cfcf6ecf42 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:41.972963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0ce20-2bb0-475d-8854-46cfcf6ecf42 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:41.978734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58f7ca-0a92-498e-ad85-9cd87a6121a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:41.979534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58f7ca-0a92-498e-ad85-9cd87a6121a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:41.979822 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58f7ca-0a92-498e-ad85-9cd87a6121a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:41.979986 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 988/1998] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:41.980144 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58f7ca-0a92-498e-ad85-9cd87a6121a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:41.980750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58f7ca-0a92-498e-ad85-9cd87a6121a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:51:41.981064 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58f7ca-0a92-498e-ad85-9cd87a6121a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:41.983079 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58f7ca-0a92-498e-ad85-9cd87a6121a6 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:41.996787 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1011/1999] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:51:42.009278 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739a28d-3fea-4fd1-a022-3c1f972706e9 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:42.015102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739a28d-3fea-4fd1-a022-3c1f972706e9 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:42.020297 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58f7ca-0a92-498e-ad85-9cd87a6121a6 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:42.022325 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05330ba-351a-489d-80c0-f9cfd6f3298c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:42.022764 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-4b58f7ca-0a92-498e-ad85-9cd87a6121a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:42.023176 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05330ba-351a-489d-80c0-f9cfd6f3298c admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:42.023752 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05330ba-351a-489d-80c0-f9cfd6f3298c admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:42.024144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05330ba-351a-489d-80c0-f9cfd6f3298c admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:42.034123 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05330ba-351a-489d-80c0-f9cfd6f3298c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:42.041335 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05330ba-351a-489d-80c0-f9cfd6f3298c admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:42.105207 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58f7ca-0a92-498e-ad85-9cd87a6121a6 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:42.110503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189953a-5010-4a48-862c-25f24fece4c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:42.111070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189953a-5010-4a48-862c-25f24fece4c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:42.111384 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189953a-5010-4a48-862c-25f24fece4c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:42.111715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189953a-5010-4a48-862c-25f24fece4c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:42.114661 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c189953a-5010-4a48-862c-25f24fece4c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:42.182630 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 989/2000] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:42 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:51:42.187603 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05330ba-351a-489d-80c0-f9cfd6f3298c admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:42.214999 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189953a-5010-4a48-862c-25f24fece4c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:42.217724 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189953a-5010-4a48-862c-25f24fece4c5 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:42.229956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1012/2001] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:42.262498 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05330ba-351a-489d-80c0-f9cfd6f3298c admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:42.269053 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b98f8-a8e2-4243-8d65-12e99bc86e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:42.269693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b98f8-a8e2-4243-8d65-12e99bc86e13 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:42.270004 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b98f8-a8e2-4243-8d65-12e99bc86e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:42.270279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b98f8-a8e2-4243-8d65-12e99bc86e13 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:42.270927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b98f8-a8e2-4243-8d65-12e99bc86e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:42.273099 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b98f8-a8e2-4243-8d65-12e99bc86e13 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:42.410638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 990/2002] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:42 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:42.415144 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189953a-5010-4a48-862c-25f24fece4c5 service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:42.430679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189953a-5010-4a48-862c-25f24fece4c5 service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:42.433459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:42.441941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2892f-73c7-47cf-b55e-c963bbfd047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:42.442968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2892f-73c7-47cf-b55e-c963bbfd047e admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:42.443398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2892f-73c7-47cf-b55e-c963bbfd047e admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:42.443872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2892f-73c7-47cf-b55e-c963bbfd047e admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:42.444673 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2892f-73c7-47cf-b55e-c963bbfd047e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:42.447127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2892f-73c7-47cf-b55e-c963bbfd047e admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:42.465226 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1013/2003] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:42.469932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b98f8-a8e2-4243-8d65-12e99bc86e13 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:42.496984 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b98f8-a8e2-4243-8d65-12e99bc86e13 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:42.504427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612630c5-c91f-4bda-91b6-4e76490740be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:42.505310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612630c5-c91f-4bda-91b6-4e76490740be admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:42.505930 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612630c5-c91f-4bda-91b6-4e76490740be admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:42.506232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612630c5-c91f-4bda-91b6-4e76490740be admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:42.506878 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612630c5-c91f-4bda-91b6-4e76490740be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:42.508583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612630c5-c91f-4bda-91b6-4e76490740be admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:42.523217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 991/2004] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:42.528454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2892f-73c7-47cf-b55e-c963bbfd047e admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:42.542850 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2892f-73c7-47cf-b55e-c963bbfd047e admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:42.551755 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedb3bc-69b1-414f-a5ed-20fae4fedead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:42.551755 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedb3bc-69b1-414f-a5ed-20fae4fedead admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:42.552154 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedb3bc-69b1-414f-a5ed-20fae4fedead admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:42.552600 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedb3bc-69b1-414f-a5ed-20fae4fedead admin admin] PATH_INFO: `/v3/projects/ba2de5255a6f4cccbfd1c89af52dfa61/users/0ff74c55fbb44cda8c014eae451c7681/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:42.580067 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedb3bc-69b1-414f-a5ed-20fae4fedead admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba2de5255a6f4cccbfd1c89af52dfa61, user_id=0ff74c55fbb44cda8c014eae451c7681, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:42.582744 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedb3bc-69b1-414f-a5ed-20fae4fedead admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:42.702355 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1014/2005] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:42 2022] PUT /identity/v3/projects/ba2de5255a6f4cccbfd1c89af52dfa61/users/0ff74c55fbb44cda8c014eae451c7681/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:42.713014 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d402f-d3fa-49ad-8f82-e3758d11e274 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:42.713553 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d402f-d3fa-49ad-8f82-e3758d11e274 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:42.713553 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d402f-d3fa-49ad-8f82-e3758d11e274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:42.752512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-cc5d402f-d3fa-49ad-8f82-e3758d11e274 None None] MFA Rules not processed for user `0ff74c55fbb44cda8c014eae451c7681`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:42.754618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-cc5d402f-d3fa-49ad-8f82-e3758d11e274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:42.873912 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 992/2006] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:42.889189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedb3bc-69b1-414f-a5ed-20fae4fedead admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:42.957232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedb3bc-69b1-414f-a5ed-20fae4fedead admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:42.961311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20d825-31cd-4ba9-b217-1d6031930c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:42.965054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20d825-31cd-4ba9-b217-1d6031930c77 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:42.965054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20d825-31cd-4ba9-b217-1d6031930c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:42.965054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20d825-31cd-4ba9-b217-1d6031930c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:42.976220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20d825-31cd-4ba9-b217-1d6031930c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:42.978990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20d825-31cd-4ba9-b217-1d6031930c77 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:42.999753 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1015/2007] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:43.022302 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d402f-d3fa-49ad-8f82-e3758d11e274 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:43.088304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d402f-d3fa-49ad-8f82-e3758d11e274 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:43.094199 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a03d7e-6795-4aa4-a63e-57df9fbc62e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:43.094440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a03d7e-6795-4aa4-a63e-57df9fbc62e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:43.094707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a03d7e-6795-4aa4-a63e-57df9fbc62e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:43.094980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a03d7e-6795-4aa4-a63e-57df9fbc62e2 admin admin] PATH_INFO: `/v3/users/0ff74c55fbb44cda8c014eae451c7681` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:43.096185 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a03d7e-6795-4aa4-a63e-57df9fbc62e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff74c55fbb44cda8c014eae451c7681)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:43.103363 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a03d7e-6795-4aa4-a63e-57df9fbc62e2 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:43.547266 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b7a03d7e-6795-4aa4-a63e-57df9fbc62e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff74c55fbb44cda8c014eae451c7681'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:43.548120 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b7a03d7e-6795-4aa4-a63e-57df9fbc62e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff74c55fbb44cda8c014eae451c7681'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:43.557699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b7a03d7e-6795-4aa4-a63e-57df9fbc62e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff74c55fbb44cda8c014eae451c7681'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:43.585865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b7a03d7e-6795-4aa4-a63e-57df9fbc62e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff74c55fbb44cda8c014eae451c7681'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:43.587983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b7a03d7e-6795-4aa4-a63e-57df9fbc62e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff74c55fbb44cda8c014eae451c7681'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:43.778116 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 993/2008] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:43 2022] DELETE /identity/v3/users/0ff74c55fbb44cda8c014eae451c7681 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:43.784870 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbeb17a-5266-42f3-b8e1-7f4925d1a282 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:43.785857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbeb17a-5266-42f3-b8e1-7f4925d1a282 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:43.786307 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbeb17a-5266-42f3-b8e1-7f4925d1a282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:43.819415 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-9cbeb17a-5266-42f3-b8e1-7f4925d1a282 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:43.820894 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9cbeb17a-5266-42f3-b8e1-7f4925d1a282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:43.871428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a03d7e-6795-4aa4-a63e-57df9fbc62e2 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:43.874084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b7a03d7e-6795-4aa4-a63e-57df9fbc62e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:44.009263 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1016/2009] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:44.010292 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbeb17a-5266-42f3-b8e1-7f4925d1a282 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:44.018790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9cbeb17a-5266-42f3-b8e1-7f4925d1a282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:44.040687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a03d7e-6795-4aa4-a63e-57df9fbc62e2 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:44.047545 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8060dd-4801-4609-bda2-51ff4795ee21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:44.048177 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8060dd-4801-4609-bda2-51ff4795ee21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:44.048459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8060dd-4801-4609-bda2-51ff4795ee21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:44.048737 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8060dd-4801-4609-bda2-51ff4795ee21 admin admin] PATH_INFO: `/v3/users/0017c51598094459a50687dc5bf3ea11` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:44.049962 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8060dd-4801-4609-bda2-51ff4795ee21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0017c51598094459a50687dc5bf3ea11)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:44.052001 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8060dd-4801-4609-bda2-51ff4795ee21 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:44.121635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbeb17a-5266-42f3-b8e1-7f4925d1a282 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:44.127409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157bad7-3b20-4a64-82e6-a5ec02c84203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:44.128133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157bad7-3b20-4a64-82e6-a5ec02c84203 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:44.128420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157bad7-3b20-4a64-82e6-a5ec02c84203 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:44.128697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157bad7-3b20-4a64-82e6-a5ec02c84203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:44.141976 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157bad7-3b20-4a64-82e6-a5ec02c84203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:44.143535 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157bad7-3b20-4a64-82e6-a5ec02c84203 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:44.155774 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1017/2010] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:44.294238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:44.429012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:44.461302 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-9b8060dd-4801-4609-bda2-51ff4795ee21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0017c51598094459a50687dc5bf3ea11'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:44.462939 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-9b8060dd-4801-4609-bda2-51ff4795ee21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0017c51598094459a50687dc5bf3ea11'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:44.486859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-9b8060dd-4801-4609-bda2-51ff4795ee21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0017c51598094459a50687dc5bf3ea11'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:44.509891 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-9b8060dd-4801-4609-bda2-51ff4795ee21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0017c51598094459a50687dc5bf3ea11'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:44.510639 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-9b8060dd-4801-4609-bda2-51ff4795ee21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0017c51598094459a50687dc5bf3ea11'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:44.630392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 994/2011] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:43 2022] DELETE /identity/v3/users/0017c51598094459a50687dc5bf3ea11 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:44.630514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da1916-04c4-472f-936e-06edeaea3b43 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:44.630514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da1916-04c4-472f-936e-06edeaea3b43 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:44.630514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da1916-04c4-472f-936e-06edeaea3b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:44.664644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-e8da1916-04c4-472f-936e-06edeaea3b43 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:44.666839 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e8da1916-04c4-472f-936e-06edeaea3b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:44.750606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8060dd-4801-4609-bda2-51ff4795ee21 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:44.756849 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-9b8060dd-4801-4609-bda2-51ff4795ee21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:44.775003 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1018/2012] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:44.780135 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8060dd-4801-4609-bda2-51ff4795ee21 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:44.787193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da1916-04c4-472f-936e-06edeaea3b43 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:44.787758 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62124a-d9a7-4f3d-a1d4-704266dc7ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:44.787758 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62124a-d9a7-4f3d-a1d4-704266dc7ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:44.787758 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62124a-d9a7-4f3d-a1d4-704266dc7ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:44.788061 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e8da1916-04c4-472f-936e-06edeaea3b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:44.788149 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62124a-d9a7-4f3d-a1d4-704266dc7ba1 admin admin] PATH_INFO: `/v3/projects/ba2de5255a6f4cccbfd1c89af52dfa61` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:44.789214 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62124a-d9a7-4f3d-a1d4-704266dc7ba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba2de5255a6f4cccbfd1c89af52dfa61)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:44.791839 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62124a-d9a7-4f3d-a1d4-704266dc7ba1 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:44.866681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da1916-04c4-472f-936e-06edeaea3b43 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:44.870954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b8bfe-a53e-4e82-8fef-6e7d0e5f43ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:44.871632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b8bfe-a53e-4e82-8fef-6e7d0e5f43ef service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:44.871912 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b8bfe-a53e-4e82-8fef-6e7d0e5f43ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:44.872182 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b8bfe-a53e-4e82-8fef-6e7d0e5f43ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:44.888674 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b8bfe-a53e-4e82-8fef-6e7d0e5f43ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:44.890143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b8bfe-a53e-4e82-8fef-6e7d0e5f43ef service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:44.902512 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1019/2013] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:51:44.955329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-bc62124a-d9a7-4f3d-a1d4-704266dc7ba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba2de5255a6f4cccbfd1c89af52dfa61', 'request_id': 'req-bc62124a-d9a7-4f3d-a1d4-704266dc7ba1'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:45.038102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-bc62124a-d9a7-4f3d-a1d4-704266dc7ba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba2de5255a6f4cccbfd1c89af52dfa61', 'request_id': 'req-bc62124a-d9a7-4f3d-a1d4-704266dc7ba1'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:45.052039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-bc62124a-d9a7-4f3d-a1d4-704266dc7ba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba2de5255a6f4cccbfd1c89af52dfa61', 'request_id': 'req-bc62124a-d9a7-4f3d-a1d4-704266dc7ba1'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:45.074646 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-bc62124a-d9a7-4f3d-a1d4-704266dc7ba1 admin admin] The token cache is being invalidate because project ba2de5255a6f4cccbfd1c89af52dfa61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:45.074935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-bc62124a-d9a7-4f3d-a1d4-704266dc7ba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:45.076365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-bc62124a-d9a7-4f3d-a1d4-704266dc7ba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:45.077810 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 995/2014] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:44 2022] DELETE /identity/v3/projects/ba2de5255a6f4cccbfd1c89af52dfa61 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:45.084130 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747129ce-549e-4763-8aae-2d146434b6f2 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:45.084471 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747129ce-549e-4763-8aae-2d146434b6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:45.084683 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747129ce-549e-4763-8aae-2d146434b6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:45.108891 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-747129ce-549e-4763-8aae-2d146434b6f2 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:45.111143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-747129ce-549e-4763-8aae-2d146434b6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:45.271838 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1020/2015] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:45.274417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4642-a3dd-4f27-b547-b3a22189e20c None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:45.274832 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4642-a3dd-4f27-b547-b3a22189e20c None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:45.275208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4642-a3dd-4f27-b547-b3a22189e20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:45.298361 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-ea2d4642-a3dd-4f27-b547-b3a22189e20c None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:45.301832 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ea2d4642-a3dd-4f27-b547-b3a22189e20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:45.310531 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 996/2016] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:45.314577 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747129ce-549e-4763-8aae-2d146434b6f2 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:45.329335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747129ce-549e-4763-8aae-2d146434b6f2 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:45.342058 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d18088-4ca0-4a27-a1db-d9e5d588a3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:45.342910 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d18088-4ca0-4a27-a1db-d9e5d588a3bd admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:45.343521 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d18088-4ca0-4a27-a1db-d9e5d588a3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:45.343521 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d18088-4ca0-4a27-a1db-d9e5d588a3bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:45.344144 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d18088-4ca0-4a27-a1db-d9e5d588a3bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:51:45.344438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d18088-4ca0-4a27-a1db-d9e5d588a3bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:45.346085 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d18088-4ca0-4a27-a1db-d9e5d588a3bd admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:45.366964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1021/2017] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:51:45.369197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d4642-a3dd-4f27-b547-b3a22189e20c None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:45.381694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d4642-a3dd-4f27-b547-b3a22189e20c None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:45.387182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7469c2-4c37-476f-8ba1-d2a51d636ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:45.389301 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7469c2-4c37-476f-8ba1-d2a51d636ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:45.389301 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7469c2-4c37-476f-8ba1-d2a51d636ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:45.399076 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7469c2-4c37-476f-8ba1-d2a51d636ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:45.399076 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7469c2-4c37-476f-8ba1-d2a51d636ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:45.399076 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7469c2-4c37-476f-8ba1-d2a51d636ac1 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:45.549232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 997/2018] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:45 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:51:45.550511 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d18088-4ca0-4a27-a1db-d9e5d588a3bd admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:45.576804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d18088-4ca0-4a27-a1db-d9e5d588a3bd admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:45.752213 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5fee9-72a3-41c5-80ac-24529e5066b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:45.752989 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5fee9-72a3-41c5-80ac-24529e5066b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:45.753522 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5fee9-72a3-41c5-80ac-24529e5066b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:45.753893 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5fee9-72a3-41c5-80ac-24529e5066b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:45.754647 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5fee9-72a3-41c5-80ac-24529e5066b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:45.771376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7469c2-4c37-476f-8ba1-d2a51d636ac1 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:45.773279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-da7469c2-4c37-476f-8ba1-d2a51d636ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:45.777566 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5fee9-72a3-41c5-80ac-24529e5066b7 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:45.796358 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7469c2-4c37-476f-8ba1-d2a51d636ac1 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:45.801827 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c60409-bfad-41bb-a046-141115b37c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:45.805357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c60409-bfad-41bb-a046-141115b37c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:45.805357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c60409-bfad-41bb-a046-141115b37c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:45.805357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c60409-bfad-41bb-a046-141115b37c20 admin admin] PATH_INFO: `/v3/projects/1422490d2ee644dbb307686da8e22396` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:45.805357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c60409-bfad-41bb-a046-141115b37c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1422490d2ee644dbb307686da8e22396)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:45.807355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c60409-bfad-41bb-a046-141115b37c20 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:45.945854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1022/2019] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:45 2022] POST /identity/v3/users => generated 288 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:45.947614 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5fee9-72a3-41c5-80ac-24529e5066b7 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:45.974483 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5fee9-72a3-41c5-80ac-24529e5066b7 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:46.029634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-45c60409-bfad-41bb-a046-141115b37c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1422490d2ee644dbb307686da8e22396', 'request_id': 'req-45c60409-bfad-41bb-a046-141115b37c20'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:46.112932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-45c60409-bfad-41bb-a046-141115b37c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1422490d2ee644dbb307686da8e22396', 'request_id': 'req-45c60409-bfad-41bb-a046-141115b37c20'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:46.113587 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0ffc9-5171-4e86-a252-2fbfaff290ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:46.114637 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0ffc9-5171-4e86-a252-2fbfaff290ba admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:46.115073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0ffc9-5171-4e86-a252-2fbfaff290ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:46.116399 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0ffc9-5171-4e86-a252-2fbfaff290ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:46.117306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0ffc9-5171-4e86-a252-2fbfaff290ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:46.119623 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0ffc9-5171-4e86-a252-2fbfaff290ba admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:46.124540 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-45c60409-bfad-41bb-a046-141115b37c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1422490d2ee644dbb307686da8e22396', 'request_id': 'req-45c60409-bfad-41bb-a046-141115b37c20'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:46.137821 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1023/2020] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:46.144827 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0ffc9-5171-4e86-a252-2fbfaff290ba admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:46.153464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0ffc9-5171-4e86-a252-2fbfaff290ba admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:46.162945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc06d30-b977-499f-8bbb-c7ed7b025bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:46.171855 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc06d30-b977-499f-8bbb-c7ed7b025bef admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:46.172350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc06d30-b977-499f-8bbb-c7ed7b025bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:46.172709 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc06d30-b977-499f-8bbb-c7ed7b025bef admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:46.173621 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc06d30-b977-499f-8bbb-c7ed7b025bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:46.175405 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc06d30-b977-499f-8bbb-c7ed7b025bef admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:46.180860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-45c60409-bfad-41bb-a046-141115b37c20 admin admin] The token cache is being invalidate because project 1422490d2ee644dbb307686da8e22396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:46.186794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-45c60409-bfad-41bb-a046-141115b37c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:46.193246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1024/2021] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:46.194650 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-45c60409-bfad-41bb-a046-141115b37c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:46.200733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 998/2022] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:45 2022] DELETE /identity/v3/projects/1422490d2ee644dbb307686da8e22396 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:46.200940 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc06d30-b977-499f-8bbb-c7ed7b025bef admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:46.202444 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c60409-bfad-41bb-a046-141115b37c20 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:46.203443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-0fc06d30-b977-499f-8bbb-c7ed7b025bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:46.214790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-45c60409-bfad-41bb-a046-141115b37c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:46.240649 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c60409-bfad-41bb-a046-141115b37c20 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:46.241680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:46.250748 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c4887-5a46-4910-b313-5f0eb253fc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:46.251422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c4887-5a46-4910-b313-5f0eb253fc3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:46.251733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c4887-5a46-4910-b313-5f0eb253fc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:46.252501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c4887-5a46-4910-b313-5f0eb253fc3e admin admin] PATH_INFO: `/v3/users/991ff4722e32473584b1c4245ce30bf0` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:46.254061 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc06d30-b977-499f-8bbb-c7ed7b025bef admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:46.255543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c4887-5a46-4910-b313-5f0eb253fc3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=991ff4722e32473584b1c4245ce30bf0)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:46.259938 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c4887-5a46-4910-b313-5f0eb253fc3e admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:46.261745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e173cc2-aec5-4b76-8250-de679690b2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:46.262511 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e173cc2-aec5-4b76-8250-de679690b2cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:46.262851 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e173cc2-aec5-4b76-8250-de679690b2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:46.263300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e173cc2-aec5-4b76-8250-de679690b2cf admin admin] PATH_INFO: `/v3/projects/f2e819494a214ecfa1ed3cf64a88cf84/users/cf5c97f9832a444096fd316b71a1bfa6/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:46.301187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e173cc2-aec5-4b76-8250-de679690b2cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e819494a214ecfa1ed3cf64a88cf84, user_id=cf5c97f9832a444096fd316b71a1bfa6, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:46.305698 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e173cc2-aec5-4b76-8250-de679690b2cf admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:46.406818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1025/2023] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:46 2022] PUT /identity/v3/projects/f2e819494a214ecfa1ed3cf64a88cf84/users/cf5c97f9832a444096fd316b71a1bfa6/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:46.429585 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06f693-3bb5-45b8-aeb3-136be4e5f281 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:46.435717 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06f693-3bb5-45b8-aeb3-136be4e5f281 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:46.435717 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06f693-3bb5-45b8-aeb3-136be4e5f281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:46.471372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-2a06f693-3bb5-45b8-aeb3-136be4e5f281 None None] MFA Rules not processed for user `cf5c97f9832a444096fd316b71a1bfa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:46.473125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2a06f693-3bb5-45b8-aeb3-136be4e5f281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:46.574938 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1026/2024] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:46.583768 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-1b8c4887-5a46-4910-b313-5f0eb253fc3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '991ff4722e32473584b1c4245ce30bf0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:46.585228 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-1b8c4887-5a46-4910-b313-5f0eb253fc3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '991ff4722e32473584b1c4245ce30bf0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:46.587159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06f693-3bb5-45b8-aeb3-136be4e5f281 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:46.588899 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2a06f693-3bb5-45b8-aeb3-136be4e5f281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:46.598070 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-1b8c4887-5a46-4910-b313-5f0eb253fc3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '991ff4722e32473584b1c4245ce30bf0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:46.613321 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-1b8c4887-5a46-4910-b313-5f0eb253fc3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '991ff4722e32473584b1c4245ce30bf0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:46.614093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-1b8c4887-5a46-4910-b313-5f0eb253fc3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '991ff4722e32473584b1c4245ce30bf0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:46.656267 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06f693-3bb5-45b8-aeb3-136be4e5f281 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:46.665146 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9687828-4a31-4b43-8369-b80c05454818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:46.665786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9687828-4a31-4b43-8369-b80c05454818 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:46.666066 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9687828-4a31-4b43-8369-b80c05454818 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:46.666430 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9687828-4a31-4b43-8369-b80c05454818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:46.670148 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a9687828-4a31-4b43-8369-b80c05454818 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:46.693397 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 999/2025] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:46 2022] DELETE /identity/v3/users/991ff4722e32473584b1c4245ce30bf0 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:46.736934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9687828-4a31-4b43-8369-b80c05454818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:46.739171 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9687828-4a31-4b43-8369-b80c05454818 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:46.753750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1027/2026] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:51:46.970684 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:47.247313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c4887-5a46-4910-b313-5f0eb253fc3e admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:47.249734 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1b8c4887-5a46-4910-b313-5f0eb253fc3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:47.336919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c4887-5a46-4910-b313-5f0eb253fc3e admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:47.342173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298ff6d-b6f1-4cbc-b928-6c92ab434278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:47.351230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298ff6d-b6f1-4cbc-b928-6c92ab434278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:47.351230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298ff6d-b6f1-4cbc-b928-6c92ab434278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:47.351230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298ff6d-b6f1-4cbc-b928-6c92ab434278 admin admin] PATH_INFO: `/v3/users/e5dab09914634854bed1c1c4a1527746` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:47.351230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298ff6d-b6f1-4cbc-b928-6c92ab434278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5dab09914634854bed1c1c4a1527746)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:47.351230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298ff6d-b6f1-4cbc-b928-6c92ab434278 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:47.524711 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9687828-4a31-4b43-8369-b80c05454818 service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:47.525493 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a9687828-4a31-4b43-8369-b80c05454818 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:47.650679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9687828-4a31-4b43-8369-b80c05454818 service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:47.659008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d2f12-1d01-4225-a8a5-9189aea28aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:47.660139 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d2f12-1d01-4225-a8a5-9189aea28aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:47.660627 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d2f12-1d01-4225-a8a5-9189aea28aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:47.661127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d2f12-1d01-4225-a8a5-9189aea28aa0 admin admin] PATH_INFO: `/v3/projects/600cc2fab14d44c8b011ba144c82d0ce` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:47.663238 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d2f12-1d01-4225-a8a5-9189aea28aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=600cc2fab14d44c8b011ba144c82d0ce)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:47.666749 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d2f12-1d01-4225-a8a5-9189aea28aa0 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:47.726139 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d298ff6d-b6f1-4cbc-b928-6c92ab434278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5dab09914634854bed1c1c4a1527746'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:47.727010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d298ff6d-b6f1-4cbc-b928-6c92ab434278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5dab09914634854bed1c1c4a1527746'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:47.737519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d298ff6d-b6f1-4cbc-b928-6c92ab434278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5dab09914634854bed1c1c4a1527746'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:47.753735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d298ff6d-b6f1-4cbc-b928-6c92ab434278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5dab09914634854bed1c1c4a1527746'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:47.754858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d298ff6d-b6f1-4cbc-b928-6c92ab434278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5dab09914634854bed1c1c4a1527746'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:47.796908 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-574d2f12-1d01-4225-a8a5-9189aea28aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '600cc2fab14d44c8b011ba144c82d0ce', 'request_id': 'req-574d2f12-1d01-4225-a8a5-9189aea28aa0'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:47.804041 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-574d2f12-1d01-4225-a8a5-9189aea28aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '600cc2fab14d44c8b011ba144c82d0ce', 'request_id': 'req-574d2f12-1d01-4225-a8a5-9189aea28aa0'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:47.851371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1000/2027] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:47 2022] DELETE /identity/v3/users/e5dab09914634854bed1c1c4a1527746 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:47.990512 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-574d2f12-1d01-4225-a8a5-9189aea28aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '600cc2fab14d44c8b011ba144c82d0ce', 'request_id': 'req-574d2f12-1d01-4225-a8a5-9189aea28aa0'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:48.008565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-574d2f12-1d01-4225-a8a5-9189aea28aa0 admin admin] The token cache is being invalidate because project 600cc2fab14d44c8b011ba144c82d0ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:48.008565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-574d2f12-1d01-4225-a8a5-9189aea28aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:48.008565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-574d2f12-1d01-4225-a8a5-9189aea28aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:48.009103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1028/2028] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:47 2022] DELETE /identity/v3/projects/600cc2fab14d44c8b011ba144c82d0ce => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:48.015433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460ae87-6610-491e-b143-3fdc55dbf99a None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:48.016833 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460ae87-6610-491e-b143-3fdc55dbf99a None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:48.017473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460ae87-6610-491e-b143-3fdc55dbf99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:48.048353 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-3460ae87-6610-491e-b143-3fdc55dbf99a None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:48.049610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3460ae87-6610-491e-b143-3fdc55dbf99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:48.054794 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:48.139259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1001/2029] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:48.148307 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413dcda-bb91-4b80-812b-9778ec1bde27 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:48.148661 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413dcda-bb91-4b80-812b-9778ec1bde27 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:48.148948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413dcda-bb91-4b80-812b-9778ec1bde27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:48.171885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-5413dcda-bb91-4b80-812b-9778ec1bde27 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:48.173184 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5413dcda-bb91-4b80-812b-9778ec1bde27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:48.181634 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1029/2030] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:48.187011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460ae87-6610-491e-b143-3fdc55dbf99a None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:48.190145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413dcda-bb91-4b80-812b-9778ec1bde27 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:48.191656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5413dcda-bb91-4b80-812b-9778ec1bde27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:48.198084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460ae87-6610-491e-b143-3fdc55dbf99a None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:48.204350 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce0b40-973a-44e8-9eff-2adda40f1474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:48.205560 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce0b40-973a-44e8-9eff-2adda40f1474 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:48.205560 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce0b40-973a-44e8-9eff-2adda40f1474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:48.205560 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce0b40-973a-44e8-9eff-2adda40f1474 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:48.207621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce0b40-973a-44e8-9eff-2adda40f1474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:51:48.207621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce0b40-973a-44e8-9eff-2adda40f1474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:48.208233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413dcda-bb91-4b80-812b-9778ec1bde27 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:48.208416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce0b40-973a-44e8-9eff-2adda40f1474 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:48.215677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07538a58-e3d4-4dd2-a319-b67b82304945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:48.217322 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07538a58-e3d4-4dd2-a319-b67b82304945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:48.218257 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07538a58-e3d4-4dd2-a319-b67b82304945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:48.218257 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07538a58-e3d4-4dd2-a319-b67b82304945 admin admin] PATH_INFO: `/v3/projects/c68ca919c27948d0af25cca7446764bf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:48.220144 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07538a58-e3d4-4dd2-a319-b67b82304945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68ca919c27948d0af25cca7446764bf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:48.224113 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07538a58-e3d4-4dd2-a319-b67b82304945 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:48.230274 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1002/2031] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:51:48.235409 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce0b40-973a-44e8-9eff-2adda40f1474 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:48.247154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce0b40-973a-44e8-9eff-2adda40f1474 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:48.253441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5f3fa-af93-46f5-bac2-37b1db0813e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:48.254234 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5f3fa-af93-46f5-bac2-37b1db0813e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:48.254531 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5f3fa-af93-46f5-bac2-37b1db0813e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:48.254877 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5f3fa-af93-46f5-bac2-37b1db0813e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:48.255556 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5f3fa-af93-46f5-bac2-37b1db0813e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:48.257795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5f3fa-af93-46f5-bac2-37b1db0813e2 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:48.371116 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1003/2032] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:48 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:51:48.376225 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5f3fa-af93-46f5-bac2-37b1db0813e2 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:48.384687 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-07538a58-e3d4-4dd2-a319-b67b82304945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68ca919c27948d0af25cca7446764bf', 'request_id': 'req-07538a58-e3d4-4dd2-a319-b67b82304945'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:48.393766 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-07538a58-e3d4-4dd2-a319-b67b82304945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68ca919c27948d0af25cca7446764bf', 'request_id': 'req-07538a58-e3d4-4dd2-a319-b67b82304945'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:48.449892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5f3fa-af93-46f5-bac2-37b1db0813e2 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:48.456587 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3af90b-9b8e-4aa0-840c-5a663fbb89c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:48.457384 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3af90b-9b8e-4aa0-840c-5a663fbb89c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:48.457771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3af90b-9b8e-4aa0-840c-5a663fbb89c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:48.458136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3af90b-9b8e-4aa0-840c-5a663fbb89c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:48.458879 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3af90b-9b8e-4aa0-840c-5a663fbb89c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:48.461025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3af90b-9b8e-4aa0-840c-5a663fbb89c4 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:48.504834 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-07538a58-e3d4-4dd2-a319-b67b82304945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68ca919c27948d0af25cca7446764bf', 'request_id': 'req-07538a58-e3d4-4dd2-a319-b67b82304945'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:48.526300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-07538a58-e3d4-4dd2-a319-b67b82304945 admin admin] The token cache is being invalidate because project c68ca919c27948d0af25cca7446764bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:48.526300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-07538a58-e3d4-4dd2-a319-b67b82304945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:48.526300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-07538a58-e3d4-4dd2-a319-b67b82304945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:48.526300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1030/2033] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:48 2022] DELETE /identity/v3/projects/c68ca919c27948d0af25cca7446764bf => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:48.539345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c10a6-afa4-44c4-bf03-5c5c33fb2e8a None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:48.539669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c10a6-afa4-44c4-bf03-5c5c33fb2e8a None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:48.542339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c10a6-afa4-44c4-bf03-5c5c33fb2e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:48.568909 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1004/2034] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:48 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:48.573996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f28c10a6-afa4-44c4-bf03-5c5c33fb2e8a None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:48.575283 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f28c10a6-afa4-44c4-bf03-5c5c33fb2e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:48.581727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3af90b-9b8e-4aa0-840c-5a663fbb89c4 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:48.584091 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-8b3af90b-9b8e-4aa0-840c-5a663fbb89c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:48.585093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1031/2035] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:48.594206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d2474-9e34-4e7a-b668-92644f52c49f None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:48.594493 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d2474-9e34-4e7a-b668-92644f52c49f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:48.594773 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d2474-9e34-4e7a-b668-92644f52c49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:48.603120 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3af90b-9b8e-4aa0-840c-5a663fbb89c4 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:48.611853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f441c2b-bc02-4030-a646-4520582eb9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:48.613179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f441c2b-bc02-4030-a646-4520582eb9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:48.613635 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f441c2b-bc02-4030-a646-4520582eb9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:48.614131 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f441c2b-bc02-4030-a646-4520582eb9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:48.615339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f441c2b-bc02-4030-a646-4520582eb9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:48.618534 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f441c2b-bc02-4030-a646-4520582eb9d7 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:48.620177 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-ba4d2474-9e34-4e7a-b668-92644f52c49f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:48.622115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ba4d2474-9e34-4e7a-b668-92644f52c49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:48.631757 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1032/2036] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:48.636155 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d2474-9e34-4e7a-b668-92644f52c49f None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:48.638115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1005/2037] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:48.646587 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d2474-9e34-4e7a-b668-92644f52c49f None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:48.650364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f441c2b-bc02-4030-a646-4520582eb9d7 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:48.654891 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e36a8-d933-40fd-b9c1-55ee64d3d636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:48.655542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e36a8-d933-40fd-b9c1-55ee64d3d636 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:48.655822 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e36a8-d933-40fd-b9c1-55ee64d3d636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:48.656113 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e36a8-d933-40fd-b9c1-55ee64d3d636 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:48.656755 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e36a8-d933-40fd-b9c1-55ee64d3d636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:51:48.657055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e36a8-d933-40fd-b9c1-55ee64d3d636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:48.658671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e36a8-d933-40fd-b9c1-55ee64d3d636 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:48.662714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f441c2b-bc02-4030-a646-4520582eb9d7 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:48.668395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8885c-bbd6-414b-94b4-55cd79dc82b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:48.669021 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8885c-bbd6-414b-94b4-55cd79dc82b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:48.669306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8885c-bbd6-414b-94b4-55cd79dc82b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:48.670213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8885c-bbd6-414b-94b4-55cd79dc82b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:48.671090 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8885c-bbd6-414b-94b4-55cd79dc82b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:48.672782 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8885c-bbd6-414b-94b4-55cd79dc82b5 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:48.674384 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1033/2038] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:51:48.686425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1006/2039] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:48.688276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e36a8-d933-40fd-b9c1-55ee64d3d636 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:48.692114 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8885c-bbd6-414b-94b4-55cd79dc82b5 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:48.702793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8885c-bbd6-414b-94b4-55cd79dc82b5 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:48.704604 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e36a8-d933-40fd-b9c1-55ee64d3d636 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:48.708324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7058db-fd04-4d4b-95ad-6730c2af2b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:48.709104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7058db-fd04-4d4b-95ad-6730c2af2b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:48.714803 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7058db-fd04-4d4b-95ad-6730c2af2b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:48.714803 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7058db-fd04-4d4b-95ad-6730c2af2b1d admin admin] PATH_INFO: `/v3/projects/667e1d1346554cb2944518e1bb3c6348/users/92614bedff7c4e648747e4b7395da9ec/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:48.715020 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a37f9b-df6a-4e53-a2ce-c4557535b125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:48.715020 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a37f9b-df6a-4e53-a2ce-c4557535b125 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:48.715020 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a37f9b-df6a-4e53-a2ce-c4557535b125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:48.715020 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a37f9b-df6a-4e53-a2ce-c4557535b125 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:48.715319 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a37f9b-df6a-4e53-a2ce-c4557535b125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:48.716012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a37f9b-df6a-4e53-a2ce-c4557535b125 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:48.728093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7058db-fd04-4d4b-95ad-6730c2af2b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=667e1d1346554cb2944518e1bb3c6348, user_id=92614bedff7c4e648747e4b7395da9ec, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:48.731887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7058db-fd04-4d4b-95ad-6730c2af2b1d admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:48.888747 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1034/2041] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:48 2022] POST /identity/v3/projects => generated 365 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:51:48.893002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a37f9b-df6a-4e53-a2ce-c4557535b125 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:48.897372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1007/2041] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:48 2022] PUT /identity/v3/projects/667e1d1346554cb2944518e1bb3c6348/users/92614bedff7c4e648747e4b7395da9ec/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:48.899293 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320cc24-ee4f-422c-9cd4-14dcf1ca769d None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:48.899821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320cc24-ee4f-422c-9cd4-14dcf1ca769d None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:48.900103 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320cc24-ee4f-422c-9cd4-14dcf1ca769d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:48.937464 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-c320cc24-ee4f-422c-9cd4-14dcf1ca769d None None] MFA Rules not processed for user `92614bedff7c4e648747e4b7395da9ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:48.947872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c320cc24-ee4f-422c-9cd4-14dcf1ca769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:49.000404 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a37f9b-df6a-4e53-a2ce-c4557535b125 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:49.013787 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697d840-3888-458c-87b3-1612eeefa5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:49.014857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697d840-3888-458c-87b3-1612eeefa5cd admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:49.015440 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697d840-3888-458c-87b3-1612eeefa5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:49.015916 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697d840-3888-458c-87b3-1612eeefa5cd admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:49.016631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697d840-3888-458c-87b3-1612eeefa5cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:49.018826 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697d840-3888-458c-87b3-1612eeefa5cd admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:49.037277 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1008/2042] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:49.038412 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320cc24-ee4f-422c-9cd4-14dcf1ca769d None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:49.039926 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c320cc24-ee4f-422c-9cd4-14dcf1ca769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:49.100791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320cc24-ee4f-422c-9cd4-14dcf1ca769d None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:49.104519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79143e-c9b8-4cec-a0ac-61a4b0a97cd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:49.105159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79143e-c9b8-4cec-a0ac-61a4b0a97cd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:49.105465 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79143e-c9b8-4cec-a0ac-61a4b0a97cd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:49.105740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79143e-c9b8-4cec-a0ac-61a4b0a97cd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:49.108306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1b79143e-c9b8-4cec-a0ac-61a4b0a97cd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:49.125444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1035/2043] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:48 2022] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:49.129532 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697d840-3888-458c-87b3-1612eeefa5cd admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:49.140128 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697d840-3888-458c-87b3-1612eeefa5cd admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:49.145538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19cd0d-0ea8-480d-90a7-25a29cfde2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:49.146144 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19cd0d-0ea8-480d-90a7-25a29cfde2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:49.146423 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19cd0d-0ea8-480d-90a7-25a29cfde2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:49.146701 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19cd0d-0ea8-480d-90a7-25a29cfde2f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:49.147324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19cd0d-0ea8-480d-90a7-25a29cfde2f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:49.149290 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19cd0d-0ea8-480d-90a7-25a29cfde2f4 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:49.178683 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79143e-c9b8-4cec-a0ac-61a4b0a97cd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:49.180004 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79143e-c9b8-4cec-a0ac-61a4b0a97cd7 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:49.191403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1009/2044] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:49.192305 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79143e-c9b8-4cec-a0ac-61a4b0a97cd7 service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:49.204639 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79143e-c9b8-4cec-a0ac-61a4b0a97cd7 service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:49.210793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc8a1-7724-40b1-a1d4-88cf6dceae27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:49.211554 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc8a1-7724-40b1-a1d4-88cf6dceae27 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:49.211842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc8a1-7724-40b1-a1d4-88cf6dceae27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:49.212120 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc8a1-7724-40b1-a1d4-88cf6dceae27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:49.212775 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadc8a1-7724-40b1-a1d4-88cf6dceae27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:49.214463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadc8a1-7724-40b1-a1d4-88cf6dceae27 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:49.226124 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1010/2045] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:49.230463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc8a1-7724-40b1-a1d4-88cf6dceae27 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:49.241850 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc8a1-7724-40b1-a1d4-88cf6dceae27 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:49.248424 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784c7a5-b296-42ac-bf2d-5af81008a019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:49.249185 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784c7a5-b296-42ac-bf2d-5af81008a019 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:49.249472 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784c7a5-b296-42ac-bf2d-5af81008a019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:49.249738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784c7a5-b296-42ac-bf2d-5af81008a019 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:49.250391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784c7a5-b296-42ac-bf2d-5af81008a019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:49.252065 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784c7a5-b296-42ac-bf2d-5af81008a019 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:49.266415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1011/2046] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:49.272192 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784c7a5-b296-42ac-bf2d-5af81008a019 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:49.284086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784c7a5-b296-42ac-bf2d-5af81008a019 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:49.290135 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849fe5c-9cc6-46fe-8fc5-9f40460dc664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:49.290720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849fe5c-9cc6-46fe-8fc5-9f40460dc664 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:49.291008 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849fe5c-9cc6-46fe-8fc5-9f40460dc664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:49.291283 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849fe5c-9cc6-46fe-8fc5-9f40460dc664 admin admin] PATH_INFO: `/v3/projects/b3c10ab1a3724283b2f035ca71f3bc8d/users/e4c72bee5cd84070bcc92a156c8b54d6/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:49.307586 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1036/2047] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:49 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:49.309659 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19cd0d-0ea8-480d-90a7-25a29cfde2f4 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:49.313645 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849fe5c-9cc6-46fe-8fc5-9f40460dc664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c10ab1a3724283b2f035ca71f3bc8d, user_id=e4c72bee5cd84070bcc92a156c8b54d6, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:49.316642 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849fe5c-9cc6-46fe-8fc5-9f40460dc664 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:49.420688 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19cd0d-0ea8-480d-90a7-25a29cfde2f4 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:49.429382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95b745-63c1-4537-9606-cbdaa858d092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:49.430330 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95b745-63c1-4537-9606-cbdaa858d092 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:49.430834 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95b745-63c1-4537-9606-cbdaa858d092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:49.431307 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95b745-63c1-4537-9606-cbdaa858d092 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:49.432542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95b745-63c1-4537-9606-cbdaa858d092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:49.436810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95b745-63c1-4537-9606-cbdaa858d092 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:49.445319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1012/2048] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:49 2022] PUT /identity/v3/projects/b3c10ab1a3724283b2f035ca71f3bc8d/users/e4c72bee5cd84070bcc92a156c8b54d6/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:49.463738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8f789-b1a1-4413-ad94-92e7546ba44b None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:49.464248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8f789-b1a1-4413-ad94-92e7546ba44b None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:49.464610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8f789-b1a1-4413-ad94-92e7546ba44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:49.501359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-04f8f789-b1a1-4413-ad94-92e7546ba44b None None] MFA Rules not processed for user `e4c72bee5cd84070bcc92a156c8b54d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:49.502610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-04f8f789-b1a1-4413-ad94-92e7546ba44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:49.559629 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1037/2049] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:49 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:49.563555 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:49.565695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95b745-63c1-4537-9606-cbdaa858d092 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:49.581189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95b745-63c1-4537-9606-cbdaa858d092 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:49.603352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1013/2050] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:49.603936 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8f789-b1a1-4413-ad94-92e7546ba44b None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:49.664386 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bd70e-5ade-4a4b-9cb1-6b67f01c88d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:49.665337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bd70e-5ade-4a4b-9cb1-6b67f01c88d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:49.665751 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bd70e-5ade-4a4b-9cb1-6b67f01c88d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:49.666121 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bd70e-5ade-4a4b-9cb1-6b67f01c88d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:49.666855 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bd70e-5ade-4a4b-9cb1-6b67f01c88d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:49.668766 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bd70e-5ade-4a4b-9cb1-6b67f01c88d3 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:49.680770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1038/2051] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:51:49.683614 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8f789-b1a1-4413-ad94-92e7546ba44b None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:49.685765 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bd70e-5ade-4a4b-9cb1-6b67f01c88d3 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:49.689041 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3cdcd-8216-43ec-885e-045958b8321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:49.689681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3cdcd-8216-43ec-885e-045958b8321b admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:49.689961 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3cdcd-8216-43ec-885e-045958b8321b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:49.690226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3cdcd-8216-43ec-885e-045958b8321b admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:49.690851 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3cdcd-8216-43ec-885e-045958b8321b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:49.692810 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3cdcd-8216-43ec-885e-045958b8321b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:49.696449 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bd70e-5ade-4a4b-9cb1-6b67f01c88d3 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:49.704491 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888036a4-7f12-44ba-89bf-53a3101d1bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:49.705136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888036a4-7f12-44ba-89bf-53a3101d1bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:49.705685 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888036a4-7f12-44ba-89bf-53a3101d1bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:49.706044 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888036a4-7f12-44ba-89bf-53a3101d1bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:49.707049 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888036a4-7f12-44ba-89bf-53a3101d1bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:49.709113 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888036a4-7f12-44ba-89bf-53a3101d1bc2 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:49.722599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1039/2052] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:49.727344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888036a4-7f12-44ba-89bf-53a3101d1bc2 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:49.739743 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888036a4-7f12-44ba-89bf-53a3101d1bc2 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:49.744574 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32113267-89db-432b-9b53-852d2f9b0540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:49.745448 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32113267-89db-432b-9b53-852d2f9b0540 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:49.745551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32113267-89db-432b-9b53-852d2f9b0540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:49.745818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32113267-89db-432b-9b53-852d2f9b0540 admin admin] PATH_INFO: `/v3/projects/e3dc1dcc10844cddb44147f125bd3b8f/users/f72cd23bdf8447d5a0341f6ec7939b31/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:49.764623 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32113267-89db-432b-9b53-852d2f9b0540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3dc1dcc10844cddb44147f125bd3b8f, user_id=f72cd23bdf8447d5a0341f6ec7939b31, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:49.767486 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32113267-89db-432b-9b53-852d2f9b0540 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:49.824620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1014/2053] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:49 2022] POST /identity/v3/projects => generated 369 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:49.824620 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3cdcd-8216-43ec-885e-045958b8321b admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:49.908169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3cdcd-8216-43ec-885e-045958b8321b admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:49.915727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1040/2054] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:49 2022] PUT /identity/v3/projects/e3dc1dcc10844cddb44147f125bd3b8f/users/f72cd23bdf8447d5a0341f6ec7939b31/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:49.931863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7c5e8-0299-4bd3-b268-d2d8e5924887 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:49.932352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7c5e8-0299-4bd3-b268-d2d8e5924887 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:49.932815 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7c5e8-0299-4bd3-b268-d2d8e5924887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:49.973804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-cfc7c5e8-0299-4bd3-b268-d2d8e5924887 None None] MFA Rules not processed for user `f72cd23bdf8447d5a0341f6ec7939b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:49.975042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-cfc7c5e8-0299-4bd3-b268-d2d8e5924887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:49.986325 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1244120-3cd9-4e72-86d7-fee06a040db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:49.987093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244120-3cd9-4e72-86d7-fee06a040db5 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:49.987488 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244120-3cd9-4e72-86d7-fee06a040db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:49.987990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244120-3cd9-4e72-86d7-fee06a040db5 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:49.988726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1244120-3cd9-4e72-86d7-fee06a040db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:49.991028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1244120-3cd9-4e72-86d7-fee06a040db5 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:50.064719 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1041/2055] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:50.069422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7c5e8-0299-4bd3-b268-d2d8e5924887 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:50.082946 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7c5e8-0299-4bd3-b268-d2d8e5924887 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:50.087939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ded4f-401d-4321-a03f-67971d5e51cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:50.088593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ded4f-401d-4321-a03f-67971d5e51cc admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:50.088927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ded4f-401d-4321-a03f-67971d5e51cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:50.089140 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ded4f-401d-4321-a03f-67971d5e51cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:50.089780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ded4f-401d-4321-a03f-67971d5e51cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:50.092354 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ded4f-401d-4321-a03f-67971d5e51cc admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:50.187100 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1015/2056] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:49 2022] POST /identity/v3/users => generated 291 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:50.194782 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1244120-3cd9-4e72-86d7-fee06a040db5 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:50.218808 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1244120-3cd9-4e72-86d7-fee06a040db5 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:50.227123 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590499ea-e371-4392-af41-c2887c27ab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:50.228500 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590499ea-e371-4392-af41-c2887c27ab1f admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:50.229198 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590499ea-e371-4392-af41-c2887c27ab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:50.229983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590499ea-e371-4392-af41-c2887c27ab1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:50.231356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590499ea-e371-4392-af41-c2887c27ab1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:50.235890 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590499ea-e371-4392-af41-c2887c27ab1f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:50.249423 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1016/2057] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:50.253713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590499ea-e371-4392-af41-c2887c27ab1f admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:50.258390 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1042/2058] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:51:50 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:51:50.264640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590499ea-e371-4392-af41-c2887c27ab1f admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:50.264948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ded4f-401d-4321-a03f-67971d5e51cc admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:50.354512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a311771-b7ef-4c2e-a030-d4a22dc0ba3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:50.355592 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a311771-b7ef-4c2e-a030-d4a22dc0ba3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:50.355592 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a311771-b7ef-4c2e-a030-d4a22dc0ba3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:50.355904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a311771-b7ef-4c2e-a030-d4a22dc0ba3b admin admin] PATH_INFO: `/v3/projects/7ba92cd5bf044e4f81e4fd448eaf6fd2/users/9c1549c4fe2843ab8082534060e1f637/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:50.380796 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a311771-b7ef-4c2e-a030-d4a22dc0ba3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba92cd5bf044e4f81e4fd448eaf6fd2, user_id=9c1549c4fe2843ab8082534060e1f637, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:50.383648 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a311771-b7ef-4c2e-a030-d4a22dc0ba3b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:50.390342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ded4f-401d-4321-a03f-67971d5e51cc admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:50.398505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147d40b-2a82-4db1-adcf-63997c092712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:50.404304 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147d40b-2a82-4db1-adcf-63997c092712 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:50.404304 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147d40b-2a82-4db1-adcf-63997c092712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:50.404304 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147d40b-2a82-4db1-adcf-63997c092712 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:50.404304 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147d40b-2a82-4db1-adcf-63997c092712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:50.409073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147d40b-2a82-4db1-adcf-63997c092712 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:50.461811 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1017/2059] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:50 2022] PUT /identity/v3/projects/7ba92cd5bf044e4f81e4fd448eaf6fd2/users/9c1549c4fe2843ab8082534060e1f637/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:50.465880 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a311771-b7ef-4c2e-a030-d4a22dc0ba3b admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:50.532222 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1043/2060] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:51:50 2022] POST /identity/v3/users => generated 295 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:51:50.537101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147d40b-2a82-4db1-adcf-63997c092712 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:50.542189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a311771-b7ef-4c2e-a030-d4a22dc0ba3b admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:50.549078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c852fac-4ffa-4c38-929d-aec468f189c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:50.549714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c852fac-4ffa-4c38-929d-aec468f189c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:50.549995 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c852fac-4ffa-4c38-929d-aec468f189c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:50.550567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c852fac-4ffa-4c38-929d-aec468f189c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:50.551226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c852fac-4ffa-4c38-929d-aec468f189c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:50.552944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c852fac-4ffa-4c38-929d-aec468f189c6 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:50.553428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147d40b-2a82-4db1-adcf-63997c092712 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:50.561903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eec4da-8dea-43a5-b430-6a0ead5db5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:50.561903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eec4da-8dea-43a5-b430-6a0ead5db5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:50.561903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eec4da-8dea-43a5-b430-6a0ead5db5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:50.563359 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eec4da-8dea-43a5-b430-6a0ead5db5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:50.563359 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eec4da-8dea-43a5-b430-6a0ead5db5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:50.565622 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eec4da-8dea-43a5-b430-6a0ead5db5e9 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:50.572190 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1018/2061] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:50.573714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c852fac-4ffa-4c38-929d-aec468f189c6 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:50.586201 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1044/2062] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:50.587656 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c852fac-4ffa-4c38-929d-aec468f189c6 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:50.593911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9db07b-9fae-47b0-b55c-b60cf42a1f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:50.594987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9db07b-9fae-47b0-b55c-b60cf42a1f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:50.595116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eec4da-8dea-43a5-b430-6a0ead5db5e9 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:50.595433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9db07b-9fae-47b0-b55c-b60cf42a1f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:50.595909 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9db07b-9fae-47b0-b55c-b60cf42a1f6a admin admin] PATH_INFO: `/v3/projects/7ba92cd5bf044e4f81e4fd448eaf6fd2/users/9c1549c4fe2843ab8082534060e1f637/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:50.599198 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9db07b-9fae-47b0-b55c-b60cf42a1f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba92cd5bf044e4f81e4fd448eaf6fd2, user_id=9c1549c4fe2843ab8082534060e1f637, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:50.604323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9db07b-9fae-47b0-b55c-b60cf42a1f6a admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:50.611646 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eec4da-8dea-43a5-b430-6a0ead5db5e9 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:50.621239 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1019/2063] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:50 2022] PUT /identity/v3/projects/7ba92cd5bf044e4f81e4fd448eaf6fd2/users/9c1549c4fe2843ab8082534060e1f637/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:50.633647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef83e62-62a2-487c-99e8-f7b91ff3fd35 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:50.633928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef83e62-62a2-487c-99e8-f7b91ff3fd35 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:50.634199 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef83e62-62a2-487c-99e8-f7b91ff3fd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:50.677085 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-4ef83e62-62a2-487c-99e8-f7b91ff3fd35 None None] MFA Rules not processed for user `9c1549c4fe2843ab8082534060e1f637`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:50.678806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4ef83e62-62a2-487c-99e8-f7b91ff3fd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:50.683360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af519bda-0b02-4c9f-9d1e-166f851a14a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:50.684115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af519bda-0b02-4c9f-9d1e-166f851a14a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:50.684388 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af519bda-0b02-4c9f-9d1e-166f851a14a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:50.684723 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af519bda-0b02-4c9f-9d1e-166f851a14a6 admin admin] PATH_INFO: `/v3/projects/562afdcac94443729522e921007933d2/users/a5a14ed8cc9d47dc8b57b53bf579155c/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:50.719283 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af519bda-0b02-4c9f-9d1e-166f851a14a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=562afdcac94443729522e921007933d2, user_id=a5a14ed8cc9d47dc8b57b53bf579155c, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:50.728262 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af519bda-0b02-4c9f-9d1e-166f851a14a6 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:50.776326 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:50.778325 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1020/2064] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:50.790710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef83e62-62a2-487c-99e8-f7b91ff3fd35 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:50.809392 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1045/2065] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:50 2022] PUT /identity/v3/projects/562afdcac94443729522e921007933d2/users/a5a14ed8cc9d47dc8b57b53bf579155c/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:50.813837 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af519bda-0b02-4c9f-9d1e-166f851a14a6 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:50.879250 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef83e62-62a2-487c-99e8-f7b91ff3fd35 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:50.892284 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af519bda-0b02-4c9f-9d1e-166f851a14a6 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:50.897538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baecdbc-cf67-424e-ad80-e553a332dcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:50.898163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baecdbc-cf67-424e-ad80-e553a332dcaa admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:50.898439 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baecdbc-cf67-424e-ad80-e553a332dcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:50.898734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baecdbc-cf67-424e-ad80-e553a332dcaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:50.899745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baecdbc-cf67-424e-ad80-e553a332dcaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:50.901372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baecdbc-cf67-424e-ad80-e553a332dcaa admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:50.913327 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1046/2066] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:51:50.917430 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baecdbc-cf67-424e-ad80-e553a332dcaa admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:50.928659 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baecdbc-cf67-424e-ad80-e553a332dcaa admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:50.933765 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b83d6-fa14-40e3-a5b5-0a16d607fa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:50.934429 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b83d6-fa14-40e3-a5b5-0a16d607fa50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:50.934707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b83d6-fa14-40e3-a5b5-0a16d607fa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:50.935038 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b83d6-fa14-40e3-a5b5-0a16d607fa50 admin admin] PATH_INFO: `/v3/projects/562afdcac94443729522e921007933d2/users/a5a14ed8cc9d47dc8b57b53bf579155c/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:50.937164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b83d6-fa14-40e3-a5b5-0a16d607fa50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=562afdcac94443729522e921007933d2, user_id=a5a14ed8cc9d47dc8b57b53bf579155c, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:50.939986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b83d6-fa14-40e3-a5b5-0a16d607fa50 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:50.946853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22c81d-ace3-47fb-843a-9a2943cf78e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:50.947492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22c81d-ace3-47fb-843a-9a2943cf78e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:50.947809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22c81d-ace3-47fb-843a-9a2943cf78e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:50.948084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22c81d-ace3-47fb-843a-9a2943cf78e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:50.952463 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1047/2067] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:51:50 2022] PUT /identity/v3/projects/562afdcac94443729522e921007933d2/users/a5a14ed8cc9d47dc8b57b53bf579155c/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:50.964356 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e58613-8383-4c2a-9738-f00c171ac072 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:50.964662 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e58613-8383-4c2a-9738-f00c171ac072 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:50.964937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e58613-8383-4c2a-9738-f00c171ac072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:51.005025 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-b1e58613-8383-4c2a-9738-f00c171ac072 None None] MFA Rules not processed for user `a5a14ed8cc9d47dc8b57b53bf579155c`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:51.006453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b1e58613-8383-4c2a-9738-f00c171ac072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:51.047869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22c81d-ace3-47fb-843a-9a2943cf78e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:51.049337 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22c81d-ace3-47fb-843a-9a2943cf78e8 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:51.060971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1021/2068] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:51:51.091085 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1048/2069] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:51.286900 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22c81d-ace3-47fb-843a-9a2943cf78e8 service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:51.299872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e58613-8383-4c2a-9738-f00c171ac072 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:51.301145 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22c81d-ace3-47fb-843a-9a2943cf78e8 service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:51.301507 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b1e58613-8383-4c2a-9738-f00c171ac072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:51.377390 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e58613-8383-4c2a-9738-f00c171ac072 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:51.378839 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114c851-21c4-4d61-8455-93ad6aacc32e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:51.379807 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114c851-21c4-4d61-8455-93ad6aacc32e service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:51.380355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114c851-21c4-4d61-8455-93ad6aacc32e service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:51.380778 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114c851-21c4-4d61-8455-93ad6aacc32e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:51.381354 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761d93e-1fad-44e2-848f-b0d71cb356f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:51.382046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761d93e-1fad-44e2-848f-b0d71cb356f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:51.382333 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761d93e-1fad-44e2-848f-b0d71cb356f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:51.382613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761d93e-1fad-44e2-848f-b0d71cb356f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:51.397857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114c851-21c4-4d61-8455-93ad6aacc32e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:51.400371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114c851-21c4-4d61-8455-93ad6aacc32e service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:51.418557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1022/2070] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:51.464049 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761d93e-1fad-44e2-848f-b0d71cb356f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:51.465528 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761d93e-1fad-44e2-848f-b0d71cb356f5 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:51.477683 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1049/2071] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:51.641514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:51.827334 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114c851-21c4-4d61-8455-93ad6aacc32e service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:51.840057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114c851-21c4-4d61-8455-93ad6aacc32e service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:51.846180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539577d-70a0-45c5-92ac-35e7a79c670c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:51.846995 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539577d-70a0-45c5-92ac-35e7a79c670c service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:51.847460 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539577d-70a0-45c5-92ac-35e7a79c670c service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:51.847926 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539577d-70a0-45c5-92ac-35e7a79c670c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:51.915159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539577d-70a0-45c5-92ac-35e7a79c670c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:51.916575 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539577d-70a0-45c5-92ac-35e7a79c670c service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:51.926681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1023/2072] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:53.564050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:54.556682 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:54.667962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:56.361324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:56.798545 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761d93e-1fad-44e2-848f-b0d71cb356f5 service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:56.800488 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a761d93e-1fad-44e2-848f-b0d71cb356f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:56.857203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:56.936782 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761d93e-1fad-44e2-848f-b0d71cb356f5 service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:56.944908 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fa640-4850-442d-8419-90a1607eaaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:56.946001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fa640-4850-442d-8419-90a1607eaaf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:56.946493 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fa640-4850-442d-8419-90a1607eaaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:56.946990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fa640-4850-442d-8419-90a1607eaaf0 admin admin] PATH_INFO: `/v3/users/511b31a29c9e4e588484e3e3bf9c0afc` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:56.948914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fa640-4850-442d-8419-90a1607eaaf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=511b31a29c9e4e588484e3e3bf9c0afc)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:56.955142 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fa640-4850-442d-8419-90a1607eaaf0 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:57.085634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539577d-70a0-45c5-92ac-35e7a79c670c service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:57.087079 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d539577d-70a0-45c5-92ac-35e7a79c670c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:57.103726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539577d-70a0-45c5-92ac-35e7a79c670c service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:57.109039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6070c93-7ff5-4808-b01a-e61746f365df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:57.109706 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6070c93-7ff5-4808-b01a-e61746f365df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:57.110028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6070c93-7ff5-4808-b01a-e61746f365df admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:57.113406 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6070c93-7ff5-4808-b01a-e61746f365df admin admin] PATH_INFO: `/v3/users/e84c314f43724c4ba7d983ac6e72ec66` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:57.113406 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6070c93-7ff5-4808-b01a-e61746f365df admin admin] RBAC: Authorizing `identity:delete_user(user_id=e84c314f43724c4ba7d983ac6e72ec66)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:57.114501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6070c93-7ff5-4808-b01a-e61746f365df admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:57.189174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d30fa640-4850-442d-8419-90a1607eaaf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '511b31a29c9e4e588484e3e3bf9c0afc'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:57.275496 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d30fa640-4850-442d-8419-90a1607eaaf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '511b31a29c9e4e588484e3e3bf9c0afc'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:57.276042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d30fa640-4850-442d-8419-90a1607eaaf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '511b31a29c9e4e588484e3e3bf9c0afc'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:57.276698 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d30fa640-4850-442d-8419-90a1607eaaf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '511b31a29c9e4e588484e3e3bf9c0afc'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:57.285303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d30fa640-4850-442d-8419-90a1607eaaf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '511b31a29c9e4e588484e3e3bf9c0afc'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:57.308372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1050/2073] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:56 2022] DELETE /identity/v3/users/511b31a29c9e4e588484e3e3bf9c0afc => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:57.308890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0644f-f800-49a4-96a2-e814a8c65c6f None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:57.309174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0644f-f800-49a4-96a2-e814a8c65c6f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:57.309485 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0644f-f800-49a4-96a2-e814a8c65c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:57.330547 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-75b0644f-f800-49a4-96a2-e814a8c65c6f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:57.331835 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-75b0644f-f800-49a4-96a2-e814a8c65c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:57.414490 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1051/2074] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:57.424817 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0644f-f800-49a4-96a2-e814a8c65c6f None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:57.426314 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-75b0644f-f800-49a4-96a2-e814a8c65c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:57.436127 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f6070c93-7ff5-4808-b01a-e61746f365df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e84c314f43724c4ba7d983ac6e72ec66'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:57.437714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f6070c93-7ff5-4808-b01a-e61746f365df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e84c314f43724c4ba7d983ac6e72ec66'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:57.456273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f6070c93-7ff5-4808-b01a-e61746f365df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e84c314f43724c4ba7d983ac6e72ec66'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:57.462899 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f6070c93-7ff5-4808-b01a-e61746f365df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e84c314f43724c4ba7d983ac6e72ec66'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:57.463926 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f6070c93-7ff5-4808-b01a-e61746f365df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e84c314f43724c4ba7d983ac6e72ec66'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:57.498813 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0644f-f800-49a4-96a2-e814a8c65c6f None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:57.502663 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590fb3a-c341-4654-9a11-a2d0fe8673e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:57.503397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590fb3a-c341-4654-9a11-a2d0fe8673e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:57.503697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590fb3a-c341-4654-9a11-a2d0fe8673e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:57.503975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590fb3a-c341-4654-9a11-a2d0fe8673e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:57.505776 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f590fb3a-c341-4654-9a11-a2d0fe8673e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:57.519845 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590fb3a-c341-4654-9a11-a2d0fe8673e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:57.521372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590fb3a-c341-4654-9a11-a2d0fe8673e2 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:57.532033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1052/2075] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:51:57.556047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1024/2076] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:57 2022] DELETE /identity/v3/users/e84c314f43724c4ba7d983ac6e72ec66 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:57.559280 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed7ce-283a-4a7e-ac8e-ac00736e050b None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:57.559836 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed7ce-283a-4a7e-ac8e-ac00736e050b None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:57.561278 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed7ce-283a-4a7e-ac8e-ac00736e050b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:57.583585 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-e47ed7ce-283a-4a7e-ac8e-ac00736e050b None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:57.593964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e47ed7ce-283a-4a7e-ac8e-ac00736e050b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:57.653547 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6070c93-7ff5-4808-b01a-e61746f365df admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:57.655981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f6070c93-7ff5-4808-b01a-e61746f365df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:57.658785 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1053/2077] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:57.668844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ed7ce-283a-4a7e-ac8e-ac00736e050b None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:57.672040 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e47ed7ce-283a-4a7e-ac8e-ac00736e050b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:57.674054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6070c93-7ff5-4808-b01a-e61746f365df admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:57.683186 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7eae4d-589c-4706-a76f-08c82c1232f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:57.685885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7eae4d-589c-4706-a76f-08c82c1232f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:57.685885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7eae4d-589c-4706-a76f-08c82c1232f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:57.685885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7eae4d-589c-4706-a76f-08c82c1232f1 admin admin] PATH_INFO: `/v3/users/92614bedff7c4e648747e4b7395da9ec` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:57.686963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7eae4d-589c-4706-a76f-08c82c1232f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92614bedff7c4e648747e4b7395da9ec)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:57.688991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7eae4d-589c-4706-a76f-08c82c1232f1 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:57.739226 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ed7ce-283a-4a7e-ac8e-ac00736e050b None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:57.751635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc34cc-9e17-45fc-9767-112cc22e7178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:57.751635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc34cc-9e17-45fc-9767-112cc22e7178 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:57.751635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc34cc-9e17-45fc-9767-112cc22e7178 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:57.751635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc34cc-9e17-45fc-9767-112cc22e7178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:57.754303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc34cc-9e17-45fc-9767-112cc22e7178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:57.755822 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc34cc-9e17-45fc-9767-112cc22e7178 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:57.766608 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1054/2078] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:51:57.974494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3d7eae4d-589c-4706-a76f-08c82c1232f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92614bedff7c4e648747e4b7395da9ec'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:57.975945 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3d7eae4d-589c-4706-a76f-08c82c1232f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92614bedff7c4e648747e4b7395da9ec'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:57.989262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3d7eae4d-589c-4706-a76f-08c82c1232f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92614bedff7c4e648747e4b7395da9ec'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:58.004395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3d7eae4d-589c-4706-a76f-08c82c1232f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92614bedff7c4e648747e4b7395da9ec'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:58.006328 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3d7eae4d-589c-4706-a76f-08c82c1232f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92614bedff7c4e648747e4b7395da9ec'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:58.146343 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc34cc-9e17-45fc-9767-112cc22e7178 service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:58.148017 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1025/2079] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:57 2022] DELETE /identity/v3/users/92614bedff7c4e648747e4b7395da9ec => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:58.149468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2edc34cc-9e17-45fc-9767-112cc22e7178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:58.152852 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d6e6c-ef1a-4834-b063-be84f84c71eb None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:58.153140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d6e6c-ef1a-4834-b063-be84f84c71eb None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:58.153420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d6e6c-ef1a-4834-b063-be84f84c71eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:58.176235 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-fe0d6e6c-ef1a-4834-b063-be84f84c71eb None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:58.177831 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-fe0d6e6c-ef1a-4834-b063-be84f84c71eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:58.187054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc34cc-9e17-45fc-9767-112cc22e7178 service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:58.271636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1026/2080] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:51:58.282549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d6e6c-ef1a-4834-b063-be84f84c71eb None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:58.284003 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-fe0d6e6c-ef1a-4834-b063-be84f84c71eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:58.285413 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c865f74-0211-4acb-8b2f-6847a75fcb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:58.287534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c865f74-0211-4acb-8b2f-6847a75fcb42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:58.287534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c865f74-0211-4acb-8b2f-6847a75fcb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:58.287534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c865f74-0211-4acb-8b2f-6847a75fcb42 admin admin] PATH_INFO: `/v3/projects/587ac1111b724b17946ed1d333b12019` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:58.288396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c865f74-0211-4acb-8b2f-6847a75fcb42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=587ac1111b724b17946ed1d333b12019)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:58.290783 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c865f74-0211-4acb-8b2f-6847a75fcb42 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:58.348556 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d6e6c-ef1a-4834-b063-be84f84c71eb None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:58.352412 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599d537-bda7-4f07-8917-912d37a0e735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:58.353027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599d537-bda7-4f07-8917-912d37a0e735 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:58.353307 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599d537-bda7-4f07-8917-912d37a0e735 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:58.353633 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599d537-bda7-4f07-8917-912d37a0e735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:58.364386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599d537-bda7-4f07-8917-912d37a0e735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:58.365890 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599d537-bda7-4f07-8917-912d37a0e735 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:58.377404 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1027/2081] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:51:58.414923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599d537-bda7-4f07-8917-912d37a0e735 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:58.416473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-9599d537-bda7-4f07-8917-912d37a0e735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:58.430785 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599d537-bda7-4f07-8917-912d37a0e735 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:58.436746 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ad6ee-6d6a-4e81-b6b1-87595623aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:58.437471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ad6ee-6d6a-4e81-b6b1-87595623aa89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:58.437742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ad6ee-6d6a-4e81-b6b1-87595623aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:58.438281 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ad6ee-6d6a-4e81-b6b1-87595623aa89 admin admin] PATH_INFO: `/v3/projects/0efcc1fbeaff480c82c8d6a747777998` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:58.439583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ad6ee-6d6a-4e81-b6b1-87595623aa89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0efcc1fbeaff480c82c8d6a747777998)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:58.448401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ad6ee-6d6a-4e81-b6b1-87595623aa89 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:58.542364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7c865f74-0211-4acb-8b2f-6847a75fcb42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '587ac1111b724b17946ed1d333b12019', 'request_id': 'req-7c865f74-0211-4acb-8b2f-6847a75fcb42'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:58.556002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7c865f74-0211-4acb-8b2f-6847a75fcb42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '587ac1111b724b17946ed1d333b12019', 'request_id': 'req-7c865f74-0211-4acb-8b2f-6847a75fcb42'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:58.622996 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-482ad6ee-6d6a-4e81-b6b1-87595623aa89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0efcc1fbeaff480c82c8d6a747777998', 'request_id': 'req-482ad6ee-6d6a-4e81-b6b1-87595623aa89'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:58.641900 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:58.717824 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7c865f74-0211-4acb-8b2f-6847a75fcb42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '587ac1111b724b17946ed1d333b12019', 'request_id': 'req-7c865f74-0211-4acb-8b2f-6847a75fcb42'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:58.747522 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7c865f74-0211-4acb-8b2f-6847a75fcb42 admin admin] The token cache is being invalidate because project 587ac1111b724b17946ed1d333b12019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:58.749299 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7c865f74-0211-4acb-8b2f-6847a75fcb42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:58.750174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7c865f74-0211-4acb-8b2f-6847a75fcb42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:58.755059 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1055/2082] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:58 2022] DELETE /identity/v3/projects/587ac1111b724b17946ed1d333b12019 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:58.756087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c865f74-0211-4acb-8b2f-6847a75fcb42 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:58.758255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7c865f74-0211-4acb-8b2f-6847a75fcb42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:58.765198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:51:58.831910 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c865f74-0211-4acb-8b2f-6847a75fcb42 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:58.832529 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-482ad6ee-6d6a-4e81-b6b1-87595623aa89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0efcc1fbeaff480c82c8d6a747777998', 'request_id': 'req-482ad6ee-6d6a-4e81-b6b1-87595623aa89'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:58.841218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-482ad6ee-6d6a-4e81-b6b1-87595623aa89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0efcc1fbeaff480c82c8d6a747777998', 'request_id': 'req-482ad6ee-6d6a-4e81-b6b1-87595623aa89'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:58.853090 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-482ad6ee-6d6a-4e81-b6b1-87595623aa89 admin admin] The token cache is being invalidate because project 0efcc1fbeaff480c82c8d6a747777998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:58.853489 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-482ad6ee-6d6a-4e81-b6b1-87595623aa89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:58.854316 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-482ad6ee-6d6a-4e81-b6b1-87595623aa89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:58.855898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1028/2083] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:58 2022] DELETE /identity/v3/projects/0efcc1fbeaff480c82c8d6a747777998 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:51:58.857271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ad6ee-6d6a-4e81-b6b1-87595623aa89 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:58.858591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-482ad6ee-6d6a-4e81-b6b1-87595623aa89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:58.897127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce374e-3343-480a-a8e2-d6532f3d446b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:58.898371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce374e-3343-480a-a8e2-d6532f3d446b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:58.898371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce374e-3343-480a-a8e2-d6532f3d446b admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:58.898371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce374e-3343-480a-a8e2-d6532f3d446b admin admin] PATH_INFO: `/v3/users/e4c72bee5cd84070bcc92a156c8b54d6` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:58.899538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce374e-3343-480a-a8e2-d6532f3d446b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c72bee5cd84070bcc92a156c8b54d6)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:58.901619 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce374e-3343-480a-a8e2-d6532f3d446b admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:58.932388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ad6ee-6d6a-4e81-b6b1-87595623aa89 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:58.938046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64720835-f1e3-477f-addf-d8fc9f178f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:58.942343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64720835-f1e3-477f-addf-d8fc9f178f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:58.942343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64720835-f1e3-477f-addf-d8fc9f178f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:58.942343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64720835-f1e3-477f-addf-d8fc9f178f13 admin admin] PATH_INFO: `/v3/users/34f4dc2d138a4729ac7cfebabaf6653d` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:58.942343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64720835-f1e3-477f-addf-d8fc9f178f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34f4dc2d138a4729ac7cfebabaf6653d)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:58.942343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64720835-f1e3-477f-addf-d8fc9f178f13 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:59.148281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b9ce374e-3343-480a-a8e2-d6532f3d446b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c72bee5cd84070bcc92a156c8b54d6'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.167756 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-64720835-f1e3-477f-addf-d8fc9f178f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34f4dc2d138a4729ac7cfebabaf6653d'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.168422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-64720835-f1e3-477f-addf-d8fc9f178f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34f4dc2d138a4729ac7cfebabaf6653d'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.176567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-64720835-f1e3-477f-addf-d8fc9f178f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34f4dc2d138a4729ac7cfebabaf6653d'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.188322 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-64720835-f1e3-477f-addf-d8fc9f178f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34f4dc2d138a4729ac7cfebabaf6653d'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.189029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-64720835-f1e3-477f-addf-d8fc9f178f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34f4dc2d138a4729ac7cfebabaf6653d'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.270265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b9ce374e-3343-480a-a8e2-d6532f3d446b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c72bee5cd84070bcc92a156c8b54d6'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.270981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b9ce374e-3343-480a-a8e2-d6532f3d446b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c72bee5cd84070bcc92a156c8b54d6'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.271622 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b9ce374e-3343-480a-a8e2-d6532f3d446b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c72bee5cd84070bcc92a156c8b54d6'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.280814 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b9ce374e-3343-480a-a8e2-d6532f3d446b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c72bee5cd84070bcc92a156c8b54d6'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.299740 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1056/2084] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:58 2022] DELETE /identity/v3/users/e4c72bee5cd84070bcc92a156c8b54d6 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:59.300604 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce374e-3343-480a-a8e2-d6532f3d446b admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:59.302490 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b9ce374e-3343-480a-a8e2-d6532f3d446b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:59.365065 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1029/2085] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:58 2022] DELETE /identity/v3/users/34f4dc2d138a4729ac7cfebabaf6653d => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:59.365935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64720835-f1e3-477f-addf-d8fc9f178f13 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:59.367713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-64720835-f1e3-477f-addf-d8fc9f178f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:59.370417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce374e-3343-480a-a8e2-d6532f3d446b admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:59.446431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e26a78-1afc-49dd-807d-05ad7654ae9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:59.446711 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64720835-f1e3-477f-addf-d8fc9f178f13 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:59.448348 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e26a78-1afc-49dd-807d-05ad7654ae9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:59.448921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e26a78-1afc-49dd-807d-05ad7654ae9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:59.449591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e26a78-1afc-49dd-807d-05ad7654ae9e admin admin] PATH_INFO: `/v3/users/4545face9b5e4c1898438beb57856d05` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:59.452522 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e26a78-1afc-49dd-807d-05ad7654ae9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4545face9b5e4c1898438beb57856d05)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:59.454057 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c96fdb-1fcb-47bf-8cd5-9b13ad07463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:59.454748 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c96fdb-1fcb-47bf-8cd5-9b13ad07463e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:59.454942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e26a78-1afc-49dd-807d-05ad7654ae9e admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:59.455144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c96fdb-1fcb-47bf-8cd5-9b13ad07463e admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:59.455504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c96fdb-1fcb-47bf-8cd5-9b13ad07463e admin admin] PATH_INFO: `/v3/projects/667e1d1346554cb2944518e1bb3c6348` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:59.456813 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c96fdb-1fcb-47bf-8cd5-9b13ad07463e admin admin] RBAC: Authorizing `identity:delete_project(project_id=667e1d1346554cb2944518e1bb3c6348)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:59.458919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c96fdb-1fcb-47bf-8cd5-9b13ad07463e admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:51:59.623761 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d9c96fdb-1fcb-47bf-8cd5-9b13ad07463e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '667e1d1346554cb2944518e1bb3c6348', 'request_id': 'req-d9c96fdb-1fcb-47bf-8cd5-9b13ad07463e'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.729325 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d9c96fdb-1fcb-47bf-8cd5-9b13ad07463e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '667e1d1346554cb2944518e1bb3c6348', 'request_id': 'req-d9c96fdb-1fcb-47bf-8cd5-9b13ad07463e'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.736865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d9c96fdb-1fcb-47bf-8cd5-9b13ad07463e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '667e1d1346554cb2944518e1bb3c6348', 'request_id': 'req-d9c96fdb-1fcb-47bf-8cd5-9b13ad07463e'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.745809 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c9e26a78-1afc-49dd-807d-05ad7654ae9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4545face9b5e4c1898438beb57856d05'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.761469 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d9c96fdb-1fcb-47bf-8cd5-9b13ad07463e admin admin] The token cache is being invalidate because project 667e1d1346554cb2944518e1bb3c6348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:51:59.761866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d9c96fdb-1fcb-47bf-8cd5-9b13ad07463e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.762483 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d9c96fdb-1fcb-47bf-8cd5-9b13ad07463e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.764245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1030/2086] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:59 2022] DELETE /identity/v3/projects/667e1d1346554cb2944518e1bb3c6348 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:59.765552 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902f780-2ab6-4534-9c1c-75508f42ede0 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:59.765832 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902f780-2ab6-4534-9c1c-75508f42ede0 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:59.766106 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902f780-2ab6-4534-9c1c-75508f42ede0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:59.795961 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-1902f780-2ab6-4534-9c1c-75508f42ede0 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:51:59.796948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1902f780-2ab6-4534-9c1c-75508f42ede0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:59.832131 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c9e26a78-1afc-49dd-807d-05ad7654ae9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4545face9b5e4c1898438beb57856d05'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.832805 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c9e26a78-1afc-49dd-807d-05ad7654ae9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4545face9b5e4c1898438beb57856d05'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.833426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c9e26a78-1afc-49dd-807d-05ad7654ae9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4545face9b5e4c1898438beb57856d05'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.844286 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c9e26a78-1afc-49dd-807d-05ad7654ae9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4545face9b5e4c1898438beb57856d05'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:51:59.866598 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1057/2087] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:59 2022] DELETE /identity/v3/users/4545face9b5e4c1898438beb57856d05 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:51:59.868738 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e26a78-1afc-49dd-807d-05ad7654ae9e admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:59.872301 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c9e26a78-1afc-49dd-807d-05ad7654ae9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:59.886311 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1031/2088] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:51:59.887267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902f780-2ab6-4534-9c1c-75508f42ede0 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:51:59.891506 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1902f780-2ab6-4534-9c1c-75508f42ede0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:51:59.910234 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902f780-2ab6-4534-9c1c-75508f42ede0 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:59.954740 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e26a78-1afc-49dd-807d-05ad7654ae9e admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:51:59.960061 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17684683-980b-486c-ae45-6202eacdc894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:51:59.960870 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17684683-980b-486c-ae45-6202eacdc894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:51:59.961276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17684683-980b-486c-ae45-6202eacdc894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:51:59.961686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17684683-980b-486c-ae45-6202eacdc894 admin admin] PATH_INFO: `/v3/users/f72cd23bdf8447d5a0341f6ec7939b31` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:51:59.963192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17684683-980b-486c-ae45-6202eacdc894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f72cd23bdf8447d5a0341f6ec7939b31)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:51:59.965405 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17684683-980b-486c-ae45-6202eacdc894 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:00.014207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:00.014921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:00.017507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:00.017507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f admin admin] PATH_INFO: `/v3/projects/f9c4d7f488e040fcac49477a11af9b67` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:00.017507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c4d7f488e040fcac49477a11af9b67)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:00.018835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:00.224809 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-17684683-980b-486c-ae45-6202eacdc894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f72cd23bdf8447d5a0341f6ec7939b31'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:00.230001 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c4d7f488e040fcac49477a11af9b67', 'request_id': 'req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:00.329603 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-17684683-980b-486c-ae45-6202eacdc894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f72cd23bdf8447d5a0341f6ec7939b31'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:00.330278 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-17684683-980b-486c-ae45-6202eacdc894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f72cd23bdf8447d5a0341f6ec7939b31'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:00.330923 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-17684683-980b-486c-ae45-6202eacdc894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f72cd23bdf8447d5a0341f6ec7939b31'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:00.338669 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-17684683-980b-486c-ae45-6202eacdc894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f72cd23bdf8447d5a0341f6ec7939b31'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:00.360921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1058/2089] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:51:59 2022] DELETE /identity/v3/users/f72cd23bdf8447d5a0341f6ec7939b31 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:00.361789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17684683-980b-486c-ae45-6202eacdc894 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:00.363217 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-17684683-980b-486c-ae45-6202eacdc894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:00.466286 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17684683-980b-486c-ae45-6202eacdc894 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:00.474362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e44a8f-fe5e-4b15-aebf-850e11f81465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:00.475823 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e44a8f-fe5e-4b15-aebf-850e11f81465 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:00.476284 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c4d7f488e040fcac49477a11af9b67', 'request_id': 'req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:00.476779 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e44a8f-fe5e-4b15-aebf-850e11f81465 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:00.477481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e44a8f-fe5e-4b15-aebf-850e11f81465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:00.481309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-83e44a8f-fe5e-4b15-aebf-850e11f81465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:00.492483 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c4d7f488e040fcac49477a11af9b67', 'request_id': 'req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:00.509739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f admin admin] The token cache is being invalidate because project f9c4d7f488e040fcac49477a11af9b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:00.510068 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:00.511148 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:00.518373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1032/2090] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:51:59 2022] DELETE /identity/v3/projects/f9c4d7f488e040fcac49477a11af9b67 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:00.543844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:00.552150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:00.617622 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e44a8f-fe5e-4b15-aebf-850e11f81465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:00.619287 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e44a8f-fe5e-4b15-aebf-850e11f81465 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:00.634685 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1059/2091] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:00.636373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de8dd3-d94e-409e-b114-d9ef6dc88ce6 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:00.636856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de8dd3-d94e-409e-b114-d9ef6dc88ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:00.637148 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de8dd3-d94e-409e-b114-d9ef6dc88ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:00.667591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-47de8dd3-d94e-409e-b114-d9ef6dc88ce6 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:00.669153 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-47de8dd3-d94e-409e-b114-d9ef6dc88ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:00.681885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1060/2092] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:00.691650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b145-5f97-4a5f-b21d-76252ae4c656 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:00.692077 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b145-5f97-4a5f-b21d-76252ae4c656 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:00.692447 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b145-5f97-4a5f-b21d-76252ae4c656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:00.714619 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e126f78-83ab-4d07-87b6-a91c3cefbb2f admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:00.720632 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c7e49-340f-4ebf-988b-bb2d90f60fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:00.721294 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c7e49-340f-4ebf-988b-bb2d90f60fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:00.721654 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c7e49-340f-4ebf-988b-bb2d90f60fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:00.722071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c7e49-340f-4ebf-988b-bb2d90f60fc7 admin admin] PATH_INFO: `/v3/projects/baf0291351b246f58815f1190d67c6af` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:00.722827 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-9e19b145-5f97-4a5f-b21d-76252ae4c656 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:00.723273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c7e49-340f-4ebf-988b-bb2d90f60fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baf0291351b246f58815f1190d67c6af)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:00.725542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c7e49-340f-4ebf-988b-bb2d90f60fc7 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:00.725897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9e19b145-5f97-4a5f-b21d-76252ae4c656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:00.741317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1061/2093] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:00.746760 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19b145-5f97-4a5f-b21d-76252ae4c656 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:00.760134 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19b145-5f97-4a5f-b21d-76252ae4c656 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:00.770286 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f64ed1-e74f-41dd-8dab-dca6370a8077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:00.770916 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f64ed1-e74f-41dd-8dab-dca6370a8077 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:00.771203 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f64ed1-e74f-41dd-8dab-dca6370a8077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:00.771469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f64ed1-e74f-41dd-8dab-dca6370a8077 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:00.772158 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f64ed1-e74f-41dd-8dab-dca6370a8077 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:52:00.773058 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f64ed1-e74f-41dd-8dab-dca6370a8077 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:00.774868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f64ed1-e74f-41dd-8dab-dca6370a8077 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:00.794159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1062/2094] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:52:00.799983 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f64ed1-e74f-41dd-8dab-dca6370a8077 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:00.812463 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f64ed1-e74f-41dd-8dab-dca6370a8077 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:00.822303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd6185-436c-4644-bb2a-17cdfb36d015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:00.823026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd6185-436c-4644-bb2a-17cdfb36d015 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:00.823364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd6185-436c-4644-bb2a-17cdfb36d015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:00.823739 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd6185-436c-4644-bb2a-17cdfb36d015 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:00.824383 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd6185-436c-4644-bb2a-17cdfb36d015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:00.826406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd6185-436c-4644-bb2a-17cdfb36d015 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:00.905827 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:00.907376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-209c7e49-340f-4ebf-988b-bb2d90f60fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baf0291351b246f58815f1190d67c6af', 'request_id': 'req-209c7e49-340f-4ebf-988b-bb2d90f60fc7'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:00.972558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1063/2095] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:00 2022] POST /identity/v3/projects => generated 389 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:52:00.977203 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd6185-436c-4644-bb2a-17cdfb36d015 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:01.024596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-209c7e49-340f-4ebf-988b-bb2d90f60fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baf0291351b246f58815f1190d67c6af', 'request_id': 'req-209c7e49-340f-4ebf-988b-bb2d90f60fc7'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:01.029697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:01.036503 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-209c7e49-340f-4ebf-988b-bb2d90f60fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baf0291351b246f58815f1190d67c6af', 'request_id': 'req-209c7e49-340f-4ebf-988b-bb2d90f60fc7'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:01.049267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-209c7e49-340f-4ebf-988b-bb2d90f60fc7 admin admin] The token cache is being invalidate because project baf0291351b246f58815f1190d67c6af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:01.050080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-209c7e49-340f-4ebf-988b-bb2d90f60fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:01.051099 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-209c7e49-340f-4ebf-988b-bb2d90f60fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:01.052657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1033/2096] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:00 2022] DELETE /identity/v3/projects/baf0291351b246f58815f1190d67c6af => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:01.058571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a773703-033d-4f8d-912f-17407fccf817 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:01.059013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a773703-033d-4f8d-912f-17407fccf817 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:01.059350 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a773703-033d-4f8d-912f-17407fccf817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:01.067678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd6185-436c-4644-bb2a-17cdfb36d015 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:01.072758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed01666-7f9b-4c49-a1b3-6a1bba468abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:01.073382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed01666-7f9b-4c49-a1b3-6a1bba468abe admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:01.075092 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed01666-7f9b-4c49-a1b3-6a1bba468abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:01.075092 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed01666-7f9b-4c49-a1b3-6a1bba468abe admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:01.075092 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed01666-7f9b-4c49-a1b3-6a1bba468abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:01.077945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed01666-7f9b-4c49-a1b3-6a1bba468abe admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:01.085674 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-6a773703-033d-4f8d-912f-17407fccf817 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:01.087016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-6a773703-033d-4f8d-912f-17407fccf817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:01.096052 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1034/2097] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:01.104732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165f379-69cd-482d-a2d4-d6d0c1652cff None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:01.104732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165f379-69cd-482d-a2d4-d6d0c1652cff None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:01.104732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165f379-69cd-482d-a2d4-d6d0c1652cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:01.137765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-4165f379-69cd-482d-a2d4-d6d0c1652cff None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:01.139597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4165f379-69cd-482d-a2d4-d6d0c1652cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:01.161573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1035/2098] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:52:01.162433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165f379-69cd-482d-a2d4-d6d0c1652cff None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:01.163899 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4165f379-69cd-482d-a2d4-d6d0c1652cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:01.191539 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165f379-69cd-482d-a2d4-d6d0c1652cff None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:01.191539 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1833b2-d701-443b-8b62-90b2d5878816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:01.191539 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1833b2-d701-443b-8b62-90b2d5878816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:01.191539 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1833b2-d701-443b-8b62-90b2d5878816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:01.192222 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1833b2-d701-443b-8b62-90b2d5878816 admin admin] PATH_INFO: `/v3/projects/e3dc1dcc10844cddb44147f125bd3b8f` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:01.193036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1833b2-d701-443b-8b62-90b2d5878816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3dc1dcc10844cddb44147f125bd3b8f)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:01.195056 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1833b2-d701-443b-8b62-90b2d5878816 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:01.293344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1064/2099] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:00 2022] POST /identity/v3/users => generated 295 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:52:01.294189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed01666-7f9b-4c49-a1b3-6a1bba468abe admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:01.305457 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed01666-7f9b-4c49-a1b3-6a1bba468abe admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:01.310879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c75f48-f319-42f6-9979-683054e96c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:01.311495 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c75f48-f319-42f6-9979-683054e96c7c admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:01.311787 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c75f48-f319-42f6-9979-683054e96c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:01.312064 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c75f48-f319-42f6-9979-683054e96c7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:01.312707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c75f48-f319-42f6-9979-683054e96c7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:52:01.313031 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c75f48-f319-42f6-9979-683054e96c7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:01.314788 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c75f48-f319-42f6-9979-683054e96c7c admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:01.329941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1065/2100] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:52:01.329941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c75f48-f319-42f6-9979-683054e96c7c admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:01.333971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-24c75f48-f319-42f6-9979-683054e96c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:01.348752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c75f48-f319-42f6-9979-683054e96c7c admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:01.355809 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a6b4a-ee46-4d28-864a-e1d32590c2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:01.356946 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a6b4a-ee46-4d28-864a-e1d32590c2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:01.357152 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a6b4a-ee46-4d28-864a-e1d32590c2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:01.358350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a6b4a-ee46-4d28-864a-e1d32590c2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:01.359011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a6b4a-ee46-4d28-864a-e1d32590c2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:01.360913 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a6b4a-ee46-4d28-864a-e1d32590c2b8 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:01.372616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1066/2101] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:01.373680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a6b4a-ee46-4d28-864a-e1d32590c2b8 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:01.376953 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a57a6b4a-ee46-4d28-864a-e1d32590c2b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:01.390953 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a6b4a-ee46-4d28-864a-e1d32590c2b8 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:01.396945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bcbe6-02ab-4b49-a89c-27449d4059b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:01.397596 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bcbe6-02ab-4b49-a89c-27449d4059b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:01.398628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bcbe6-02ab-4b49-a89c-27449d4059b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:01.398628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bcbe6-02ab-4b49-a89c-27449d4059b7 admin admin] PATH_INFO: `/v3/projects/b3c10ab1a3724283b2f035ca71f3bc8d` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:01.401156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bcbe6-02ab-4b49-a89c-27449d4059b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c10ab1a3724283b2f035ca71f3bc8d)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:01.401275 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bcbe6-02ab-4b49-a89c-27449d4059b7 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:01.419139 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4e1833b2-d701-443b-8b62-90b2d5878816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3dc1dcc10844cddb44147f125bd3b8f', 'request_id': 'req-4e1833b2-d701-443b-8b62-90b2d5878816'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:01.523851 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4e1833b2-d701-443b-8b62-90b2d5878816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3dc1dcc10844cddb44147f125bd3b8f', 'request_id': 'req-4e1833b2-d701-443b-8b62-90b2d5878816'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:01.532269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4e1833b2-d701-443b-8b62-90b2d5878816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3dc1dcc10844cddb44147f125bd3b8f', 'request_id': 'req-4e1833b2-d701-443b-8b62-90b2d5878816'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:01.546089 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4e1833b2-d701-443b-8b62-90b2d5878816 admin admin] The token cache is being invalidate because project e3dc1dcc10844cddb44147f125bd3b8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:01.546371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4e1833b2-d701-443b-8b62-90b2d5878816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:01.547069 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4e1833b2-d701-443b-8b62-90b2d5878816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:01.547662 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c13bcbe6-02ab-4b49-a89c-27449d4059b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c10ab1a3724283b2f035ca71f3bc8d', 'request_id': 'req-c13bcbe6-02ab-4b49-a89c-27449d4059b7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:01.549041 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1036/2102] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:01 2022] DELETE /identity/v3/projects/e3dc1dcc10844cddb44147f125bd3b8f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:01.550122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1833b2-d701-443b-8b62-90b2d5878816 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:01.552697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4e1833b2-d701-443b-8b62-90b2d5878816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:01.562278 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c13bcbe6-02ab-4b49-a89c-27449d4059b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c10ab1a3724283b2f035ca71f3bc8d', 'request_id': 'req-c13bcbe6-02ab-4b49-a89c-27449d4059b7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:01.640978 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1833b2-d701-443b-8b62-90b2d5878816 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:01.681349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c13bcbe6-02ab-4b49-a89c-27449d4059b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c10ab1a3724283b2f035ca71f3bc8d', 'request_id': 'req-c13bcbe6-02ab-4b49-a89c-27449d4059b7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:01.694754 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c13bcbe6-02ab-4b49-a89c-27449d4059b7 admin admin] The token cache is being invalidate because project b3c10ab1a3724283b2f035ca71f3bc8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:01.695069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c13bcbe6-02ab-4b49-a89c-27449d4059b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:01.695836 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c13bcbe6-02ab-4b49-a89c-27449d4059b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:01.708994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1067/2103] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:01 2022] DELETE /identity/v3/projects/b3c10ab1a3724283b2f035ca71f3bc8d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:01.708994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bcbe6-02ab-4b49-a89c-27449d4059b7 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:01.710282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c13bcbe6-02ab-4b49-a89c-27449d4059b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:01.714950 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164df24-c2d9-4f8e-b8c4-eabea30dc6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:01.715623 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164df24-c2d9-4f8e-b8c4-eabea30dc6be admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:01.716063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164df24-c2d9-4f8e-b8c4-eabea30dc6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:01.716335 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164df24-c2d9-4f8e-b8c4-eabea30dc6be admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:01.717087 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164df24-c2d9-4f8e-b8c4-eabea30dc6be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:01.719085 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164df24-c2d9-4f8e-b8c4-eabea30dc6be admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:01.727971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bcbe6-02ab-4b49-a89c-27449d4059b7 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:01.730221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581e7a6-6c17-400a-b7de-30a87142ab6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:01.730834 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581e7a6-6c17-400a-b7de-30a87142ab6d admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:01.731110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581e7a6-6c17-400a-b7de-30a87142ab6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:01.731384 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581e7a6-6c17-400a-b7de-30a87142ab6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:01.732080 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581e7a6-6c17-400a-b7de-30a87142ab6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:01.734328 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581e7a6-6c17-400a-b7de-30a87142ab6d admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:01.745233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1068/2104] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:01.746168 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581e7a6-6c17-400a-b7de-30a87142ab6d admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:01.749390 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e581e7a6-6c17-400a-b7de-30a87142ab6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:01.767775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581e7a6-6c17-400a-b7de-30a87142ab6d admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:01.768306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e134073-a09d-40b7-9015-3ecde600cd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:01.769082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e134073-a09d-40b7-9015-3ecde600cd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:01.769082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e134073-a09d-40b7-9015-3ecde600cd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:01.769082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e134073-a09d-40b7-9015-3ecde600cd05 admin admin] PATH_INFO: `/v3/users/a5a14ed8cc9d47dc8b57b53bf579155c` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:01.770879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e134073-a09d-40b7-9015-3ecde600cd05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a14ed8cc9d47dc8b57b53bf579155c)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:01.772972 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e134073-a09d-40b7-9015-3ecde600cd05 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:01.850873 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1037/2105] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:01 2022] POST /identity/v3/projects => generated 383 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:01.851560 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164df24-c2d9-4f8e-b8c4-eabea30dc6be admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:01.853395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-6164df24-c2d9-4f8e-b8c4-eabea30dc6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:01.924179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164df24-c2d9-4f8e-b8c4-eabea30dc6be admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:01.929053 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e51c3-ac58-4cd2-8bd4-59df2049ee41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:01.929697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e51c3-ac58-4cd2-8bd4-59df2049ee41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:01.929978 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e51c3-ac58-4cd2-8bd4-59df2049ee41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:01.930282 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e51c3-ac58-4cd2-8bd4-59df2049ee41 admin admin] PATH_INFO: `/v3/users/9c1549c4fe2843ab8082534060e1f637` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:01.931432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e51c3-ac58-4cd2-8bd4-59df2049ee41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1549c4fe2843ab8082534060e1f637)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:01.933403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e51c3-ac58-4cd2-8bd4-59df2049ee41 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:01.970479 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-8e134073-a09d-40b7-9015-3ecde600cd05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a14ed8cc9d47dc8b57b53bf579155c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:02.157362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-8e134073-a09d-40b7-9015-3ecde600cd05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a14ed8cc9d47dc8b57b53bf579155c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:02.157996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-8e134073-a09d-40b7-9015-3ecde600cd05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a14ed8cc9d47dc8b57b53bf579155c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:02.158862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-8e134073-a09d-40b7-9015-3ecde600cd05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a14ed8cc9d47dc8b57b53bf579155c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:02.169996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-8e134073-a09d-40b7-9015-3ecde600cd05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a14ed8cc9d47dc8b57b53bf579155c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:02.192324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1069/2106] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:01 2022] DELETE /identity/v3/users/a5a14ed8cc9d47dc8b57b53bf579155c => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:02.193410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e134073-a09d-40b7-9015-3ecde600cd05 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:02.197126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8e134073-a09d-40b7-9015-3ecde600cd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:02.283781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e134073-a09d-40b7-9015-3ecde600cd05 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:02.286875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-aa4e51c3-ac58-4cd2-8bd4-59df2049ee41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1549c4fe2843ab8082534060e1f637'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:02.288336 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-aa4e51c3-ac58-4cd2-8bd4-59df2049ee41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1549c4fe2843ab8082534060e1f637'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:02.289707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0d427-2f65-4d9c-9b4f-ae2a6b232a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:02.290481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0d427-2f65-4d9c-9b4f-ae2a6b232a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:02.290875 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0d427-2f65-4d9c-9b4f-ae2a6b232a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:02.291348 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0d427-2f65-4d9c-9b4f-ae2a6b232a81 admin admin] PATH_INFO: `/v3/projects/2149f8448c2e41e19a541cc033f908f2/users/0a45f5c01ccc4338ba5934b9229f4a86/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:02.300016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-aa4e51c3-ac58-4cd2-8bd4-59df2049ee41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1549c4fe2843ab8082534060e1f637'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:02.309358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0d427-2f65-4d9c-9b4f-ae2a6b232a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2149f8448c2e41e19a541cc033f908f2, user_id=0a45f5c01ccc4338ba5934b9229f4a86, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:02.313022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0d427-2f65-4d9c-9b4f-ae2a6b232a81 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:02.316546 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-aa4e51c3-ac58-4cd2-8bd4-59df2049ee41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1549c4fe2843ab8082534060e1f637'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:02.317618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-aa4e51c3-ac58-4cd2-8bd4-59df2049ee41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1549c4fe2843ab8082534060e1f637'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:02.443624 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1070/2107] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:02 2022] PUT /identity/v3/projects/2149f8448c2e41e19a541cc033f908f2/users/0a45f5c01ccc4338ba5934b9229f4a86/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:02.445071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0d427-2f65-4d9c-9b4f-ae2a6b232a81 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:02.445252 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1038/2108] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:01 2022] DELETE /identity/v3/users/9c1549c4fe2843ab8082534060e1f637 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:02.447421 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-d8a0d427-2f65-4d9c-9b4f-ae2a6b232a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:02.459782 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f62059-2619-4753-b2ee-b250a77d1dd6 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:02.462039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f62059-2619-4753-b2ee-b250a77d1dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:02.463134 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f62059-2619-4753-b2ee-b250a77d1dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:02.529227 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-c8f62059-2619-4753-b2ee-b250a77d1dd6 None None] MFA Rules not processed for user `0a45f5c01ccc4338ba5934b9229f4a86`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:02.531370 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c8f62059-2619-4753-b2ee-b250a77d1dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:02.565096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0d427-2f65-4d9c-9b4f-ae2a6b232a81 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:02.647868 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1039/2109] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:02.650344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f62059-2619-4753-b2ee-b250a77d1dd6 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:02.651254 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6065208-8755-4b98-8859-bfd4f1d4bd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:02.652161 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6065208-8755-4b98-8859-bfd4f1d4bd61 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:02.652655 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6065208-8755-4b98-8859-bfd4f1d4bd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:02.652944 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6065208-8755-4b98-8859-bfd4f1d4bd61 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:02.653624 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6065208-8755-4b98-8859-bfd4f1d4bd61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:02.655680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6065208-8755-4b98-8859-bfd4f1d4bd61 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:02.660640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c8f62059-2619-4753-b2ee-b250a77d1dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:02.679931 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f62059-2619-4753-b2ee-b250a77d1dd6 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:02.684988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8958b6-e92c-485f-a22c-dee59613c873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:02.686252 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8958b6-e92c-485f-a22c-dee59613c873 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:02.687290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8958b6-e92c-485f-a22c-dee59613c873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:02.687290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8958b6-e92c-485f-a22c-dee59613c873 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:02.687611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8958b6-e92c-485f-a22c-dee59613c873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:02.689362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8958b6-e92c-485f-a22c-dee59613c873 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:02.791706 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1071/2110] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:02 2022] POST /identity/v3/users => generated 292 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:02.799207 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6065208-8755-4b98-8859-bfd4f1d4bd61 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:02.818548 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6065208-8755-4b98-8859-bfd4f1d4bd61 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:02.827051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753aac3b-7957-4bf2-8822-755574fe8662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:02.827971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753aac3b-7957-4bf2-8822-755574fe8662 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:02.828351 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753aac3b-7957-4bf2-8822-755574fe8662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:02.830049 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753aac3b-7957-4bf2-8822-755574fe8662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:02.830049 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753aac3b-7957-4bf2-8822-755574fe8662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:02.834622 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753aac3b-7957-4bf2-8822-755574fe8662 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:02.839792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1040/2111] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:02 2022] POST /identity/v3/projects => generated 389 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:02.841504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8958b6-e92c-485f-a22c-dee59613c873 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:02.856209 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1072/2112] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:02.858565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753aac3b-7957-4bf2-8822-755574fe8662 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:02.884769 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753aac3b-7957-4bf2-8822-755574fe8662 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:02.893197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:03.005091 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8958b6-e92c-485f-a22c-dee59613c873 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:03.025793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b58f5-a42f-4279-a7cb-16a8abd55f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:03.027289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b58f5-a42f-4279-a7cb-16a8abd55f93 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:03.028193 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b58f5-a42f-4279-a7cb-16a8abd55f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:03.028924 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b58f5-a42f-4279-a7cb-16a8abd55f93 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:03.031237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b58f5-a42f-4279-a7cb-16a8abd55f93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:03.031451 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc15ed8-84e0-4e81-b923-21ed8dde5e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:03.033131 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc15ed8-84e0-4e81-b923-21ed8dde5e00 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:03.034160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc15ed8-84e0-4e81-b923-21ed8dde5e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:03.034773 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc15ed8-84e0-4e81-b923-21ed8dde5e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:03.036109 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc15ed8-84e0-4e81-b923-21ed8dde5e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:03.040572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc15ed8-84e0-4e81-b923-21ed8dde5e00 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:03.055661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b58f5-a42f-4279-a7cb-16a8abd55f93 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:03.089273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1073/2113] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:03.096856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc15ed8-84e0-4e81-b923-21ed8dde5e00 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:03.127321 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc15ed8-84e0-4e81-b923-21ed8dde5e00 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:03.145500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459a9e2-be01-46cf-8f88-c6651ff1ff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:03.145500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459a9e2-be01-46cf-8f88-c6651ff1ff3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:03.145500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459a9e2-be01-46cf-8f88-c6651ff1ff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:03.145500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459a9e2-be01-46cf-8f88-c6651ff1ff3a admin admin] PATH_INFO: `/v3/projects/8259043f3b9047d0b0927256a796852b/users/002cd7cb206d47919efd2444edd91568/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:03.190663 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459a9e2-be01-46cf-8f88-c6651ff1ff3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8259043f3b9047d0b0927256a796852b, user_id=002cd7cb206d47919efd2444edd91568, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:03.207346 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459a9e2-be01-46cf-8f88-c6651ff1ff3a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:03.252807 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1041/2114] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:02 2022] POST /identity/v3/users => generated 301 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:03.254642 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b58f5-a42f-4279-a7cb-16a8abd55f93 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:03.258349 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c99b58f5-a42f-4279-a7cb-16a8abd55f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:03.284974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b58f5-a42f-4279-a7cb-16a8abd55f93 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:03.292983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff908936-8c78-4fca-a054-93e5743a8256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:03.294017 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff908936-8c78-4fca-a054-93e5743a8256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:03.294478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff908936-8c78-4fca-a054-93e5743a8256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:03.296952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff908936-8c78-4fca-a054-93e5743a8256 admin admin] PATH_INFO: `/v3/projects/562afdcac94443729522e921007933d2` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:03.299317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff908936-8c78-4fca-a054-93e5743a8256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=562afdcac94443729522e921007933d2)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:03.302765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff908936-8c78-4fca-a054-93e5743a8256 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:03.335106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1074/2115] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:03 2022] PUT /identity/v3/projects/8259043f3b9047d0b0927256a796852b/users/002cd7cb206d47919efd2444edd91568/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:03.336351 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459a9e2-be01-46cf-8f88-c6651ff1ff3a admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:03.469290 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459a9e2-be01-46cf-8f88-c6651ff1ff3a admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:03.496574 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ff908936-8c78-4fca-a054-93e5743a8256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '562afdcac94443729522e921007933d2', 'request_id': 'req-ff908936-8c78-4fca-a054-93e5743a8256'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:03.557411 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8d9cb-02ff-4a5a-ade9-9385dc06e998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:03.558736 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8d9cb-02ff-4a5a-ade9-9385dc06e998 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:03.559226 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8d9cb-02ff-4a5a-ade9-9385dc06e998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:03.559342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8d9cb-02ff-4a5a-ade9-9385dc06e998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:03.560019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8d9cb-02ff-4a5a-ade9-9385dc06e998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:03.562527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8d9cb-02ff-4a5a-ade9-9385dc06e998 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:03.575643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1075/2116] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:03.577007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e0f45-f5c6-4abe-a69d-97ad1b3806e0 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:03.577291 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e0f45-f5c6-4abe-a69d-97ad1b3806e0 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:03.577565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e0f45-f5c6-4abe-a69d-97ad1b3806e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:03.612534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-2b1e0f45-f5c6-4abe-a69d-97ad1b3806e0 None None] MFA Rules not processed for user `002cd7cb206d47919efd2444edd91568`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:03.612964 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ff908936-8c78-4fca-a054-93e5743a8256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '562afdcac94443729522e921007933d2', 'request_id': 'req-ff908936-8c78-4fca-a054-93e5743a8256'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:03.613937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2b1e0f45-f5c6-4abe-a69d-97ad1b3806e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:03.622301 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ff908936-8c78-4fca-a054-93e5743a8256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '562afdcac94443729522e921007933d2', 'request_id': 'req-ff908936-8c78-4fca-a054-93e5743a8256'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:03.639070 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ff908936-8c78-4fca-a054-93e5743a8256 admin admin] The token cache is being invalidate because project 562afdcac94443729522e921007933d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:03.639636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ff908936-8c78-4fca-a054-93e5743a8256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:03.640392 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ff908936-8c78-4fca-a054-93e5743a8256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:03.642799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1042/2117] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:03 2022] DELETE /identity/v3/projects/562afdcac94443729522e921007933d2 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:03.647635 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff908936-8c78-4fca-a054-93e5743a8256 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:03.647635 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ff908936-8c78-4fca-a054-93e5743a8256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:03.659856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff908936-8c78-4fca-a054-93e5743a8256 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:03.668546 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db822450-ae8c-4917-8b35-f80a8ae67fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:03.669407 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db822450-ae8c-4917-8b35-f80a8ae67fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:03.670994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db822450-ae8c-4917-8b35-f80a8ae67fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:03.671404 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db822450-ae8c-4917-8b35-f80a8ae67fe5 admin admin] PATH_INFO: `/v3/projects/7ba92cd5bf044e4f81e4fd448eaf6fd2` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:03.674162 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db822450-ae8c-4917-8b35-f80a8ae67fe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba92cd5bf044e4f81e4fd448eaf6fd2)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:03.677141 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db822450-ae8c-4917-8b35-f80a8ae67fe5 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:03.718776 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1076/2118] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:03.720008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e0f45-f5c6-4abe-a69d-97ad1b3806e0 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:03.721813 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2b1e0f45-f5c6-4abe-a69d-97ad1b3806e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:03.729936 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:03.743529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e0f45-f5c6-4abe-a69d-97ad1b3806e0 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:03.751823 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf4acf-e535-46c9-8fd2-201912981b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:03.752540 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf4acf-e535-46c9-8fd2-201912981b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:03.752827 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf4acf-e535-46c9-8fd2-201912981b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:03.753271 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf4acf-e535-46c9-8fd2-201912981b24 admin admin] PATH_INFO: `/v3/projects/1b8bf2035d7144e8a760b55444a9c471/users/ebf933fe9f114e7fadecea806d8fcc24/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:03.775909 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf4acf-e535-46c9-8fd2-201912981b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8bf2035d7144e8a760b55444a9c471, user_id=ebf933fe9f114e7fadecea806d8fcc24, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:03.781064 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf4acf-e535-46c9-8fd2-201912981b24 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:03.893265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1077/2119] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:03 2022] PUT /identity/v3/projects/1b8bf2035d7144e8a760b55444a9c471/users/ebf933fe9f114e7fadecea806d8fcc24/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:03.894590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db668b2-459b-4986-bc0b-847e31add95c None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:03.894882 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db668b2-459b-4986-bc0b-847e31add95c None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:03.895159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db668b2-459b-4986-bc0b-847e31add95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:03.913539 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-db822450-ae8c-4917-8b35-f80a8ae67fe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba92cd5bf044e4f81e4fd448eaf6fd2', 'request_id': 'req-db822450-ae8c-4917-8b35-f80a8ae67fe5'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:03.920838 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-6db668b2-459b-4986-bc0b-847e31add95c None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:03.921509 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-6db668b2-459b-4986-bc0b-847e31add95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:03.990772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1078/2120] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:03.991756 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db668b2-459b-4986-bc0b-847e31add95c None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:03.993167 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-6db668b2-459b-4986-bc0b-847e31add95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:04.058878 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-db822450-ae8c-4917-8b35-f80a8ae67fe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba92cd5bf044e4f81e4fd448eaf6fd2', 'request_id': 'req-db822450-ae8c-4917-8b35-f80a8ae67fe5'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:04.066155 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db668b2-459b-4986-bc0b-847e31add95c None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:04.067745 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-db822450-ae8c-4917-8b35-f80a8ae67fe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba92cd5bf044e4f81e4fd448eaf6fd2', 'request_id': 'req-db822450-ae8c-4917-8b35-f80a8ae67fe5'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:04.070956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1937952-258a-4fa6-a847-f066db58241d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:04.071956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1937952-258a-4fa6-a847-f066db58241d service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:04.072453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1937952-258a-4fa6-a847-f066db58241d service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:04.073066 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1937952-258a-4fa6-a847-f066db58241d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:04.085625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-db822450-ae8c-4917-8b35-f80a8ae67fe5 admin admin] The token cache is being invalidate because project 7ba92cd5bf044e4f81e4fd448eaf6fd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:04.086106 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-db822450-ae8c-4917-8b35-f80a8ae67fe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:04.087123 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-db822450-ae8c-4917-8b35-f80a8ae67fe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:04.089432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1043/2121] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:03 2022] DELETE /identity/v3/projects/7ba92cd5bf044e4f81e4fd448eaf6fd2 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:04.090781 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db822450-ae8c-4917-8b35-f80a8ae67fe5 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:04.093362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-db822450-ae8c-4917-8b35-f80a8ae67fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:04.113547 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db822450-ae8c-4917-8b35-f80a8ae67fe5 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:04.120756 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fffc76-9a65-431a-ad0b-0d8303cbca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:04.121606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fffc76-9a65-431a-ad0b-0d8303cbca8b admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:04.121985 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fffc76-9a65-431a-ad0b-0d8303cbca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:04.122383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fffc76-9a65-431a-ad0b-0d8303cbca8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:04.123844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fffc76-9a65-431a-ad0b-0d8303cbca8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:04.126253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fffc76-9a65-431a-ad0b-0d8303cbca8b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:04.144789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1044/2122] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:04.147417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f626fa-a30f-48da-b190-361eba195fb6 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:04.148037 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f626fa-a30f-48da-b190-361eba195fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:04.148785 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f626fa-a30f-48da-b190-361eba195fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:04.158064 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1937952-258a-4fa6-a847-f066db58241d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:04.160216 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1937952-258a-4fa6-a847-f066db58241d service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:04.175980 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1079/2123] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:04.178972 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804ab63-2658-4bba-8af4-f94526f07141 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:04.179599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804ab63-2658-4bba-8af4-f94526f07141 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:04.182335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804ab63-2658-4bba-8af4-f94526f07141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:04.182476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-92f626fa-a30f-48da-b190-361eba195fb6 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:04.185070 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-92f626fa-a30f-48da-b190-361eba195fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:04.204163 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1045/2124] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:04.204163 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f626fa-a30f-48da-b190-361eba195fb6 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:04.217050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-4804ab63-2658-4bba-8af4-f94526f07141 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:04.218541 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-4804ab63-2658-4bba-8af4-f94526f07141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:04.223227 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f626fa-a30f-48da-b190-361eba195fb6 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:04.229909 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1080/2125] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:04.231152 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804ab63-2658-4bba-8af4-f94526f07141 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:04.233361 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb796e1-e61d-40ec-aeaf-39a9c9f60b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:04.234508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb796e1-e61d-40ec-aeaf-39a9c9f60b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:04.234992 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb796e1-e61d-40ec-aeaf-39a9c9f60b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:04.235615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb796e1-e61d-40ec-aeaf-39a9c9f60b98 admin admin] PATH_INFO: `/v3/projects/1b8bf2035d7144e8a760b55444a9c471/users/ebf933fe9f114e7fadecea806d8fcc24/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:04.242872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb796e1-e61d-40ec-aeaf-39a9c9f60b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8bf2035d7144e8a760b55444a9c471, user_id=ebf933fe9f114e7fadecea806d8fcc24, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:04.243829 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804ab63-2658-4bba-8af4-f94526f07141 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:04.250215 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb796e1-e61d-40ec-aeaf-39a9c9f60b98 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:04.262677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516ca4c-39d2-46c2-99bd-f538709561dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:04.262677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516ca4c-39d2-46c2-99bd-f538709561dd admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:04.262677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516ca4c-39d2-46c2-99bd-f538709561dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:04.262677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516ca4c-39d2-46c2-99bd-f538709561dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:04.263270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516ca4c-39d2-46c2-99bd-f538709561dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:52:04.263270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516ca4c-39d2-46c2-99bd-f538709561dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:04.263270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516ca4c-39d2-46c2-99bd-f538709561dd admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:04.274165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1081/2126] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:52:04.274165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e326c-e6aa-4ca4-9a0f-f2a0e29759c4 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:04.274165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e326c-e6aa-4ca4-9a0f-f2a0e29759c4 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:04.274165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e326c-e6aa-4ca4-9a0f-f2a0e29759c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:04.287029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1046/2127] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:04 2022] PUT /identity/v3/projects/1b8bf2035d7144e8a760b55444a9c471/users/ebf933fe9f114e7fadecea806d8fcc24/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:04.288711 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb796e1-e61d-40ec-aeaf-39a9c9f60b98 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:04.297332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-052e326c-e6aa-4ca4-9a0f-f2a0e29759c4 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:04.298815 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-052e326c-e6aa-4ca4-9a0f-f2a0e29759c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:04.374416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1082/2128] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:04.375992 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c55e3-4c3d-4e99-a0e7-365f4a360391 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:04.376863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c55e3-4c3d-4e99-a0e7-365f4a360391 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:04.376863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c55e3-4c3d-4e99-a0e7-365f4a360391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:04.410430 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-943c55e3-4c3d-4e99-a0e7-365f4a360391 None None] MFA Rules not processed for user `ebf933fe9f114e7fadecea806d8fcc24`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:04.411713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-943c55e3-4c3d-4e99-a0e7-365f4a360391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:04.426370 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb796e1-e61d-40ec-aeaf-39a9c9f60b98 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:04.439384 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5501364-75bc-4dc6-9826-4753cc64ad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:04.440563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5501364-75bc-4dc6-9826-4753cc64ad58 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:04.441156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5501364-75bc-4dc6-9826-4753cc64ad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:04.441571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5501364-75bc-4dc6-9826-4753cc64ad58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:04.442820 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5501364-75bc-4dc6-9826-4753cc64ad58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:04.445980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5501364-75bc-4dc6-9826-4753cc64ad58 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:04.517121 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1083/2129] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:04 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:04.518304 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c55e3-4c3d-4e99-a0e7-365f4a360391 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:04.531326 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c55e3-4c3d-4e99-a0e7-365f4a360391 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:04.537254 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0da35-e1a0-4077-b95c-6b07e0f8ee03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:04.537926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0da35-e1a0-4077-b95c-6b07e0f8ee03 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:04.538222 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0da35-e1a0-4077-b95c-6b07e0f8ee03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:04.538527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0da35-e1a0-4077-b95c-6b07e0f8ee03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:04.539260 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0da35-e1a0-4077-b95c-6b07e0f8ee03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:52:04.540060 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0da35-e1a0-4077-b95c-6b07e0f8ee03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:04.541896 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0da35-e1a0-4077-b95c-6b07e0f8ee03 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:04.555715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1084/2130] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:52:04.556638 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0da35-e1a0-4077-b95c-6b07e0f8ee03 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:04.558494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b9c0da35-e1a0-4077-b95c-6b07e0f8ee03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:04.573498 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1047/2131] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:04 2022] POST /identity/v3/projects => generated 365 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:04.574757 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5501364-75bc-4dc6-9826-4753cc64ad58 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:04.577167 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:04.641694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0da35-e1a0-4077-b95c-6b07e0f8ee03 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:04.670929 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5501364-75bc-4dc6-9826-4753cc64ad58 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:04.686839 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abf280-535c-4a58-a2ba-42803b13d55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:04.690097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abf280-535c-4a58-a2ba-42803b13d55b admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:04.695493 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abf280-535c-4a58-a2ba-42803b13d55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:04.695493 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abf280-535c-4a58-a2ba-42803b13d55b admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:04.695493 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abf280-535c-4a58-a2ba-42803b13d55b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:04.695918 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abf280-535c-4a58-a2ba-42803b13d55b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:04.724891 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcb33d-a495-4c55-9ba4-8d362fcdc3a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:04.725804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb33d-a495-4c55-9ba4-8d362fcdc3a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:04.726140 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb33d-a495-4c55-9ba4-8d362fcdc3a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:04.726484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb33d-a495-4c55-9ba4-8d362fcdc3a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:04.812070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcb33d-a495-4c55-9ba4-8d362fcdc3a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:04.813741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcb33d-a495-4c55-9ba4-8d362fcdc3a9 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:04.826565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1085/2132] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:04 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:04.827541 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcb33d-a495-4c55-9ba4-8d362fcdc3a9 service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:04.835939 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1048/2133] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:04 2022] POST /identity/v3/projects => generated 385 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:04.840818 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abf280-535c-4a58-a2ba-42803b13d55b admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:04.846275 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcb33d-a495-4c55-9ba4-8d362fcdc3a9 service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:04.982544 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a11721-6356-4889-8556-7937cd59a3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:04.984463 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a11721-6356-4889-8556-7937cd59a3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:04.984957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a11721-6356-4889-8556-7937cd59a3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:04.985377 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a11721-6356-4889-8556-7937cd59a3b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:04.986244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a11721-6356-4889-8556-7937cd59a3b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:04.988394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a11721-6356-4889-8556-7937cd59a3b0 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:04.995692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abf280-535c-4a58-a2ba-42803b13d55b admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:05.003556 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7e02e-28ea-4c75-a87a-5cdbe18c7c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:05.004928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7e02e-28ea-4c75-a87a-5cdbe18c7c97 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:05.005555 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7e02e-28ea-4c75-a87a-5cdbe18c7c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:05.006113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7e02e-28ea-4c75-a87a-5cdbe18c7c97 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:05.007375 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7e02e-28ea-4c75-a87a-5cdbe18c7c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:05.011428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7e02e-28ea-4c75-a87a-5cdbe18c7c97 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:05.102030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1086/2134] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:04 2022] POST /identity/v3/users => generated 283 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:05.106416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a11721-6356-4889-8556-7937cd59a3b0 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:05.121030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a11721-6356-4889-8556-7937cd59a3b0 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:05.125435 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b1666-c91d-4dde-857b-d460d3059c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:05.126792 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b1666-c91d-4dde-857b-d460d3059c06 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:05.127235 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b1666-c91d-4dde-857b-d460d3059c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:05.127539 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b1666-c91d-4dde-857b-d460d3059c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:05.128193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b1666-c91d-4dde-857b-d460d3059c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:05.129807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b1666-c91d-4dde-857b-d460d3059c06 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:05.140851 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1087/2135] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:05.141694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b1666-c91d-4dde-857b-d460d3059c06 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:05.151460 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b1666-c91d-4dde-857b-d460d3059c06 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:05.157128 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e45b7e-948d-4181-a42e-5cab53b41a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:05.157791 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e45b7e-948d-4181-a42e-5cab53b41a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:05.158070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e45b7e-948d-4181-a42e-5cab53b41a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:05.158346 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e45b7e-948d-4181-a42e-5cab53b41a4c admin admin] PATH_INFO: `/v3/users/0a45f5c01ccc4338ba5934b9229f4a86` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:05.159506 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e45b7e-948d-4181-a42e-5cab53b41a4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a45f5c01ccc4338ba5934b9229f4a86)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:05.161449 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e45b7e-948d-4181-a42e-5cab53b41a4c admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:05.176255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1049/2136] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:04 2022] POST /identity/v3/users => generated 293 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:52:05.177119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7e02e-28ea-4c75-a87a-5cdbe18c7c97 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:05.178841 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4da7e02e-28ea-4c75-a87a-5cdbe18c7c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:05.191147 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7e02e-28ea-4c75-a87a-5cdbe18c7c97 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:05.196238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f6f3e-f142-4c60-9b7a-005c676778be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:05.196764 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f6f3e-f142-4c60-9b7a-005c676778be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:05.197036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f6f3e-f142-4c60-9b7a-005c676778be admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:05.197299 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f6f3e-f142-4c60-9b7a-005c676778be admin admin] PATH_INFO: `/v3/users/cf5c97f9832a444096fd316b71a1bfa6` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:05.198411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f6f3e-f142-4c60-9b7a-005c676778be admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf5c97f9832a444096fd316b71a1bfa6)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:05.200448 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f6f3e-f142-4c60-9b7a-005c676778be admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:05.409639 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c4e45b7e-948d-4181-a42e-5cab53b41a4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a45f5c01ccc4338ba5934b9229f4a86'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:05.444032 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cd9f6f3e-f142-4c60-9b7a-005c676778be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf5c97f9832a444096fd316b71a1bfa6'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:05.444665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cd9f6f3e-f142-4c60-9b7a-005c676778be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf5c97f9832a444096fd316b71a1bfa6'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:05.453900 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cd9f6f3e-f142-4c60-9b7a-005c676778be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf5c97f9832a444096fd316b71a1bfa6'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:05.470753 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cd9f6f3e-f142-4c60-9b7a-005c676778be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf5c97f9832a444096fd316b71a1bfa6'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:05.471519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cd9f6f3e-f142-4c60-9b7a-005c676778be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf5c97f9832a444096fd316b71a1bfa6'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:05.511960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c4e45b7e-948d-4181-a42e-5cab53b41a4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a45f5c01ccc4338ba5934b9229f4a86'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:05.512675 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c4e45b7e-948d-4181-a42e-5cab53b41a4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a45f5c01ccc4338ba5934b9229f4a86'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:05.513327 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c4e45b7e-948d-4181-a42e-5cab53b41a4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a45f5c01ccc4338ba5934b9229f4a86'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:05.522215 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c4e45b7e-948d-4181-a42e-5cab53b41a4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a45f5c01ccc4338ba5934b9229f4a86'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:05.543240 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1088/2137] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:05 2022] DELETE /identity/v3/users/0a45f5c01ccc4338ba5934b9229f4a86 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:05.544158 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e45b7e-948d-4181-a42e-5cab53b41a4c admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:05.545885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c4e45b7e-948d-4181-a42e-5cab53b41a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:05.620710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e45b7e-948d-4181-a42e-5cab53b41a4c admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:05.626740 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05616d-1b1f-4b2b-bbc3-7753be6af663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:05.627382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05616d-1b1f-4b2b-bbc3-7753be6af663 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:05.627698 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05616d-1b1f-4b2b-bbc3-7753be6af663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:05.627974 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05616d-1b1f-4b2b-bbc3-7753be6af663 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:05.628642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05616d-1b1f-4b2b-bbc3-7753be6af663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:05.630479 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05616d-1b1f-4b2b-bbc3-7753be6af663 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:05.655132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1089/2138] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:05.657117 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05616d-1b1f-4b2b-bbc3-7753be6af663 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:05.658205 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7c05616d-1b1f-4b2b-bbc3-7753be6af663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:05.674022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1050/2139] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:05 2022] DELETE /identity/v3/users/cf5c97f9832a444096fd316b71a1bfa6 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:05.674022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b02dd-732a-4b43-b8a3-a0fa64c9ff65 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:05.674022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b02dd-732a-4b43-b8a3-a0fa64c9ff65 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:05.674022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b02dd-732a-4b43-b8a3-a0fa64c9ff65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:05.677369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05616d-1b1f-4b2b-bbc3-7753be6af663 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:05.700898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-751b02dd-732a-4b43-b8a3-a0fa64c9ff65 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:05.703237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-751b02dd-732a-4b43-b8a3-a0fa64c9ff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:05.743274 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:05.749012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da14157-8009-429c-a2ae-2306ce2d4c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:05.749424 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da14157-8009-429c-a2ae-2306ce2d4c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:05.749701 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da14157-8009-429c-a2ae-2306ce2d4c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:05.749977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da14157-8009-429c-a2ae-2306ce2d4c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:05.750644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da14157-8009-429c-a2ae-2306ce2d4c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:05.752303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da14157-8009-429c-a2ae-2306ce2d4c43 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:05.762914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1090/2140] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:05.764340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da14157-8009-429c-a2ae-2306ce2d4c43 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:05.784309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da14157-8009-429c-a2ae-2306ce2d4c43 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:05.789270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d107b2a-d1e7-4490-ab85-bc5908a4f517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:05.790282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d107b2a-d1e7-4490-ab85-bc5908a4f517 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:05.790537 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d107b2a-d1e7-4490-ab85-bc5908a4f517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:05.790887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d107b2a-d1e7-4490-ab85-bc5908a4f517 admin admin] PATH_INFO: `/v3/projects/aa831bc73ba7411b8aad7da420a6f98f/users/2c6c6bc26d3c4aa5937ded4e24de1032/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:05.800574 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1051/2141] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:05.802379 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7420b37-a164-413d-b794-3e25f20b4fde None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:05.802722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7420b37-a164-413d-b794-3e25f20b4fde None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:05.803054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7420b37-a164-413d-b794-3e25f20b4fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:05.809646 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d107b2a-d1e7-4490-ab85-bc5908a4f517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa831bc73ba7411b8aad7da420a6f98f, user_id=2c6c6bc26d3c4aa5937ded4e24de1032, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:05.812746 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d107b2a-d1e7-4490-ab85-bc5908a4f517 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:05.827677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-d7420b37-a164-413d-b794-3e25f20b4fde None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:05.828927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d7420b37-a164-413d-b794-3e25f20b4fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:05.836848 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1052/2142] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:05.841218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7420b37-a164-413d-b794-3e25f20b4fde None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:05.848474 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7420b37-a164-413d-b794-3e25f20b4fde None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:05.853469 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a86a1-c871-4e8d-b5e8-d409a72b1c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:05.854149 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a86a1-c871-4e8d-b5e8-d409a72b1c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:05.854484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a86a1-c871-4e8d-b5e8-d409a72b1c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:05.854702 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a86a1-c871-4e8d-b5e8-d409a72b1c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:05.855293 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a86a1-c871-4e8d-b5e8-d409a72b1c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:05.856973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a86a1-c871-4e8d-b5e8-d409a72b1c44 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:05.867787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1053/2143] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:05.868621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a86a1-c871-4e8d-b5e8-d409a72b1c44 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:05.875774 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c11a86a1-c871-4e8d-b5e8-d409a72b1c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:05.930049 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:05.937962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1091/2144] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:05 2022] PUT /identity/v3/projects/aa831bc73ba7411b8aad7da420a6f98f/users/2c6c6bc26d3c4aa5937ded4e24de1032/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:05.939044 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d107b2a-d1e7-4490-ab85-bc5908a4f517 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:05.945715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a86a1-c871-4e8d-b5e8-d409a72b1c44 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:06.004815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38732d5e-6af9-4f54-a5b7-6cee548d7213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:06.005424 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38732d5e-6af9-4f54-a5b7-6cee548d7213 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:06.005699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38732d5e-6af9-4f54-a5b7-6cee548d7213 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:06.005975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38732d5e-6af9-4f54-a5b7-6cee548d7213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:06.015008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d107b2a-d1e7-4490-ab85-bc5908a4f517 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:06.020827 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e421d-ded7-4241-869d-bb29d376774f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:06.021261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e421d-ded7-4241-869d-bb29d376774f service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:06.021536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e421d-ded7-4241-869d-bb29d376774f service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:06.021803 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e421d-ded7-4241-869d-bb29d376774f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:06.091833 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38732d5e-6af9-4f54-a5b7-6cee548d7213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:06.093934 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38732d5e-6af9-4f54-a5b7-6cee548d7213 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:06.104683 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e421d-ded7-4241-869d-bb29d376774f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:06.105818 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1054/2145] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:06.106218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e421d-ded7-4241-869d-bb29d376774f service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:06.107220 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38732d5e-6af9-4f54-a5b7-6cee548d7213 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:06.117781 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38732d5e-6af9-4f54-a5b7-6cee548d7213 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:06.123846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c3a6b-128e-41f7-af45-b09517211881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:06.124915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3a6b-128e-41f7-af45-b09517211881 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:06.124915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3a6b-128e-41f7-af45-b09517211881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:06.125520 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3a6b-128e-41f7-af45-b09517211881 admin admin] PATH_INFO: `/v3/projects/b180ec035ca64da5b923c857288583f5/users/ce412a078a214e72b3a5af2ae9588292/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:06.128643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1092/2146] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:06.130755 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85aa80-0036-4cfc-b5ae-dfa0426f45a1 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:06.131335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85aa80-0036-4cfc-b5ae-dfa0426f45a1 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:06.131840 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85aa80-0036-4cfc-b5ae-dfa0426f45a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:06.143222 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c3a6b-128e-41f7-af45-b09517211881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b180ec035ca64da5b923c857288583f5, user_id=ce412a078a214e72b3a5af2ae9588292, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:06.147391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c3a6b-128e-41f7-af45-b09517211881 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:06.180365 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-9c85aa80-0036-4cfc-b5ae-dfa0426f45a1 None None] MFA Rules not processed for user `2c6c6bc26d3c4aa5937ded4e24de1032`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:06.181871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9c85aa80-0036-4cfc-b5ae-dfa0426f45a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:06.264848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1093/2147] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:06.269924 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1055/2148] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:06 2022] PUT /identity/v3/projects/b180ec035ca64da5b923c857288583f5/users/ce412a078a214e72b3a5af2ae9588292/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:06.270126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85aa80-0036-4cfc-b5ae-dfa0426f45a1 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:06.283800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3083fb-1bcd-4630-ad9e-9f51de7c4f26 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:06.284118 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3083fb-1bcd-4630-ad9e-9f51de7c4f26 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:06.285402 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3083fb-1bcd-4630-ad9e-9f51de7c4f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:06.285557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85aa80-0036-4cfc-b5ae-dfa0426f45a1 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:06.329874 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-fa3083fb-1bcd-4630-ad9e-9f51de7c4f26 None None] MFA Rules not processed for user `ce412a078a214e72b3a5af2ae9588292`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:06.331785 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-fa3083fb-1bcd-4630-ad9e-9f51de7c4f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:06.362371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd133c-2e3b-4c1b-a256-c99e397a241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:06.363500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd133c-2e3b-4c1b-a256-c99e397a241a admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:06.364182 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd133c-2e3b-4c1b-a256-c99e397a241a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:06.364693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd133c-2e3b-4c1b-a256-c99e397a241a admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:06.365490 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd133c-2e3b-4c1b-a256-c99e397a241a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:06.370568 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd133c-2e3b-4c1b-a256-c99e397a241a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:06.440497 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1056/2149] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:52:06.447101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3083fb-1bcd-4630-ad9e-9f51de7c4f26 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:06.479934 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3083fb-1bcd-4630-ad9e-9f51de7c4f26 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:06.492491 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2f25a-6d86-4795-ba84-ac93ea86000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:06.493585 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2f25a-6d86-4795-ba84-ac93ea86000b admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:06.494492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2f25a-6d86-4795-ba84-ac93ea86000b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:06.494774 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2f25a-6d86-4795-ba84-ac93ea86000b admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:06.495488 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2f25a-6d86-4795-ba84-ac93ea86000b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:06.500687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2f25a-6d86-4795-ba84-ac93ea86000b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:06.525667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1094/2150] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:06 2022] POST /identity/v3/projects => generated 363 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:06.539750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd133c-2e3b-4c1b-a256-c99e397a241a admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:06.634574 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd133c-2e3b-4c1b-a256-c99e397a241a admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:06.646864 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0567f5-7b0c-474a-a033-f21862249ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:06.648632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0567f5-7b0c-474a-a033-f21862249ebf admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:06.649139 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0567f5-7b0c-474a-a033-f21862249ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:06.649647 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0567f5-7b0c-474a-a033-f21862249ebf admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:06.651125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0567f5-7b0c-474a-a033-f21862249ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:06.659762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0567f5-7b0c-474a-a033-f21862249ebf admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:06.682419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1057/2151] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:06 2022] POST /identity/v3/projects => generated 385 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:06.687362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2f25a-6d86-4795-ba84-ac93ea86000b admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:06.787238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2f25a-6d86-4795-ba84-ac93ea86000b admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:06.798047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1095/2152] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:06 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:06.798776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e8e37-b6ce-4b6e-bb43-2978f92cb192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:06.798776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e8e37-b6ce-4b6e-bb43-2978f92cb192 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:06.798776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e8e37-b6ce-4b6e-bb43-2978f92cb192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:06.798776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e8e37-b6ce-4b6e-bb43-2978f92cb192 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:06.799350 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e8e37-b6ce-4b6e-bb43-2978f92cb192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:06.801070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0567f5-7b0c-474a-a033-f21862249ebf admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:06.802694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e8e37-b6ce-4b6e-bb43-2978f92cb192 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:06.804054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8d0567f5-7b0c-474a-a033-f21862249ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:06.825362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0567f5-7b0c-474a-a033-f21862249ebf admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:06.838513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64436d6c-9289-46e4-90ce-641676aafab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:06.839200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64436d6c-9289-46e4-90ce-641676aafab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:06.839507 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64436d6c-9289-46e4-90ce-641676aafab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:06.839790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64436d6c-9289-46e4-90ce-641676aafab0 admin admin] PATH_INFO: `/v3/projects/2149f8448c2e41e19a541cc033f908f2` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:06.841045 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64436d6c-9289-46e4-90ce-641676aafab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2149f8448c2e41e19a541cc033f908f2)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:06.843078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64436d6c-9289-46e4-90ce-641676aafab0 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:06.965668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1058/2153] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:06 2022] POST /identity/v3/users => generated 299 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:52:06.966718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e8e37-b6ce-4b6e-bb43-2978f92cb192 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:06.980849 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e8e37-b6ce-4b6e-bb43-2978f92cb192 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:06.988352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b378fa3-fd4e-4c09-be6e-3c1bbfa7e3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:06.988984 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b378fa3-fd4e-4c09-be6e-3c1bbfa7e3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:06.989265 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b378fa3-fd4e-4c09-be6e-3c1bbfa7e3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:06.989549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b378fa3-fd4e-4c09-be6e-3c1bbfa7e3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:06.990317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b378fa3-fd4e-4c09-be6e-3c1bbfa7e3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:06.991986 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b378fa3-fd4e-4c09-be6e-3c1bbfa7e3e9 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:07.004491 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1059/2154] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:07.005386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b378fa3-fd4e-4c09-be6e-3c1bbfa7e3e9 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:07.008836 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-8b378fa3-fd4e-4c09-be6e-3c1bbfa7e3e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:07.035776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b378fa3-fd4e-4c09-be6e-3c1bbfa7e3e9 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:07.035920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-64436d6c-9289-46e4-90ce-641676aafab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2149f8448c2e41e19a541cc033f908f2', 'request_id': 'req-64436d6c-9289-46e4-90ce-641676aafab0'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:07.037477 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-64436d6c-9289-46e4-90ce-641676aafab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2149f8448c2e41e19a541cc033f908f2', 'request_id': 'req-64436d6c-9289-46e4-90ce-641676aafab0'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:07.099429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb992e8-6eee-4127-8172-7d5887e0ca08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:07.100238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb992e8-6eee-4127-8172-7d5887e0ca08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:07.100743 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb992e8-6eee-4127-8172-7d5887e0ca08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:07.101233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb992e8-6eee-4127-8172-7d5887e0ca08 admin admin] PATH_INFO: `/v3/projects/f2e819494a214ecfa1ed3cf64a88cf84` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:07.109812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb992e8-6eee-4127-8172-7d5887e0ca08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2e819494a214ecfa1ed3cf64a88cf84)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:07.109812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb992e8-6eee-4127-8172-7d5887e0ca08 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:07.169127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-64436d6c-9289-46e4-90ce-641676aafab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2149f8448c2e41e19a541cc033f908f2', 'request_id': 'req-64436d6c-9289-46e4-90ce-641676aafab0'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:07.182442 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-64436d6c-9289-46e4-90ce-641676aafab0 admin admin] The token cache is being invalidate because project 2149f8448c2e41e19a541cc033f908f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:07.182884 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-64436d6c-9289-46e4-90ce-641676aafab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:07.183947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-64436d6c-9289-46e4-90ce-641676aafab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:07.186255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1096/2155] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:06 2022] DELETE /identity/v3/projects/2149f8448c2e41e19a541cc033f908f2 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:07.187058 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64436d6c-9289-46e4-90ce-641676aafab0 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:07.188495 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-64436d6c-9289-46e4-90ce-641676aafab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:07.201821 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64436d6c-9289-46e4-90ce-641676aafab0 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:07.206962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1162497-f592-4eb8-9fc3-6d0ebf06502a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:07.207628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1162497-f592-4eb8-9fc3-6d0ebf06502a admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:07.207911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1162497-f592-4eb8-9fc3-6d0ebf06502a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:07.208188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1162497-f592-4eb8-9fc3-6d0ebf06502a admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:07.208843 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1162497-f592-4eb8-9fc3-6d0ebf06502a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:07.210480 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1162497-f592-4eb8-9fc3-6d0ebf06502a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:07.221856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1097/2156] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:07.222077 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1162497-f592-4eb8-9fc3-6d0ebf06502a admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:07.224435 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f1162497-f592-4eb8-9fc3-6d0ebf06502a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:07.238368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1162497-f592-4eb8-9fc3-6d0ebf06502a admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:07.243308 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb7083-2e6c-461c-80cf-cd32d4eafc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:07.244074 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb7083-2e6c-461c-80cf-cd32d4eafc3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:07.244346 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb7083-2e6c-461c-80cf-cd32d4eafc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:07.244619 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb7083-2e6c-461c-80cf-cd32d4eafc3f admin admin] PATH_INFO: `/v3/projects/64920e968a4c43ea93f01fb12c9949b8/users/d8d3d8487ab54f9281438d289338f956/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:07.261202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb7083-2e6c-461c-80cf-cd32d4eafc3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=64920e968a4c43ea93f01fb12c9949b8, user_id=d8d3d8487ab54f9281438d289338f956, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:07.264070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb7083-2e6c-461c-80cf-cd32d4eafc3f admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:07.381025 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1098/2157] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:07 2022] PUT /identity/v3/projects/64920e968a4c43ea93f01fb12c9949b8/users/d8d3d8487ab54f9281438d289338f956/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:07.381785 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb7083-2e6c-461c-80cf-cd32d4eafc3f admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:07.386305 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-cddb7083-2e6c-461c-80cf-cd32d4eafc3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:07.396267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ebb992e8-6eee-4127-8172-7d5887e0ca08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2e819494a214ecfa1ed3cf64a88cf84', 'request_id': 'req-ebb992e8-6eee-4127-8172-7d5887e0ca08'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:07.461089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb7083-2e6c-461c-80cf-cd32d4eafc3f admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:07.475768 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ebb992e8-6eee-4127-8172-7d5887e0ca08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2e819494a214ecfa1ed3cf64a88cf84', 'request_id': 'req-ebb992e8-6eee-4127-8172-7d5887e0ca08'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:07.485213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ebb992e8-6eee-4127-8172-7d5887e0ca08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2e819494a214ecfa1ed3cf64a88cf84', 'request_id': 'req-ebb992e8-6eee-4127-8172-7d5887e0ca08'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:07.496519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ebb992e8-6eee-4127-8172-7d5887e0ca08 admin admin] The token cache is being invalidate because project f2e819494a214ecfa1ed3cf64a88cf84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:07.496945 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ebb992e8-6eee-4127-8172-7d5887e0ca08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:07.497702 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ebb992e8-6eee-4127-8172-7d5887e0ca08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:07.499562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1060/2158] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:07 2022] DELETE /identity/v3/projects/f2e819494a214ecfa1ed3cf64a88cf84 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:07.500468 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb992e8-6eee-4127-8172-7d5887e0ca08 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:07.501890 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ebb992e8-6eee-4127-8172-7d5887e0ca08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:07.505618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:07.522040 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5f725-b0ec-4289-849e-a7eaef86352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:07.522681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5f725-b0ec-4289-849e-a7eaef86352f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:07.522959 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5f725-b0ec-4289-849e-a7eaef86352f admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:07.524604 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5f725-b0ec-4289-849e-a7eaef86352f admin admin] PATH_INFO: `/v3/users/ebf933fe9f114e7fadecea806d8fcc24` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:07.524604 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5f725-b0ec-4289-849e-a7eaef86352f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf933fe9f114e7fadecea806d8fcc24)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:07.526307 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5f725-b0ec-4289-849e-a7eaef86352f admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:07.577856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb992e8-6eee-4127-8172-7d5887e0ca08 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:07.583156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e3e47-42c8-424c-a9da-3ef56eefa6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:07.583916 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e3e47-42c8-424c-a9da-3ef56eefa6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:07.584200 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e3e47-42c8-424c-a9da-3ef56eefa6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:07.584481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e3e47-42c8-424c-a9da-3ef56eefa6d3 admin admin] PATH_INFO: `/v3/projects/a1a5a2af1e3b404a974093e481dd1393/users/8f7c6317c9884044a2ce745a09f77a30/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:07.601323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e3e47-42c8-424c-a9da-3ef56eefa6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a5a2af1e3b404a974093e481dd1393, user_id=8f7c6317c9884044a2ce745a09f77a30, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:07.604028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e3e47-42c8-424c-a9da-3ef56eefa6d3 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:07.718964 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1061/2159] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:07 2022] PUT /identity/v3/projects/a1a5a2af1e3b404a974093e481dd1393/users/8f7c6317c9884044a2ce745a09f77a30/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:07.720854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e3e47-42c8-424c-a9da-3ef56eefa6d3 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:07.722903 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-9f0e3e47-42c8-424c-a9da-3ef56eefa6d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:07.790664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-aaa5f725-b0ec-4289-849e-a7eaef86352f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf933fe9f114e7fadecea806d8fcc24'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:07.795529 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e3e47-42c8-424c-a9da-3ef56eefa6d3 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:07.800693 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84c5e6-cc32-4d3a-a2ec-df417dc51de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:07.801364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84c5e6-cc32-4d3a-a2ec-df417dc51de8 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:07.801640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84c5e6-cc32-4d3a-a2ec-df417dc51de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:07.801909 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84c5e6-cc32-4d3a-a2ec-df417dc51de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:07.802555 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84c5e6-cc32-4d3a-a2ec-df417dc51de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:07.804260 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84c5e6-cc32-4d3a-a2ec-df417dc51de8 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:07.815315 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1062/2160] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:07.816652 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677f9a8-ecb2-4366-9b26-8600fbcfd19d None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:07.819317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677f9a8-ecb2-4366-9b26-8600fbcfd19d None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:07.819317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677f9a8-ecb2-4366-9b26-8600fbcfd19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:07.838117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-7677f9a8-ecb2-4366-9b26-8600fbcfd19d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:07.839350 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-7677f9a8-ecb2-4366-9b26-8600fbcfd19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:07.848416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1063/2161] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:07.849084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677f9a8-ecb2-4366-9b26-8600fbcfd19d None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:07.859361 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677f9a8-ecb2-4366-9b26-8600fbcfd19d None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:07.864433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0a30b-ed5b-4697-9740-9d056ff5267e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:07.865084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0a30b-ed5b-4697-9740-9d056ff5267e admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:07.865360 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0a30b-ed5b-4697-9740-9d056ff5267e admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:07.865645 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0a30b-ed5b-4697-9740-9d056ff5267e admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:07.866042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-aaa5f725-b0ec-4289-849e-a7eaef86352f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf933fe9f114e7fadecea806d8fcc24'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:07.866280 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0a30b-ed5b-4697-9740-9d056ff5267e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:07.866720 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-aaa5f725-b0ec-4289-849e-a7eaef86352f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf933fe9f114e7fadecea806d8fcc24'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:07.867440 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-aaa5f725-b0ec-4289-849e-a7eaef86352f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf933fe9f114e7fadecea806d8fcc24'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:07.867960 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0a30b-ed5b-4697-9740-9d056ff5267e admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:07.876022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-aaa5f725-b0ec-4289-849e-a7eaef86352f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf933fe9f114e7fadecea806d8fcc24'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:07.882368 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1064/2162] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:07.882368 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0a30b-ed5b-4697-9740-9d056ff5267e admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:07.882368 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4ef0a30b-ed5b-4697-9740-9d056ff5267e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:07.895796 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0a30b-ed5b-4697-9740-9d056ff5267e admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:07.896841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1099/2163] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:07 2022] DELETE /identity/v3/users/ebf933fe9f114e7fadecea806d8fcc24 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:07.898036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30422f02-8681-44e7-aa3e-a6c6d368dd69 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:07.898322 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30422f02-8681-44e7-aa3e-a6c6d368dd69 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:07.898624 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30422f02-8681-44e7-aa3e-a6c6d368dd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:07.931275 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-30422f02-8681-44e7-aa3e-a6c6d368dd69 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:07.932905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-30422f02-8681-44e7-aa3e-a6c6d368dd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:07.971724 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:07.974099 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee41e67-83c2-45e2-af6e-0972e6043d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:07.974892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee41e67-83c2-45e2-af6e-0972e6043d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:07.975887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee41e67-83c2-45e2-af6e-0972e6043d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:07.976183 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee41e67-83c2-45e2-af6e-0972e6043d2e admin admin] PATH_INFO: `/v3/projects/64920e968a4c43ea93f01fb12c9949b8/users/d8d3d8487ab54f9281438d289338f956/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:07.978785 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee41e67-83c2-45e2-af6e-0972e6043d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=64920e968a4c43ea93f01fb12c9949b8, user_id=d8d3d8487ab54f9281438d289338f956, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:07.982672 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee41e67-83c2-45e2-af6e-0972e6043d2e admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:08.001416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1065/2164] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:07 2022] PUT /identity/v3/projects/64920e968a4c43ea93f01fb12c9949b8/users/d8d3d8487ab54f9281438d289338f956/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:08.001416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee41e67-83c2-45e2-af6e-0972e6043d2e admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:08.002838 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2ee41e67-83c2-45e2-af6e-0972e6043d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:08.038730 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1100/2165] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:08.040098 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90231f5-8e19-43df-9136-7f1ffd657e9b None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:08.040386 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90231f5-8e19-43df-9136-7f1ffd657e9b None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:08.040661 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90231f5-8e19-43df-9136-7f1ffd657e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:08.082996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-e90231f5-8e19-43df-9136-7f1ffd657e9b None None] MFA Rules not processed for user `d8d3d8487ab54f9281438d289338f956`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:08.085022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e90231f5-8e19-43df-9136-7f1ffd657e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:08.094361 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee41e67-83c2-45e2-af6e-0972e6043d2e admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:08.104542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc187f34-214f-4164-b3e2-cd157f962e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:08.105610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc187f34-214f-4164-b3e2-cd157f962e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:08.108246 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc187f34-214f-4164-b3e2-cd157f962e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:08.108246 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc187f34-214f-4164-b3e2-cd157f962e67 admin admin] PATH_INFO: `/v3/projects/a1a5a2af1e3b404a974093e481dd1393/users/8f7c6317c9884044a2ce745a09f77a30/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:08.110285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc187f34-214f-4164-b3e2-cd157f962e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a5a2af1e3b404a974093e481dd1393, user_id=8f7c6317c9884044a2ce745a09f77a30, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:08.114560 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc187f34-214f-4164-b3e2-cd157f962e67 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:08.142376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1066/2166] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:07 2022] PUT /identity/v3/projects/a1a5a2af1e3b404a974093e481dd1393/users/8f7c6317c9884044a2ce745a09f77a30/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:08.143419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc187f34-214f-4164-b3e2-cd157f962e67 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:08.272118 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1101/2167] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:08.281081 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc81ce-b39b-4a06-b121-5cc9e35b8e37 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:08.282169 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc81ce-b39b-4a06-b121-5cc9e35b8e37 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:08.282850 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc81ce-b39b-4a06-b121-5cc9e35b8e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:08.317102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc187f34-214f-4164-b3e2-cd157f962e67 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:08.323116 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ca075-2790-48dd-b00b-b452f641436b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:08.323781 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ca075-2790-48dd-b00b-b452f641436b admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:08.324065 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ca075-2790-48dd-b00b-b452f641436b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:08.324340 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ca075-2790-48dd-b00b-b452f641436b admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:08.325563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ca075-2790-48dd-b00b-b452f641436b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:52:08.326889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ca075-2790-48dd-b00b-b452f641436b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:08.329077 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ca075-2790-48dd-b00b-b452f641436b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:08.330132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-b3dc81ce-b39b-4a06-b121-5cc9e35b8e37 None None] MFA Rules not processed for user `8f7c6317c9884044a2ce745a09f77a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:08.331842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b3dc81ce-b39b-4a06-b121-5cc9e35b8e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:08.343200 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1067/2168] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:52:08.344345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ca075-2790-48dd-b00b-b452f641436b admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:08.346249 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4e2ca075-2790-48dd-b00b-b452f641436b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:08.412513 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ca075-2790-48dd-b00b-b452f641436b admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:08.418719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520c0f5-55b5-428a-8a58-b4bdf87ae9fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:08.419972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520c0f5-55b5-428a-8a58-b4bdf87ae9fe service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:08.427150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520c0f5-55b5-428a-8a58-b4bdf87ae9fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:08.427150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520c0f5-55b5-428a-8a58-b4bdf87ae9fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:08.427629 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1102/2169] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:08.427629 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc81ce-b39b-4a06-b121-5cc9e35b8e37 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:08.439871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc81ce-b39b-4a06-b121-5cc9e35b8e37 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:08.445010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3707630-b675-4e2e-98cd-d2a73b0c39ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:08.445622 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3707630-b675-4e2e-98cd-d2a73b0c39ce admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:08.445900 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3707630-b675-4e2e-98cd-d2a73b0c39ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:08.446206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3707630-b675-4e2e-98cd-d2a73b0c39ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:08.446870 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3707630-b675-4e2e-98cd-d2a73b0c39ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:08.448860 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3707630-b675-4e2e-98cd-d2a73b0c39ce admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:08.494383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520c0f5-55b5-428a-8a58-b4bdf87ae9fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:08.495320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520c0f5-55b5-428a-8a58-b4bdf87ae9fe service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:08.506490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1068/2170] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:08.507243 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520c0f5-55b5-428a-8a58-b4bdf87ae9fe service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:08.510228 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-7520c0f5-55b5-428a-8a58-b4bdf87ae9fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:08.532979 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520c0f5-55b5-428a-8a58-b4bdf87ae9fe service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:08.537862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae58532-391c-4991-9fea-374f5b7a94dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:08.538477 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58532-391c-4991-9fea-374f5b7a94dd service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:08.538777 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58532-391c-4991-9fea-374f5b7a94dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:08.539056 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58532-391c-4991-9fea-374f5b7a94dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:08.550148 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae58532-391c-4991-9fea-374f5b7a94dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:08.551889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae58532-391c-4991-9fea-374f5b7a94dd service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:08.562929 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1103/2171] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:08 2022] POST /identity/v3/projects => generated 397 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:08.563577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1069/2172] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:08.564726 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3707630-b675-4e2e-98cd-d2a73b0c39ce admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:08.566879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a3707630-b675-4e2e-98cd-d2a73b0c39ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:08.568662 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae58532-391c-4991-9fea-374f5b7a94dd service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:08.582437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae58532-391c-4991-9fea-374f5b7a94dd service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:08.640773 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3707630-b675-4e2e-98cd-d2a73b0c39ce admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:08.646215 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7447b-7584-4007-8fb0-348dd5298fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:08.646925 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7447b-7584-4007-8fb0-348dd5298fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:08.647205 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7447b-7584-4007-8fb0-348dd5298fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:08.647501 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7447b-7584-4007-8fb0-348dd5298fac admin admin] PATH_INFO: `/v3/projects/1b8bf2035d7144e8a760b55444a9c471` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:08.648633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7447b-7584-4007-8fb0-348dd5298fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8bf2035d7144e8a760b55444a9c471)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:08.650523 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7447b-7584-4007-8fb0-348dd5298fac admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:08.675788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452302d-0237-43a3-b0b0-d14c38bea8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:08.676492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452302d-0237-43a3-b0b0-d14c38bea8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:08.676770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452302d-0237-43a3-b0b0-d14c38bea8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:08.677051 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452302d-0237-43a3-b0b0-d14c38bea8c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:08.677937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452302d-0237-43a3-b0b0-d14c38bea8c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:08.679891 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452302d-0237-43a3-b0b0-d14c38bea8c3 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:08.776934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-77e7447b-7584-4007-8fb0-348dd5298fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8bf2035d7144e8a760b55444a9c471', 'request_id': 'req-77e7447b-7584-4007-8fb0-348dd5298fac'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:08.783648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-77e7447b-7584-4007-8fb0-348dd5298fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8bf2035d7144e8a760b55444a9c471', 'request_id': 'req-77e7447b-7584-4007-8fb0-348dd5298fac'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:08.809236 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1070/2173] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:08 2022] POST /identity/v3/users => generated 299 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:52:08.809236 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452302d-0237-43a3-b0b0-d14c38bea8c3 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:08.823167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452302d-0237-43a3-b0b0-d14c38bea8c3 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:08.874497 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-77e7447b-7584-4007-8fb0-348dd5298fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8bf2035d7144e8a760b55444a9c471', 'request_id': 'req-77e7447b-7584-4007-8fb0-348dd5298fac'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:08.889445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-77e7447b-7584-4007-8fb0-348dd5298fac admin admin] The token cache is being invalidate because project 1b8bf2035d7144e8a760b55444a9c471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:08.889740 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-77e7447b-7584-4007-8fb0-348dd5298fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:08.890423 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-77e7447b-7584-4007-8fb0-348dd5298fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:08.892234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1104/2174] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:08 2022] DELETE /identity/v3/projects/1b8bf2035d7144e8a760b55444a9c471 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:08.896570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7447b-7584-4007-8fb0-348dd5298fac admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:08.897981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-77e7447b-7584-4007-8fb0-348dd5298fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:08.912648 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee88f86-2373-4780-be1b-5c3931959368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:08.913795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee88f86-2373-4780-be1b-5c3931959368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:08.914381 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee88f86-2373-4780-be1b-5c3931959368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:08.914956 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee88f86-2373-4780-be1b-5c3931959368 admin admin] PATH_INFO: `/v3/users/ce412a078a214e72b3a5af2ae9588292` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:08.917299 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee88f86-2373-4780-be1b-5c3931959368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce412a078a214e72b3a5af2ae9588292)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:08.922125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee88f86-2373-4780-be1b-5c3931959368 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:08.981477 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7447b-7584-4007-8fb0-348dd5298fac admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:08.988279 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b046ea-7cbd-4f88-a400-5847df559dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:08.988901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b046ea-7cbd-4f88-a400-5847df559dbf admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:08.989185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b046ea-7cbd-4f88-a400-5847df559dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:08.989513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b046ea-7cbd-4f88-a400-5847df559dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:08.991862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b046ea-7cbd-4f88-a400-5847df559dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:08.992388 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b046ea-7cbd-4f88-a400-5847df559dbf admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:09.010469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1105/2175] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:09.010469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b046ea-7cbd-4f88-a400-5847df559dbf admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:09.010469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-53b046ea-7cbd-4f88-a400-5847df559dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:09.075111 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b046ea-7cbd-4f88-a400-5847df559dbf admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:09.079158 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4240a-16bb-4526-8f4f-a5db8324e2f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:09.079805 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4240a-16bb-4526-8f4f-a5db8324e2f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:09.080074 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4240a-16bb-4526-8f4f-a5db8324e2f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:09.080342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4240a-16bb-4526-8f4f-a5db8324e2f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:09.090049 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-dca4240a-16bb-4526-8f4f-a5db8324e2f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:09.126519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0ee88f86-2373-4780-be1b-5c3931959368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce412a078a214e72b3a5af2ae9588292'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:09.127190 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0ee88f86-2373-4780-be1b-5c3931959368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce412a078a214e72b3a5af2ae9588292'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:09.136766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0ee88f86-2373-4780-be1b-5c3931959368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce412a078a214e72b3a5af2ae9588292'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:09.156885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0ee88f86-2373-4780-be1b-5c3931959368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce412a078a214e72b3a5af2ae9588292'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:09.157916 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0ee88f86-2373-4780-be1b-5c3931959368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce412a078a214e72b3a5af2ae9588292'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:09.159350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4240a-16bb-4526-8f4f-a5db8324e2f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:09.162369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4240a-16bb-4526-8f4f-a5db8324e2f6 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:09.173481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1106/2176] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:09.174881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c14268-2d2d-4152-8e6a-51adadc05731 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:09.175166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c14268-2d2d-4152-8e6a-51adadc05731 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:09.175447 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c14268-2d2d-4152-8e6a-51adadc05731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:09.181435 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:09.207750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-91c14268-2d2d-4152-8e6a-51adadc05731 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:09.209042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-91c14268-2d2d-4152-8e6a-51adadc05731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:09.220649 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1107/2177] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:09.221370 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c14268-2d2d-4152-8e6a-51adadc05731 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:09.227739 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-91c14268-2d2d-4152-8e6a-51adadc05731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:09.241536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c14268-2d2d-4152-8e6a-51adadc05731 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:09.251634 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f783b80-ded8-4544-8ba0-ffbb060747e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:09.252261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f783b80-ded8-4544-8ba0-ffbb060747e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:09.252532 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f783b80-ded8-4544-8ba0-ffbb060747e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:09.252802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f783b80-ded8-4544-8ba0-ffbb060747e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:09.253446 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f783b80-ded8-4544-8ba0-ffbb060747e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:09.255036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f783b80-ded8-4544-8ba0-ffbb060747e9 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:09.268472 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1108/2178] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:09.269783 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba97d7-b76e-4af9-b80a-63c6d8176261 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:09.270074 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba97d7-b76e-4af9-b80a-63c6d8176261 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:09.274417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba97d7-b76e-4af9-b80a-63c6d8176261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:09.277796 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1071/2179] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:08 2022] DELETE /identity/v3/users/ce412a078a214e72b3a5af2ae9588292 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:09.278930 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee88f86-2373-4780-be1b-5c3931959368 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:09.301929 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-95ba97d7-b76e-4af9-b80a-63c6d8176261 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:09.304644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-95ba97d7-b76e-4af9-b80a-63c6d8176261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:09.381882 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee88f86-2373-4780-be1b-5c3931959368 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:09.392819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1109/2180] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:09.393037 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1dd34-f2a5-4b6d-8160-a4f0c9466689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:09.393212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f58f3-7b8f-47fb-9bb5-e0cd75e596e0 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:09.393313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1dd34-f2a5-4b6d-8160-a4f0c9466689 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:09.393446 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f58f3-7b8f-47fb-9bb5-e0cd75e596e0 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:09.393592 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1dd34-f2a5-4b6d-8160-a4f0c9466689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:09.393690 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f58f3-7b8f-47fb-9bb5-e0cd75e596e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:09.393853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1dd34-f2a5-4b6d-8160-a4f0c9466689 admin admin] PATH_INFO: `/v3/projects/4a072d0d6eb14ffabd638b7fc99ca53b/users/9406bf7a821f46289490a42921fca552/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:09.412710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1dd34-f2a5-4b6d-8160-a4f0c9466689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a072d0d6eb14ffabd638b7fc99ca53b, user_id=9406bf7a821f46289490a42921fca552, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:09.413776 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-868f58f3-7b8f-47fb-9bb5-e0cd75e596e0 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:09.414264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1dd34-f2a5-4b6d-8160-a4f0c9466689 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:09.415177 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-868f58f3-7b8f-47fb-9bb5-e0cd75e596e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:09.425618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1110/2181] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:09.426724 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f58f3-7b8f-47fb-9bb5-e0cd75e596e0 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:09.439394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f58f3-7b8f-47fb-9bb5-e0cd75e596e0 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:09.444797 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d44577-f1ca-4e03-b91a-61edf3c161a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:09.445562 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d44577-f1ca-4e03-b91a-61edf3c161a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:09.445942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d44577-f1ca-4e03-b91a-61edf3c161a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:09.446119 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d44577-f1ca-4e03-b91a-61edf3c161a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:09.446997 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d44577-f1ca-4e03-b91a-61edf3c161a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:52:09.447401 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d44577-f1ca-4e03-b91a-61edf3c161a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:09.449177 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d44577-f1ca-4e03-b91a-61edf3c161a7 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:09.465371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1111/2182] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:52:09.466337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d44577-f1ca-4e03-b91a-61edf3c161a7 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:09.469564 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a7d44577-f1ca-4e03-b91a-61edf3c161a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:09.517156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1072/2183] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:09 2022] PUT /identity/v3/projects/4a072d0d6eb14ffabd638b7fc99ca53b/users/9406bf7a821f46289490a42921fca552/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:09.526325 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1dd34-f2a5-4b6d-8160-a4f0c9466689 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:09.540208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d44577-f1ca-4e03-b91a-61edf3c161a7 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:09.621311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d5251-02cd-4d71-8c41-898d16d3b16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:09.622218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d5251-02cd-4d71-8c41-898d16d3b16d service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:09.622493 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d5251-02cd-4d71-8c41-898d16d3b16d service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:09.623357 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d5251-02cd-4d71-8c41-898d16d3b16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:09.624998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1dd34-f2a5-4b6d-8160-a4f0c9466689 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:09.631644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4731b1-a3a8-4467-8fe6-bac251ce39f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:09.632058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4731b1-a3a8-4467-8fe6-bac251ce39f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:09.632341 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4731b1-a3a8-4467-8fe6-bac251ce39f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:09.632611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4731b1-a3a8-4467-8fe6-bac251ce39f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:09.633254 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4731b1-a3a8-4467-8fe6-bac251ce39f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:09.635188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4731b1-a3a8-4467-8fe6-bac251ce39f6 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:09.636963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d5251-02cd-4d71-8c41-898d16d3b16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:09.642972 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d5251-02cd-4d71-8c41-898d16d3b16d service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:09.661367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1112/2184] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:09.663216 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ca464-1fb5-446a-b74a-80d2dbc6bb7b None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:09.663830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ca464-1fb5-446a-b74a-80d2dbc6bb7b None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:09.664421 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ca464-1fb5-446a-b74a-80d2dbc6bb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:09.667344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:09.712448 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f93ca464-1fb5-446a-b74a-80d2dbc6bb7b None None] MFA Rules not processed for user `9406bf7a821f46289490a42921fca552`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:09.714584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f93ca464-1fb5-446a-b74a-80d2dbc6bb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:09.759707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1073/2185] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:09 2022] POST /identity/v3/projects => generated 407 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:09.761525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4731b1-a3a8-4467-8fe6-bac251ce39f6 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:09.832172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1113/2186] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:09.866234 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4731b1-a3a8-4467-8fe6-bac251ce39f6 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:09.871218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19695ea-3bea-451c-9945-c20c34465c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:09.871879 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19695ea-3bea-451c-9945-c20c34465c7f admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:09.872157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19695ea-3bea-451c-9945-c20c34465c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:09.872430 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19695ea-3bea-451c-9945-c20c34465c7f admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:09.874362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19695ea-3bea-451c-9945-c20c34465c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:09.876432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19695ea-3bea-451c-9945-c20c34465c7f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:09.983555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ca464-1fb5-446a-b74a-80d2dbc6bb7b None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:09.985500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f93ca464-1fb5-446a-b74a-80d2dbc6bb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:10.010202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1074/2187] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:09 2022] POST /identity/v3/users => generated 304 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:10.018223 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19695ea-3bea-451c-9945-c20c34465c7f admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:10.038257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19695ea-3bea-451c-9945-c20c34465c7f admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:10.051249 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a888b4-adab-46ff-93d2-a7de14eb2321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:10.052394 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a888b4-adab-46ff-93d2-a7de14eb2321 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:10.052890 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a888b4-adab-46ff-93d2-a7de14eb2321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:10.053403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a888b4-adab-46ff-93d2-a7de14eb2321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:10.054717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a888b4-adab-46ff-93d2-a7de14eb2321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:10.063093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a888b4-adab-46ff-93d2-a7de14eb2321 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:10.076716 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1075/2188] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:10.084592 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a888b4-adab-46ff-93d2-a7de14eb2321 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:10.096968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a888b4-adab-46ff-93d2-a7de14eb2321 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:10.101352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ca464-1fb5-446a-b74a-80d2dbc6bb7b None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:10.106175 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e8a49-2f84-4b74-8db2-4ad54ef1cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:10.110666 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e8a49-2f84-4b74-8db2-4ad54ef1cd17 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:10.110666 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e8a49-2f84-4b74-8db2-4ad54ef1cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:10.110666 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e8a49-2f84-4b74-8db2-4ad54ef1cd17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:10.111060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e8a49-2f84-4b74-8db2-4ad54ef1cd17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:10.112822 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e8a49-2f84-4b74-8db2-4ad54ef1cd17 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:10.126974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1076/2189] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:52:10.132418 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e8a49-2f84-4b74-8db2-4ad54ef1cd17 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:10.144495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e8a49-2f84-4b74-8db2-4ad54ef1cd17 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:10.151135 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f0432-8214-47c0-bd73-88718096b88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:10.151948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f0432-8214-47c0-bd73-88718096b88c admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:10.152297 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f0432-8214-47c0-bd73-88718096b88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:10.152638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f0432-8214-47c0-bd73-88718096b88c admin admin] PATH_INFO: `/v3/projects/8d36db25fffc4f6baa62bff25bcb32a6/users/a95b9e79f49c48d38b0941d54d445035/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:10.169128 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774caa8-d042-4558-87e6-7afd6183cd20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:10.170678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774caa8-d042-4558-87e6-7afd6183cd20 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:10.171173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774caa8-d042-4558-87e6-7afd6183cd20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:10.171528 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774caa8-d042-4558-87e6-7afd6183cd20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:10.174549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f0432-8214-47c0-bd73-88718096b88c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d36db25fffc4f6baa62bff25bcb32a6, user_id=a95b9e79f49c48d38b0941d54d445035, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:10.177673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f0432-8214-47c0-bd73-88718096b88c admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:10.239675 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774caa8-d042-4558-87e6-7afd6183cd20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:10.241253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774caa8-d042-4558-87e6-7afd6183cd20 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:10.251956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1114/2190] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:09 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:52:10.316585 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1077/2191] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:10 2022] PUT /identity/v3/projects/8d36db25fffc4f6baa62bff25bcb32a6/users/a95b9e79f49c48d38b0941d54d445035/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:52:10.317898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774caa8-d042-4558-87e6-7afd6183cd20 service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:10.321046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-0774caa8-d042-4558-87e6-7afd6183cd20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:10.329004 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a58da-b745-44a5-bf9c-080b8af61946 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:10.329249 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a58da-b745-44a5-bf9c-080b8af61946 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:10.329527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a58da-b745-44a5-bf9c-080b8af61946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:10.368152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-889a58da-b745-44a5-bf9c-080b8af61946 None None] MFA Rules not processed for user `a95b9e79f49c48d38b0941d54d445035`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:10.369412 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-889a58da-b745-44a5-bf9c-080b8af61946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:10.371554 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774caa8-d042-4558-87e6-7afd6183cd20 service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:10.447039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1078/2192] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:10 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:52:10.452143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a58da-b745-44a5-bf9c-080b8af61946 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:10.468349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a65b4-4b7e-424f-9435-ec435517d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:10.469219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a65b4-4b7e-424f-9435-ec435517d2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:10.469844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a65b4-4b7e-424f-9435-ec435517d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:10.469971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a65b4-4b7e-424f-9435-ec435517d2e4 admin admin] PATH_INFO: `/v3/projects/b180ec035ca64da5b923c857288583f5` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:10.471794 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a65b4-4b7e-424f-9435-ec435517d2e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b180ec035ca64da5b923c857288583f5)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:10.474513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a65b4-4b7e-424f-9435-ec435517d2e4 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:10.536270 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a58da-b745-44a5-bf9c-080b8af61946 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:10.541881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5efbb-8880-4e43-afd4-309e18829c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:10.542600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5efbb-8880-4e43-afd4-309e18829c38 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:10.542883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5efbb-8880-4e43-afd4-309e18829c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:10.543154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5efbb-8880-4e43-afd4-309e18829c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:10.543855 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5efbb-8880-4e43-afd4-309e18829c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:10.546254 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5efbb-8880-4e43-afd4-309e18829c38 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:10.621008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ad6a65b4-4b7e-424f-9435-ec435517d2e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b180ec035ca64da5b923c857288583f5', 'request_id': 'req-ad6a65b4-4b7e-424f-9435-ec435517d2e4'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:10.629564 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ad6a65b4-4b7e-424f-9435-ec435517d2e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b180ec035ca64da5b923c857288583f5', 'request_id': 'req-ad6a65b4-4b7e-424f-9435-ec435517d2e4'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:10.703834 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ad6a65b4-4b7e-424f-9435-ec435517d2e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b180ec035ca64da5b923c857288583f5', 'request_id': 'req-ad6a65b4-4b7e-424f-9435-ec435517d2e4'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:10.715569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1079/2193] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:10 2022] POST /identity/v3/projects => generated 407 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:52:10.718045 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5efbb-8880-4e43-afd4-309e18829c38 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:10.732772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ad6a65b4-4b7e-424f-9435-ec435517d2e4 admin admin] The token cache is being invalidate because project b180ec035ca64da5b923c857288583f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:10.733597 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ad6a65b4-4b7e-424f-9435-ec435517d2e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:10.735210 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ad6a65b4-4b7e-424f-9435-ec435517d2e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:10.742776 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1115/2194] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:10 2022] DELETE /identity/v3/projects/b180ec035ca64da5b923c857288583f5 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:10.745666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a65b4-4b7e-424f-9435-ec435517d2e4 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:10.747221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ad6a65b4-4b7e-424f-9435-ec435517d2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:10.797836 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5efbb-8880-4e43-afd4-309e18829c38 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:10.806312 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f461913-adf3-4427-ba95-937cd4732e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:10.807345 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f461913-adf3-4427-ba95-937cd4732e88 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:10.807907 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f461913-adf3-4427-ba95-937cd4732e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:10.808406 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f461913-adf3-4427-ba95-937cd4732e88 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:10.809562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f461913-adf3-4427-ba95-937cd4732e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:10.814243 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f461913-adf3-4427-ba95-937cd4732e88 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:10.838385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:10.845616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a65b4-4b7e-424f-9435-ec435517d2e4 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:10.851503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d4a96-5ae7-4a57-9d4b-1cbbeb873973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:10.851756 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d4a96-5ae7-4a57-9d4b-1cbbeb873973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:10.851937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d4a96-5ae7-4a57-9d4b-1cbbeb873973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:10.852140 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d4a96-5ae7-4a57-9d4b-1cbbeb873973 admin admin] PATH_INFO: `/v3/users/8f7c6317c9884044a2ce745a09f77a30` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:10.853364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d4a96-5ae7-4a57-9d4b-1cbbeb873973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f7c6317c9884044a2ce745a09f77a30)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:10.855428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d4a96-5ae7-4a57-9d4b-1cbbeb873973 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:10.915370 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1080/2195] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:10 2022] POST /identity/v3/users => generated 310 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:52:10.920717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f461913-adf3-4427-ba95-937cd4732e88 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:10.923508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1f461913-adf3-4427-ba95-937cd4732e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:10.942223 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f461913-adf3-4427-ba95-937cd4732e88 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:10.948203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5a973-7f61-4c88-afea-18784ffc8f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:10.948856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5a973-7f61-4c88-afea-18784ffc8f1c admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:10.949128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5a973-7f61-4c88-afea-18784ffc8f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:10.949402 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5a973-7f61-4c88-afea-18784ffc8f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:10.950121 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5a973-7f61-4c88-afea-18784ffc8f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:10.953000 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5a973-7f61-4c88-afea-18784ffc8f1c admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:10.966269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1081/2196] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:10.973551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5a973-7f61-4c88-afea-18784ffc8f1c admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:10.984971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5a973-7f61-4c88-afea-18784ffc8f1c admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:10.990311 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788277b-7b0d-420f-a5a3-212f93325cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:10.991038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788277b-7b0d-420f-a5a3-212f93325cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:10.991320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788277b-7b0d-420f-a5a3-212f93325cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:10.991644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788277b-7b0d-420f-a5a3-212f93325cdc admin admin] PATH_INFO: `/v3/projects/01ed6a5a34bb4f93ad88e398c81d89ae/users/272e45f5aa2e43c1b597306213bbe791/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:11.009653 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788277b-7b0d-420f-a5a3-212f93325cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ed6a5a34bb4f93ad88e398c81d89ae, user_id=272e45f5aa2e43c1b597306213bbe791, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:11.013898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788277b-7b0d-420f-a5a3-212f93325cdc admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:11.032643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:11.134318 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1082/2197] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:10 2022] PUT /identity/v3/projects/01ed6a5a34bb4f93ad88e398c81d89ae/users/272e45f5aa2e43c1b597306213bbe791/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:52:11.143799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788277b-7b0d-420f-a5a3-212f93325cdc admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:11.143904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-424d4a96-5ae7-4a57-9d4b-1cbbeb873973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f7c6317c9884044a2ce745a09f77a30'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:11.206891 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788277b-7b0d-420f-a5a3-212f93325cdc admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:11.214127 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a32d1-23c2-4232-88a5-a7fed56cccaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:11.214127 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a32d1-23c2-4232-88a5-a7fed56cccaa admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:11.214127 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a32d1-23c2-4232-88a5-a7fed56cccaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:11.214127 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a32d1-23c2-4232-88a5-a7fed56cccaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:11.214483 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a32d1-23c2-4232-88a5-a7fed56cccaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:11.215091 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a32d1-23c2-4232-88a5-a7fed56cccaa admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:11.225267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1083/2198] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:11.229680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a32d1-23c2-4232-88a5-a7fed56cccaa admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:11.239868 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a32d1-23c2-4232-88a5-a7fed56cccaa admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:11.245322 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08aa614-acdd-4c33-b979-256717314d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:11.245988 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08aa614-acdd-4c33-b979-256717314d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:11.246262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08aa614-acdd-4c33-b979-256717314d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:11.246531 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08aa614-acdd-4c33-b979-256717314d27 admin admin] PATH_INFO: `/v3/projects/01ed6a5a34bb4f93ad88e398c81d89ae/users/272e45f5aa2e43c1b597306213bbe791/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:11.249305 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08aa614-acdd-4c33-b979-256717314d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ed6a5a34bb4f93ad88e398c81d89ae, user_id=272e45f5aa2e43c1b597306213bbe791, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:11.251982 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08aa614-acdd-4c33-b979-256717314d27 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:11.262715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1084/2199] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:11 2022] PUT /identity/v3/projects/01ed6a5a34bb4f93ad88e398c81d89ae/users/272e45f5aa2e43c1b597306213bbe791/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:52:11.275764 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be0ceb-2351-4918-b4b0-c98e621b35ca None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:11.276106 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be0ceb-2351-4918-b4b0-c98e621b35ca None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:11.276383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be0ceb-2351-4918-b4b0-c98e621b35ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:11.307234 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-48be0ceb-2351-4918-b4b0-c98e621b35ca None None] MFA Rules not processed for user `272e45f5aa2e43c1b597306213bbe791`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:11.308589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-48be0ceb-2351-4918-b4b0-c98e621b35ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:11.352320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-424d4a96-5ae7-4a57-9d4b-1cbbeb873973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f7c6317c9884044a2ce745a09f77a30'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:11.353069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-424d4a96-5ae7-4a57-9d4b-1cbbeb873973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f7c6317c9884044a2ce745a09f77a30'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:11.353861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-424d4a96-5ae7-4a57-9d4b-1cbbeb873973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f7c6317c9884044a2ce745a09f77a30'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:11.375303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-424d4a96-5ae7-4a57-9d4b-1cbbeb873973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f7c6317c9884044a2ce745a09f77a30'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:11.406012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1085/2200] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:11 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:52:11.412651 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1116/2201] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:10 2022] DELETE /identity/v3/users/8f7c6317c9884044a2ce745a09f77a30 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:11.746385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be0ceb-2351-4918-b4b0-c98e621b35ca None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:11.748560 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-48be0ceb-2351-4918-b4b0-c98e621b35ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:11.849334 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be0ceb-2351-4918-b4b0-c98e621b35ca None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:11.924989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108078c-adcb-42b0-a38f-300f96d25e67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:11.925858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108078c-adcb-42b0-a38f-300f96d25e67 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:11.926500 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108078c-adcb-42b0-a38f-300f96d25e67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:11.926876 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108078c-adcb-42b0-a38f-300f96d25e67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:11.955896 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d4a96-5ae7-4a57-9d4b-1cbbeb873973 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:11.958540 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-424d4a96-5ae7-4a57-9d4b-1cbbeb873973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:11.993146 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:12.028167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108078c-adcb-42b0-a38f-300f96d25e67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:12.030535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108078c-adcb-42b0-a38f-300f96d25e67 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:12.042376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1086/2202] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:11 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:12.076798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d4a96-5ae7-4a57-9d4b-1cbbeb873973 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:12.083496 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0eb74-870f-4816-bdd9-f179ee5890f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:12.084306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0eb74-870f-4816-bdd9-f179ee5890f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:12.084452 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0eb74-870f-4816-bdd9-f179ee5890f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:12.084727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0eb74-870f-4816-bdd9-f179ee5890f6 admin admin] PATH_INFO: `/v3/projects/a1a5a2af1e3b404a974093e481dd1393` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:12.085890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0eb74-870f-4816-bdd9-f179ee5890f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a5a2af1e3b404a974093e481dd1393)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:12.087900 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0eb74-870f-4816-bdd9-f179ee5890f6 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:12.291321 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f1c0eb74-870f-4816-bdd9-f179ee5890f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a5a2af1e3b404a974093e481dd1393', 'request_id': 'req-f1c0eb74-870f-4816-bdd9-f179ee5890f6'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:12.298250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f1c0eb74-870f-4816-bdd9-f179ee5890f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a5a2af1e3b404a974093e481dd1393', 'request_id': 'req-f1c0eb74-870f-4816-bdd9-f179ee5890f6'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:12.379173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:12.420936 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f1c0eb74-870f-4816-bdd9-f179ee5890f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a5a2af1e3b404a974093e481dd1393', 'request_id': 'req-f1c0eb74-870f-4816-bdd9-f179ee5890f6'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:12.432758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f1c0eb74-870f-4816-bdd9-f179ee5890f6 admin admin] The token cache is being invalidate because project a1a5a2af1e3b404a974093e481dd1393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:12.433046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f1c0eb74-870f-4816-bdd9-f179ee5890f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:12.433712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f1c0eb74-870f-4816-bdd9-f179ee5890f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:12.435270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1117/2203] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:11 2022] DELETE /identity/v3/projects/a1a5a2af1e3b404a974093e481dd1393 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:12.440783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824f7c1-4cd1-4a87-a3c2-f4dffa4a93c1 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:12.441117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824f7c1-4cd1-4a87-a3c2-f4dffa4a93c1 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:12.441430 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824f7c1-4cd1-4a87-a3c2-f4dffa4a93c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:12.466382 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-2824f7c1-4cd1-4a87-a3c2-f4dffa4a93c1 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:12.468909 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2824f7c1-4cd1-4a87-a3c2-f4dffa4a93c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:12.552386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1087/2204] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:12.553394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22be52b-6d9a-402d-90bf-87f3200be6ef None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:12.553714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22be52b-6d9a-402d-90bf-87f3200be6ef None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:12.554032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22be52b-6d9a-402d-90bf-87f3200be6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:12.577935 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f22be52b-6d9a-402d-90bf-87f3200be6ef None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:12.579199 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f22be52b-6d9a-402d-90bf-87f3200be6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:12.588045 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1118/2205] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:12.593184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824f7c1-4cd1-4a87-a3c2-f4dffa4a93c1 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:12.603668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824f7c1-4cd1-4a87-a3c2-f4dffa4a93c1 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:12.609084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34528d-9fc4-4b2f-8b93-63afb02d587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:12.609715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34528d-9fc4-4b2f-8b93-63afb02d587c admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:12.609996 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34528d-9fc4-4b2f-8b93-63afb02d587c admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:12.610273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34528d-9fc4-4b2f-8b93-63afb02d587c admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:12.610962 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34528d-9fc4-4b2f-8b93-63afb02d587c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:52:12.611374 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34528d-9fc4-4b2f-8b93-63afb02d587c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:12.613184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34528d-9fc4-4b2f-8b93-63afb02d587c admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:12.630067 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1088/2206] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:52:12.631319 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22be52b-6d9a-402d-90bf-87f3200be6ef None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:12.642518 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22be52b-6d9a-402d-90bf-87f3200be6ef None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:12.649384 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f4e7e-10b2-41b6-9d9c-c09899a4c7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:12.650067 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f4e7e-10b2-41b6-9d9c-c09899a4c7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:12.650347 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f4e7e-10b2-41b6-9d9c-c09899a4c7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:12.650729 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f4e7e-10b2-41b6-9d9c-c09899a4c7f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:12.651340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f4e7e-10b2-41b6-9d9c-c09899a4c7f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:12.653461 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f4e7e-10b2-41b6-9d9c-c09899a4c7f1 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:12.672223 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34528d-9fc4-4b2f-8b93-63afb02d587c admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:12.674347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-9c34528d-9fc4-4b2f-8b93-63afb02d587c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:12.739300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34528d-9fc4-4b2f-8b93-63afb02d587c admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:12.743088 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d3e24-7514-416c-abef-c833a3ea8902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:12.743713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d3e24-7514-416c-abef-c833a3ea8902 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:12.743992 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d3e24-7514-416c-abef-c833a3ea8902 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:12.744253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d3e24-7514-416c-abef-c833a3ea8902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:12.746028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-377d3e24-7514-416c-abef-c833a3ea8902 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:12.811746 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d3e24-7514-416c-abef-c833a3ea8902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:12.813272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d3e24-7514-416c-abef-c833a3ea8902 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:12.817427 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1119/2207] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:12 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:12.821790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f4e7e-10b2-41b6-9d9c-c09899a4c7f1 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:12.823220 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1089/2208] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:12 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:12.896945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f4e7e-10b2-41b6-9d9c-c09899a4c7f1 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:12.901854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f6737-8d4a-4cba-b311-33a345d235e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:12.902472 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f6737-8d4a-4cba-b311-33a345d235e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:12.902751 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f6737-8d4a-4cba-b311-33a345d235e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:12.903024 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f6737-8d4a-4cba-b311-33a345d235e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:12.904034 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f6737-8d4a-4cba-b311-33a345d235e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:12.905986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f6737-8d4a-4cba-b311-33a345d235e6 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:13.147075 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1120/2209] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:12 2022] POST /identity/v3/users => generated 294 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:13.151407 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d3e24-7514-416c-abef-c833a3ea8902 service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:13.162719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d3e24-7514-416c-abef-c833a3ea8902 service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:13.168016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2223240-18bd-4cb8-a33e-3a5e6c004217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:13.170723 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2223240-18bd-4cb8-a33e-3a5e6c004217 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:13.171215 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2223240-18bd-4cb8-a33e-3a5e6c004217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:13.171811 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2223240-18bd-4cb8-a33e-3a5e6c004217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:13.172662 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2223240-18bd-4cb8-a33e-3a5e6c004217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:13.174660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2223240-18bd-4cb8-a33e-3a5e6c004217 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:13.188207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1090/2210] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:52:13.192763 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f6737-8d4a-4cba-b311-33a345d235e6 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:13.203465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f6737-8d4a-4cba-b311-33a345d235e6 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:13.213129 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d888c0c-982e-4c84-b84a-556d96bb295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:13.213847 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d888c0c-982e-4c84-b84a-556d96bb295f admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:13.214203 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d888c0c-982e-4c84-b84a-556d96bb295f admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:13.214551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d888c0c-982e-4c84-b84a-556d96bb295f admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:13.215274 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d888c0c-982e-4c84-b84a-556d96bb295f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:13.217809 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d888c0c-982e-4c84-b84a-556d96bb295f admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:13.228494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1121/2211] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:13.239435 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2223240-18bd-4cb8-a33e-3a5e6c004217 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:13.250731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2223240-18bd-4cb8-a33e-3a5e6c004217 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:13.255695 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471419d9-2ce7-4b8f-a6d9-7247666c9508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:13.256372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471419d9-2ce7-4b8f-a6d9-7247666c9508 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:13.256659 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471419d9-2ce7-4b8f-a6d9-7247666c9508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:13.256945 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471419d9-2ce7-4b8f-a6d9-7247666c9508 admin admin] PATH_INFO: `/v3/projects/a92c28ca570b45678b11e099d0e281d1/users/94f7e93637c548b8ba2eed8480f6cf7f/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:13.274973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471419d9-2ce7-4b8f-a6d9-7247666c9508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92c28ca570b45678b11e099d0e281d1, user_id=94f7e93637c548b8ba2eed8480f6cf7f, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:13.277922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471419d9-2ce7-4b8f-a6d9-7247666c9508 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:13.390638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1091/2212] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:13 2022] PUT /identity/v3/projects/a92c28ca570b45678b11e099d0e281d1/users/94f7e93637c548b8ba2eed8480f6cf7f/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:13.405638 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7d2e3-2490-4cb5-9939-42c3686b8ad8 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:13.406749 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7d2e3-2490-4cb5-9939-42c3686b8ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:13.408316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7d2e3-2490-4cb5-9939-42c3686b8ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:13.416878 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471419d9-2ce7-4b8f-a6d9-7247666c9508 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:13.418859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-471419d9-2ce7-4b8f-a6d9-7247666c9508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:13.448761 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8ef7d2e3-2490-4cb5-9939-42c3686b8ad8 None None] MFA Rules not processed for user `94f7e93637c548b8ba2eed8480f6cf7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:13.450058 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8ef7d2e3-2490-4cb5-9939-42c3686b8ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:13.510162 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471419d9-2ce7-4b8f-a6d9-7247666c9508 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:13.518941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cbce7-ec49-4c6c-871e-0e9ebb71bd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:13.520362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cbce7-ec49-4c6c-871e-0e9ebb71bd5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:13.520857 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cbce7-ec49-4c6c-871e-0e9ebb71bd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:13.521352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cbce7-ec49-4c6c-871e-0e9ebb71bd5e admin admin] PATH_INFO: `/v3/users/002cd7cb206d47919efd2444edd91568` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:13.523649 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cbce7-ec49-4c6c-871e-0e9ebb71bd5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=002cd7cb206d47919efd2444edd91568)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:13.528221 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cbce7-ec49-4c6c-871e-0e9ebb71bd5e admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:13.535536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1122/2213] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:13.540562 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7d2e3-2490-4cb5-9939-42c3686b8ad8 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:13.562325 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7d2e3-2490-4cb5-9939-42c3686b8ad8 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:13.579153 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bb9b1-2729-493f-ba0f-ed1d9f8fa37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:13.580189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bb9b1-2729-493f-ba0f-ed1d9f8fa37d admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:13.580676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bb9b1-2729-493f-ba0f-ed1d9f8fa37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:13.581030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bb9b1-2729-493f-ba0f-ed1d9f8fa37d admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:13.582102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bb9b1-2729-493f-ba0f-ed1d9f8fa37d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:13.585391 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bb9b1-2729-493f-ba0f-ed1d9f8fa37d admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:13.696908 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1123/2214] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:13 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:13.697931 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bb9b1-2729-493f-ba0f-ed1d9f8fa37d admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:13.771226 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bb9b1-2729-493f-ba0f-ed1d9f8fa37d admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:13.776362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b2ee6-2b0b-4f48-ba91-e741e4b6f385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:13.777026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b2ee6-2b0b-4f48-ba91-e741e4b6f385 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:13.777298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b2ee6-2b0b-4f48-ba91-e741e4b6f385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:13.777572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b2ee6-2b0b-4f48-ba91-e741e4b6f385 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:13.778260 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b2ee6-2b0b-4f48-ba91-e741e4b6f385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:13.781272 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b2ee6-2b0b-4f48-ba91-e741e4b6f385 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:13.831495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4e7cbce7-ec49-4c6c-871e-0e9ebb71bd5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '002cd7cb206d47919efd2444edd91568'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:13.832300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4e7cbce7-ec49-4c6c-871e-0e9ebb71bd5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '002cd7cb206d47919efd2444edd91568'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:13.840954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4e7cbce7-ec49-4c6c-871e-0e9ebb71bd5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '002cd7cb206d47919efd2444edd91568'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:13.856319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4e7cbce7-ec49-4c6c-871e-0e9ebb71bd5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '002cd7cb206d47919efd2444edd91568'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:13.857061 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4e7cbce7-ec49-4c6c-871e-0e9ebb71bd5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '002cd7cb206d47919efd2444edd91568'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:13.919366 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1124/2215] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:13 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:52:13.923980 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b2ee6-2b0b-4f48-ba91-e741e4b6f385 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:13.926234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-eb0b2ee6-2b0b-4f48-ba91-e741e4b6f385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:13.941737 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b2ee6-2b0b-4f48-ba91-e741e4b6f385 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:13.947182 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aab225-fc80-4be4-a6a9-0b72197fdc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:13.948085 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aab225-fc80-4be4-a6a9-0b72197fdc7d admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:13.948285 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aab225-fc80-4be4-a6a9-0b72197fdc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:13.948507 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aab225-fc80-4be4-a6a9-0b72197fdc7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:13.949242 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aab225-fc80-4be4-a6a9-0b72197fdc7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:13.951715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aab225-fc80-4be4-a6a9-0b72197fdc7d admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:13.963415 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1125/2216] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:13.968989 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aab225-fc80-4be4-a6a9-0b72197fdc7d admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:13.981097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1092/2217] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:13 2022] DELETE /identity/v3/users/002cd7cb206d47919efd2444edd91568 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:13.983187 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89fdcf-b4da-463e-9b01-3cdbc17b3330 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:13.983738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89fdcf-b4da-463e-9b01-3cdbc17b3330 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:13.984231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89fdcf-b4da-463e-9b01-3cdbc17b3330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:13.991287 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aab225-fc80-4be4-a6a9-0b72197fdc7d admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:14.021581 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-1a89fdcf-b4da-463e-9b01-3cdbc17b3330 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:14.022469 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1a89fdcf-b4da-463e-9b01-3cdbc17b3330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:14.098913 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0bdd6-9480-4075-a90b-d1f1ef4bb12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:14.099701 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0bdd6-9480-4075-a90b-d1f1ef4bb12f admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:14.100069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0bdd6-9480-4075-a90b-d1f1ef4bb12f admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:14.100247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0bdd6-9480-4075-a90b-d1f1ef4bb12f admin admin] PATH_INFO: `/v3/projects/242958a625c647238a3e3bbeb7d2500b/users/a58729b0e7d84f6eae6ad03e51b69fc3/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:14.118148 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1093/2218] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:14.123499 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0bdd6-9480-4075-a90b-d1f1ef4bb12f admin admin] RBAC: Authorizing `identity:create_grant(project_id=242958a625c647238a3e3bbeb7d2500b, user_id=a58729b0e7d84f6eae6ad03e51b69fc3, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:14.126876 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0bdd6-9480-4075-a90b-d1f1ef4bb12f admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:14.130770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89fdcf-b4da-463e-9b01-3cdbc17b3330 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:14.132238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1a89fdcf-b4da-463e-9b01-3cdbc17b3330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:14.195530 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89fdcf-b4da-463e-9b01-3cdbc17b3330 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:14.199321 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7c7c-2dcc-4c55-811b-22bc44b87e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:14.199979 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7c7c-2dcc-4c55-811b-22bc44b87e1b service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:14.200293 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7c7c-2dcc-4c55-811b-22bc44b87e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:14.200565 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7c7c-2dcc-4c55-811b-22bc44b87e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:14.216328 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c7c7c-2dcc-4c55-811b-22bc44b87e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:14.217970 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c7c7c-2dcc-4c55-811b-22bc44b87e1b service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:14.228951 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1094/2219] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:52:14.299140 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:14.443066 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1126/2220] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:13 2022] PUT /identity/v3/projects/242958a625c647238a3e3bbeb7d2500b/users/a58729b0e7d84f6eae6ad03e51b69fc3/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:52:14.448627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7c7c-2dcc-4c55-811b-22bc44b87e1b service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:14.462921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7c7c-2dcc-4c55-811b-22bc44b87e1b service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:14.552724 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846aef5f-3b14-40f1-b8e4-eb215dd97510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:14.556278 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aef5f-3b14-40f1-b8e4-eb215dd97510 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:14.557526 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aef5f-3b14-40f1-b8e4-eb215dd97510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:14.558546 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aef5f-3b14-40f1-b8e4-eb215dd97510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:14.560313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846aef5f-3b14-40f1-b8e4-eb215dd97510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:14.563954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846aef5f-3b14-40f1-b8e4-eb215dd97510 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:14.584090 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1095/2221] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:14.590111 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0bdd6-9480-4075-a90b-d1f1ef4bb12f admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:14.620978 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0bdd6-9480-4075-a90b-d1f1ef4bb12f admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:14.630750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2012d77-7ca3-4336-84ce-e78a2fa15f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:14.631625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2012d77-7ca3-4336-84ce-e78a2fa15f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:14.631927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2012d77-7ca3-4336-84ce-e78a2fa15f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:14.632213 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2012d77-7ca3-4336-84ce-e78a2fa15f69 admin admin] PATH_INFO: `/v3/projects/242958a625c647238a3e3bbeb7d2500b/users/a58729b0e7d84f6eae6ad03e51b69fc3/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:14.640808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2012d77-7ca3-4336-84ce-e78a2fa15f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=242958a625c647238a3e3bbeb7d2500b, user_id=a58729b0e7d84f6eae6ad03e51b69fc3, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:14.649638 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2012d77-7ca3-4336-84ce-e78a2fa15f69 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:14.676344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1127/2222] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:14 2022] PUT /identity/v3/projects/242958a625c647238a3e3bbeb7d2500b/users/a58729b0e7d84f6eae6ad03e51b69fc3/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:14.694928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80b0af-d29f-440a-a1e3-135991853870 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:14.695395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80b0af-d29f-440a-a1e3-135991853870 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:14.696457 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80b0af-d29f-440a-a1e3-135991853870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:14.749575 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-4e80b0af-d29f-440a-a1e3-135991853870 None None] MFA Rules not processed for user `a58729b0e7d84f6eae6ad03e51b69fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:14.750798 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4e80b0af-d29f-440a-a1e3-135991853870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:14.758473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:14.842393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1096/2223] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:14.854080 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2012d77-7ca3-4336-84ce-e78a2fa15f69 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:14.855858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a2012d77-7ca3-4336-84ce-e78a2fa15f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:14.900542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80b0af-d29f-440a-a1e3-135991853870 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:14.912740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4e80b0af-d29f-440a-a1e3-135991853870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:14.930645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2012d77-7ca3-4336-84ce-e78a2fa15f69 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:14.944839 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb914f4-9775-4ac9-a842-158ec672ff3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:14.945964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb914f4-9775-4ac9-a842-158ec672ff3a service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:14.946670 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb914f4-9775-4ac9-a842-158ec672ff3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:14.947704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb914f4-9775-4ac9-a842-158ec672ff3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:14.963955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb914f4-9775-4ac9-a842-158ec672ff3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:14.968680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb914f4-9775-4ac9-a842-158ec672ff3a service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:14.984420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1128/2224] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:15.015078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80b0af-d29f-440a-a1e3-135991853870 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:15.021014 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7824b-20fb-42c6-a1fc-952fc22ee656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:15.021653 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7824b-20fb-42c6-a1fc-952fc22ee656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:15.021929 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7824b-20fb-42c6-a1fc-952fc22ee656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:15.022200 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7824b-20fb-42c6-a1fc-952fc22ee656 admin admin] PATH_INFO: `/v3/projects/8259043f3b9047d0b0927256a796852b` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:15.023359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7824b-20fb-42c6-a1fc-952fc22ee656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8259043f3b9047d0b0927256a796852b)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:15.025324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7824b-20fb-42c6-a1fc-952fc22ee656 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:15.187255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c0f7824b-20fb-42c6-a1fc-952fc22ee656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8259043f3b9047d0b0927256a796852b', 'request_id': 'req-c0f7824b-20fb-42c6-a1fc-952fc22ee656'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:15.315799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c0f7824b-20fb-42c6-a1fc-952fc22ee656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8259043f3b9047d0b0927256a796852b', 'request_id': 'req-c0f7824b-20fb-42c6-a1fc-952fc22ee656'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:15.323046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c0f7824b-20fb-42c6-a1fc-952fc22ee656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8259043f3b9047d0b0927256a796852b', 'request_id': 'req-c0f7824b-20fb-42c6-a1fc-952fc22ee656'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:15.334161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c0f7824b-20fb-42c6-a1fc-952fc22ee656 admin admin] The token cache is being invalidate because project 8259043f3b9047d0b0927256a796852b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:15.334448 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c0f7824b-20fb-42c6-a1fc-952fc22ee656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:15.335139 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c0f7824b-20fb-42c6-a1fc-952fc22ee656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:15.336738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1097/2225] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:14 2022] DELETE /identity/v3/projects/8259043f3b9047d0b0927256a796852b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:15.342869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faa605-7c27-41ac-b8e5-e04f67974932 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:15.343148 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faa605-7c27-41ac-b8e5-e04f67974932 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:15.343418 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faa605-7c27-41ac-b8e5-e04f67974932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:15.364184 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-87faa605-7c27-41ac-b8e5-e04f67974932 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:15.365484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-87faa605-7c27-41ac-b8e5-e04f67974932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:15.454161 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1129/2226] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:15.462476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db956da-b4fb-45d0-9dea-46f7929fba05 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:15.462710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db956da-b4fb-45d0-9dea-46f7929fba05 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:15.462937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db956da-b4fb-45d0-9dea-46f7929fba05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:15.486692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-0db956da-b4fb-45d0-9dea-46f7929fba05 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:15.490212 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0db956da-b4fb-45d0-9dea-46f7929fba05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:15.497294 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1098/2227] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:52:15.502654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87faa605-7c27-41ac-b8e5-e04f67974932 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:15.512898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87faa605-7c27-41ac-b8e5-e04f67974932 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:15.517970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2d27e-7d0a-49b7-ad75-6294bdb26dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:15.518582 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2d27e-7d0a-49b7-ad75-6294bdb26dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:15.518857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2d27e-7d0a-49b7-ad75-6294bdb26dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:15.519124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2d27e-7d0a-49b7-ad75-6294bdb26dc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:15.519808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2d27e-7d0a-49b7-ad75-6294bdb26dc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:52:15.520109 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2d27e-7d0a-49b7-ad75-6294bdb26dc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:15.521700 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2d27e-7d0a-49b7-ad75-6294bdb26dc4 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:15.534646 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1130/2228] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:52:15.539245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db956da-b4fb-45d0-9dea-46f7929fba05 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:15.550658 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db956da-b4fb-45d0-9dea-46f7929fba05 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:15.555390 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9a507-07fe-4e9c-909b-4f8247642a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:15.556088 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9a507-07fe-4e9c-909b-4f8247642a88 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:15.556367 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9a507-07fe-4e9c-909b-4f8247642a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:15.556642 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9a507-07fe-4e9c-909b-4f8247642a88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:15.557298 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9a507-07fe-4e9c-909b-4f8247642a88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:15.559230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9a507-07fe-4e9c-909b-4f8247642a88 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:15.709846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1099/2229] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:15 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:15.710949 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2d27e-7d0a-49b7-ad75-6294bdb26dc4 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:15.722282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2d27e-7d0a-49b7-ad75-6294bdb26dc4 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:15.782854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287167b-97a5-4967-8cfa-abff2cf798a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:15.783507 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287167b-97a5-4967-8cfa-abff2cf798a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:15.783781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287167b-97a5-4967-8cfa-abff2cf798a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:15.784062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287167b-97a5-4967-8cfa-abff2cf798a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:15.784745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287167b-97a5-4967-8cfa-abff2cf798a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:15.786649 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287167b-97a5-4967-8cfa-abff2cf798a7 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:15.929788 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1131/2230] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:15 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:15.935139 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9a507-07fe-4e9c-909b-4f8247642a88 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:15.955633 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9a507-07fe-4e9c-909b-4f8247642a88 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:15.963762 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e161a55-58e3-4e3f-881f-300b71735477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:15.964807 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e161a55-58e3-4e3f-881f-300b71735477 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:15.965302 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e161a55-58e3-4e3f-881f-300b71735477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:15.965803 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e161a55-58e3-4e3f-881f-300b71735477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:15.968263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e161a55-58e3-4e3f-881f-300b71735477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:15.970419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e161a55-58e3-4e3f-881f-300b71735477 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:15.985112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1100/2231] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:15.987335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287167b-97a5-4967-8cfa-abff2cf798a7 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:15.996720 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:16.004760 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287167b-97a5-4967-8cfa-abff2cf798a7 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:16.012998 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934e312-5326-4398-9e91-b96d212e8111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:16.014571 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934e312-5326-4398-9e91-b96d212e8111 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:16.015334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934e312-5326-4398-9e91-b96d212e8111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:16.015856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934e312-5326-4398-9e91-b96d212e8111 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:16.017071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934e312-5326-4398-9e91-b96d212e8111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:16.020376 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934e312-5326-4398-9e91-b96d212e8111 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:16.038188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1132/2232] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:52:16.043130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e161a55-58e3-4e3f-881f-300b71735477 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:16.063253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e161a55-58e3-4e3f-881f-300b71735477 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:16.072495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249c19b-603f-401b-ac3e-f0705f1779ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:16.073654 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249c19b-603f-401b-ac3e-f0705f1779ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:16.074162 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249c19b-603f-401b-ac3e-f0705f1779ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:16.074662 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249c19b-603f-401b-ac3e-f0705f1779ae admin admin] PATH_INFO: `/v3/projects/488bd025da6b4e7f828d9ff518734249/users/16420bf110644fd48d79dd45d3a3d53c/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:16.102097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249c19b-603f-401b-ac3e-f0705f1779ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=488bd025da6b4e7f828d9ff518734249, user_id=16420bf110644fd48d79dd45d3a3d53c, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:16.104932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249c19b-603f-401b-ac3e-f0705f1779ae admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:16.201836 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1101/2233] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:16 2022] PUT /identity/v3/projects/488bd025da6b4e7f828d9ff518734249/users/16420bf110644fd48d79dd45d3a3d53c/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:16.212595 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e329941-5f22-4060-8f65-a01a1d1a31ca None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:16.212830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e329941-5f22-4060-8f65-a01a1d1a31ca None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:16.213107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e329941-5f22-4060-8f65-a01a1d1a31ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:16.256573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-3e329941-5f22-4060-8f65-a01a1d1a31ca None None] MFA Rules not processed for user `16420bf110644fd48d79dd45d3a3d53c`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:16.258560 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3e329941-5f22-4060-8f65-a01a1d1a31ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:16.346086 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1133/2234] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:16.356221 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:16.606186 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249c19b-603f-401b-ac3e-f0705f1779ae admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:16.608489 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-e249c19b-603f-401b-ac3e-f0705f1779ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:16.696383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249c19b-603f-401b-ac3e-f0705f1779ae admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:16.703265 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c707c-4d09-4ed8-a9fc-e8fcb252dfd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:16.706003 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c707c-4d09-4ed8-a9fc-e8fcb252dfd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:16.706003 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c707c-4d09-4ed8-a9fc-e8fcb252dfd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:16.706003 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c707c-4d09-4ed8-a9fc-e8fcb252dfd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:16.715644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c707c-4d09-4ed8-a9fc-e8fcb252dfd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:16.717285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c707c-4d09-4ed8-a9fc-e8fcb252dfd8 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:16.727960 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1102/2235] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:16.760640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e329941-5f22-4060-8f65-a01a1d1a31ca None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:16.863106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e329941-5f22-4060-8f65-a01a1d1a31ca None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:16.868676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe3864-53ef-4b68-96a4-5f34ff762ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:16.869328 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3864-53ef-4b68-96a4-5f34ff762ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:16.869606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3864-53ef-4b68-96a4-5f34ff762ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:16.870172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3864-53ef-4b68-96a4-5f34ff762ece admin admin] PATH_INFO: `/v3/users/16420bf110644fd48d79dd45d3a3d53c` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:16.871413 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe3864-53ef-4b68-96a4-5f34ff762ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=16420bf110644fd48d79dd45d3a3d53c)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:16.873407 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe3864-53ef-4b68-96a4-5f34ff762ece admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:17.179246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b1fe3864-53ef-4b68-96a4-5f34ff762ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16420bf110644fd48d79dd45d3a3d53c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:17.386462 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b1fe3864-53ef-4b68-96a4-5f34ff762ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16420bf110644fd48d79dd45d3a3d53c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:17.386745 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:17.393636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b1fe3864-53ef-4b68-96a4-5f34ff762ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16420bf110644fd48d79dd45d3a3d53c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:17.393636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b1fe3864-53ef-4b68-96a4-5f34ff762ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16420bf110644fd48d79dd45d3a3d53c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:17.399051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b1fe3864-53ef-4b68-96a4-5f34ff762ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16420bf110644fd48d79dd45d3a3d53c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:17.426786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1134/2236] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:16 2022] DELETE /identity/v3/users/16420bf110644fd48d79dd45d3a3d53c => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:17.432246 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e924b4c-be48-43f6-9e02-c7faa43ba582 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:17.432583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e924b4c-be48-43f6-9e02-c7faa43ba582 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:17.432792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e924b4c-be48-43f6-9e02-c7faa43ba582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:17.460047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-9e924b4c-be48-43f6-9e02-c7faa43ba582 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:17.461280 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-9e924b4c-be48-43f6-9e02-c7faa43ba582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:17.539122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1103/2237] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:17.545988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe3864-53ef-4b68-96a4-5f34ff762ece admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:17.548612 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:17.555803 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b1fe3864-53ef-4b68-96a4-5f34ff762ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:17.630034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e924b4c-be48-43f6-9e02-c7faa43ba582 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:17.632404 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-9e924b4c-be48-43f6-9e02-c7faa43ba582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:17.648729 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe3864-53ef-4b68-96a4-5f34ff762ece admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:17.657507 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613b432-088a-439c-86e1-e92167f0e9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:17.660073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613b432-088a-439c-86e1-e92167f0e9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:17.660545 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613b432-088a-439c-86e1-e92167f0e9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:17.661088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613b432-088a-439c-86e1-e92167f0e9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:17.665184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e924b4c-be48-43f6-9e02-c7faa43ba582 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:17.682693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613b432-088a-439c-86e1-e92167f0e9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:17.684155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bec99-cda4-457b-9d65-df3644665b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:17.685083 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bec99-cda4-457b-9d65-df3644665b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:17.686035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613b432-088a-439c-86e1-e92167f0e9d8 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:17.689085 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bec99-cda4-457b-9d65-df3644665b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:17.689604 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bec99-cda4-457b-9d65-df3644665b32 admin admin] PATH_INFO: `/v3/users/94f7e93637c548b8ba2eed8480f6cf7f` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:17.691837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bec99-cda4-457b-9d65-df3644665b32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f7e93637c548b8ba2eed8480f6cf7f)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:17.695278 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bec99-cda4-457b-9d65-df3644665b32 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:17.707100 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1135/2238] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:52:17.802467 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613b432-088a-439c-86e1-e92167f0e9d8 service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:17.806124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7613b432-088a-439c-86e1-e92167f0e9d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:17.846724 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613b432-088a-439c-86e1-e92167f0e9d8 service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:17.866783 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6442d3-a594-4df3-a126-d2a8d1de5b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:17.868356 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6442d3-a594-4df3-a126-d2a8d1de5b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:17.869160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6442d3-a594-4df3-a126-d2a8d1de5b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:17.870790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6442d3-a594-4df3-a126-d2a8d1de5b73 admin admin] PATH_INFO: `/v3/users/9406bf7a821f46289490a42921fca552` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:17.873881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6442d3-a594-4df3-a126-d2a8d1de5b73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9406bf7a821f46289490a42921fca552)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:17.877312 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6442d3-a594-4df3-a126-d2a8d1de5b73 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:18.074192 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-716bec99-cda4-457b-9d65-df3644665b32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f7e93637c548b8ba2eed8480f6cf7f'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:18.075198 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-716bec99-cda4-457b-9d65-df3644665b32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f7e93637c548b8ba2eed8480f6cf7f'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:18.089876 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-716bec99-cda4-457b-9d65-df3644665b32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f7e93637c548b8ba2eed8480f6cf7f'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:18.122805 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-716bec99-cda4-457b-9d65-df3644665b32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f7e93637c548b8ba2eed8480f6cf7f'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:18.123615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-716bec99-cda4-457b-9d65-df3644665b32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f7e93637c548b8ba2eed8480f6cf7f'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:18.227865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-5c6442d3-a594-4df3-a126-d2a8d1de5b73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9406bf7a821f46289490a42921fca552'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:18.301484 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1104/2239] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:17 2022] DELETE /identity/v3/users/94f7e93637c548b8ba2eed8480f6cf7f => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:18.314624 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062e193-61e1-414c-b876-6f7ce1c391f9 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:18.314921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062e193-61e1-414c-b876-6f7ce1c391f9 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:18.315381 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062e193-61e1-414c-b876-6f7ce1c391f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:18.337331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-7062e193-61e1-414c-b876-6f7ce1c391f9 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:18.338915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-7062e193-61e1-414c-b876-6f7ce1c391f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:18.427691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-5c6442d3-a594-4df3-a126-d2a8d1de5b73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9406bf7a821f46289490a42921fca552'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:18.429263 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-5c6442d3-a594-4df3-a126-d2a8d1de5b73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9406bf7a821f46289490a42921fca552'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:18.430587 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-5c6442d3-a594-4df3-a126-d2a8d1de5b73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9406bf7a821f46289490a42921fca552'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:18.435079 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1105/2240] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:52:18.448462 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-5c6442d3-a594-4df3-a126-d2a8d1de5b73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9406bf7a821f46289490a42921fca552'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:18.449679 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062e193-61e1-414c-b876-6f7ce1c391f9 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:18.451874 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-7062e193-61e1-414c-b876-6f7ce1c391f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:18.478108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1136/2241] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:17 2022] DELETE /identity/v3/users/9406bf7a821f46289490a42921fca552 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:18.479893 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758f66b-40ed-40d6-8c5d-678c9e87d4d0 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:18.480378 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758f66b-40ed-40d6-8c5d-678c9e87d4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:18.480866 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758f66b-40ed-40d6-8c5d-678c9e87d4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:18.524612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062e193-61e1-414c-b876-6f7ce1c391f9 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:18.532922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-9758f66b-40ed-40d6-8c5d-678c9e87d4d0 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:18.535689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9758f66b-40ed-40d6-8c5d-678c9e87d4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:18.615468 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d329e-32d4-47db-b74b-af00764e0f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:18.616767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d329e-32d4-47db-b74b-af00764e0f7c service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:18.617274 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d329e-32d4-47db-b74b-af00764e0f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:18.617459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d329e-32d4-47db-b74b-af00764e0f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:18.669153 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1137/2242] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:18.670789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758f66b-40ed-40d6-8c5d-678c9e87d4d0 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:18.672648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9758f66b-40ed-40d6-8c5d-678c9e87d4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:18.692804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758f66b-40ed-40d6-8c5d-678c9e87d4d0 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:18.694188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd83284-8885-429e-891e-338bb251de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:18.694880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd83284-8885-429e-891e-338bb251de52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:18.695299 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd83284-8885-429e-891e-338bb251de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:18.695736 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd83284-8885-429e-891e-338bb251de52 admin admin] PATH_INFO: `/v3/projects/488bd025da6b4e7f828d9ff518734249` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:18.697034 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd83284-8885-429e-891e-338bb251de52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=488bd025da6b4e7f828d9ff518734249)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:18.699290 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd83284-8885-429e-891e-338bb251de52 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:18.703777 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d329e-32d4-47db-b74b-af00764e0f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:18.705307 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d329e-32d4-47db-b74b-af00764e0f7c service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:18.715609 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1106/2243] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:18.716498 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d329e-32d4-47db-b74b-af00764e0f7c service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:18.725893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d329e-32d4-47db-b74b-af00764e0f7c service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:18.730107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2229d-2a8e-4e41-8235-45601dfdd631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:18.730739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2229d-2a8e-4e41-8235-45601dfdd631 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:18.731023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2229d-2a8e-4e41-8235-45601dfdd631 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:18.731344 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2229d-2a8e-4e41-8235-45601dfdd631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:18.743114 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2229d-2a8e-4e41-8235-45601dfdd631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:18.745776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2229d-2a8e-4e41-8235-45601dfdd631 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:18.760303 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1107/2244] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:18.776613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:18.845436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-1bd83284-8885-429e-891e-338bb251de52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488bd025da6b4e7f828d9ff518734249', 'request_id': 'req-1bd83284-8885-429e-891e-338bb251de52'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:18.852990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-1bd83284-8885-429e-891e-338bb251de52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488bd025da6b4e7f828d9ff518734249', 'request_id': 'req-1bd83284-8885-429e-891e-338bb251de52'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:18.944656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-1bd83284-8885-429e-891e-338bb251de52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488bd025da6b4e7f828d9ff518734249', 'request_id': 'req-1bd83284-8885-429e-891e-338bb251de52'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:18.957807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-1bd83284-8885-429e-891e-338bb251de52 admin admin] The token cache is being invalidate because project 488bd025da6b4e7f828d9ff518734249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:18.958238 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-1bd83284-8885-429e-891e-338bb251de52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:18.959057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-1bd83284-8885-429e-891e-338bb251de52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:18.961130 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1138/2245] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:18 2022] DELETE /identity/v3/projects/488bd025da6b4e7f828d9ff518734249 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:19.031426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:19.322374 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2229d-2a8e-4e41-8235-45601dfdd631 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:19.324355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-e2d2229d-2a8e-4e41-8235-45601dfdd631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:19.338200 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2229d-2a8e-4e41-8235-45601dfdd631 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:19.430732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22faf38-98cf-4d01-89c2-63448d32db72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:19.432685 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22faf38-98cf-4d01-89c2-63448d32db72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:19.440010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22faf38-98cf-4d01-89c2-63448d32db72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:19.441207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22faf38-98cf-4d01-89c2-63448d32db72 admin admin] PATH_INFO: `/v3/users/2c6c6bc26d3c4aa5937ded4e24de1032` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:19.443810 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22faf38-98cf-4d01-89c2-63448d32db72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c6c6bc26d3c4aa5937ded4e24de1032)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:19.446343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22faf38-98cf-4d01-89c2-63448d32db72 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:19.625590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:19.722014 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a22faf38-98cf-4d01-89c2-63448d32db72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c6c6bc26d3c4aa5937ded4e24de1032'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:19.723106 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a22faf38-98cf-4d01-89c2-63448d32db72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c6c6bc26d3c4aa5937ded4e24de1032'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:19.738115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a22faf38-98cf-4d01-89c2-63448d32db72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c6c6bc26d3c4aa5937ded4e24de1032'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:19.756008 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a22faf38-98cf-4d01-89c2-63448d32db72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c6c6bc26d3c4aa5937ded4e24de1032'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:19.757522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a22faf38-98cf-4d01-89c2-63448d32db72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c6c6bc26d3c4aa5937ded4e24de1032'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:19.908852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd83284-8885-429e-891e-338bb251de52 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:19.909348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1108/2246] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:19 2022] DELETE /identity/v3/users/2c6c6bc26d3c4aa5937ded4e24de1032 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:52:19.911237 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1bd83284-8885-429e-891e-338bb251de52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:19.914050 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22faf38-98cf-4d01-89c2-63448d32db72 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:19.922147 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a22faf38-98cf-4d01-89c2-63448d32db72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:19.927497 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd83284-8885-429e-891e-338bb251de52 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:20.001517 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff715d9-afb0-4045-9178-1dbefd7b300e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:20.001787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22faf38-98cf-4d01-89c2-63448d32db72 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:20.002202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff715d9-afb0-4045-9178-1dbefd7b300e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:20.002410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff715d9-afb0-4045-9178-1dbefd7b300e admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:20.002658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff715d9-afb0-4045-9178-1dbefd7b300e admin admin] PATH_INFO: `/v3/projects/4a072d0d6eb14ffabd638b7fc99ca53b` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:20.003985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff715d9-afb0-4045-9178-1dbefd7b300e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a072d0d6eb14ffabd638b7fc99ca53b)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:20.006192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff715d9-afb0-4045-9178-1dbefd7b300e admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:20.007177 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697bcd4-bb41-4eca-9405-fad91f6f9893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:20.007859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697bcd4-bb41-4eca-9405-fad91f6f9893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:20.008140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697bcd4-bb41-4eca-9405-fad91f6f9893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:20.008416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697bcd4-bb41-4eca-9405-fad91f6f9893 admin admin] PATH_INFO: `/v3/projects/a92c28ca570b45678b11e099d0e281d1` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:20.009576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697bcd4-bb41-4eca-9405-fad91f6f9893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92c28ca570b45678b11e099d0e281d1)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:20.011588 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697bcd4-bb41-4eca-9405-fad91f6f9893 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:20.211116 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-7697bcd4-bb41-4eca-9405-fad91f6f9893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92c28ca570b45678b11e099d0e281d1', 'request_id': 'req-7697bcd4-bb41-4eca-9405-fad91f6f9893'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:20.213623 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3ff715d9-afb0-4045-9178-1dbefd7b300e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a072d0d6eb14ffabd638b7fc99ca53b', 'request_id': 'req-3ff715d9-afb0-4045-9178-1dbefd7b300e'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:20.221092 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3ff715d9-afb0-4045-9178-1dbefd7b300e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a072d0d6eb14ffabd638b7fc99ca53b', 'request_id': 'req-3ff715d9-afb0-4045-9178-1dbefd7b300e'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:20.335030 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-7697bcd4-bb41-4eca-9405-fad91f6f9893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92c28ca570b45678b11e099d0e281d1', 'request_id': 'req-7697bcd4-bb41-4eca-9405-fad91f6f9893'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:20.338102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:20.348320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-7697bcd4-bb41-4eca-9405-fad91f6f9893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92c28ca570b45678b11e099d0e281d1', 'request_id': 'req-7697bcd4-bb41-4eca-9405-fad91f6f9893'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:20.364358 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-7697bcd4-bb41-4eca-9405-fad91f6f9893 admin admin] The token cache is being invalidate because project a92c28ca570b45678b11e099d0e281d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:20.364827 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-7697bcd4-bb41-4eca-9405-fad91f6f9893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:20.369571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-7697bcd4-bb41-4eca-9405-fad91f6f9893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:20.369571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1109/2247] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:19 2022] DELETE /identity/v3/projects/a92c28ca570b45678b11e099d0e281d1 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:20.369571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8ff05-cb53-4f77-ab36-f1434f886b66 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:20.370297 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8ff05-cb53-4f77-ab36-f1434f886b66 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:20.370660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8ff05-cb53-4f77-ab36-f1434f886b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:20.397026 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-04a8ff05-cb53-4f77-ab36-f1434f886b66 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:20.398441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-04a8ff05-cb53-4f77-ab36-f1434f886b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:20.433021 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3ff715d9-afb0-4045-9178-1dbefd7b300e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a072d0d6eb14ffabd638b7fc99ca53b', 'request_id': 'req-3ff715d9-afb0-4045-9178-1dbefd7b300e'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:20.458227 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3ff715d9-afb0-4045-9178-1dbefd7b300e admin admin] The token cache is being invalidate because project 4a072d0d6eb14ffabd638b7fc99ca53b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:20.458735 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3ff715d9-afb0-4045-9178-1dbefd7b300e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:20.463350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3ff715d9-afb0-4045-9178-1dbefd7b300e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:20.469681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1139/2248] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:19 2022] DELETE /identity/v3/projects/4a072d0d6eb14ffabd638b7fc99ca53b => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:52:20.471518 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff715d9-afb0-4045-9178-1dbefd7b300e admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:20.473168 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3ff715d9-afb0-4045-9178-1dbefd7b300e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:20.565094 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1110/2249] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:20.583745 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4b74f-1849-417d-a6ea-de57a93e2858 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:20.584190 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4b74f-1849-417d-a6ea-de57a93e2858 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:20.584670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4b74f-1849-417d-a6ea-de57a93e2858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:20.638173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-81d4b74f-1849-417d-a6ea-de57a93e2858 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:20.640533 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-81d4b74f-1849-417d-a6ea-de57a93e2858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:20.644863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff715d9-afb0-4045-9178-1dbefd7b300e admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:20.655809 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8330e-c857-4ff0-bda7-8084a008fd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:20.656613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8330e-c857-4ff0-bda7-8084a008fd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:20.657352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8330e-c857-4ff0-bda7-8084a008fd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:20.658261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8330e-c857-4ff0-bda7-8084a008fd13 admin admin] PATH_INFO: `/v3/users/a58729b0e7d84f6eae6ad03e51b69fc3` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:20.667132 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1111/2250] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:20.667132 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4b74f-1849-417d-a6ea-de57a93e2858 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:20.667431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8330e-c857-4ff0-bda7-8084a008fd13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a58729b0e7d84f6eae6ad03e51b69fc3)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:20.667431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8330e-c857-4ff0-bda7-8084a008fd13 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:20.672774 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-81d4b74f-1849-417d-a6ea-de57a93e2858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:20.809500 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4b74f-1849-417d-a6ea-de57a93e2858 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:20.827718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bfb4f-0f25-4ccb-a870-861e8288cdbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:20.829052 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bfb4f-0f25-4ccb-a870-861e8288cdbe service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:20.829404 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bfb4f-0f25-4ccb-a870-861e8288cdbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:20.829784 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bfb4f-0f25-4ccb-a870-861e8288cdbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:20.845447 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bfb4f-0f25-4ccb-a870-861e8288cdbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:20.847013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bfb4f-0f25-4ccb-a870-861e8288cdbe service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:20.858652 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1112/2251] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:20.860493 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadda1eb-bb5b-4830-9c6c-a9f6fe21f3fb None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:20.860646 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadda1eb-bb5b-4830-9c6c-a9f6fe21f3fb None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:20.861917 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadda1eb-bb5b-4830-9c6c-a9f6fe21f3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:20.900881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-dadda1eb-bb5b-4830-9c6c-a9f6fe21f3fb None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:20.905665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-dadda1eb-bb5b-4830-9c6c-a9f6fe21f3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:20.923526 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1113/2252] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:20.925673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadda1eb-bb5b-4830-9c6c-a9f6fe21f3fb None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:20.940060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadda1eb-bb5b-4830-9c6c-a9f6fe21f3fb None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:20.946934 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbd7be-2489-41f3-9f0f-d5fae68b2cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:20.947701 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbd7be-2489-41f3-9f0f-d5fae68b2cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:20.948728 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbd7be-2489-41f3-9f0f-d5fae68b2cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:20.948728 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbd7be-2489-41f3-9f0f-d5fae68b2cb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:20.949498 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbd7be-2489-41f3-9f0f-d5fae68b2cb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:52:20.949742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbd7be-2489-41f3-9f0f-d5fae68b2cb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:20.952059 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbd7be-2489-41f3-9f0f-d5fae68b2cb1 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:20.969323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1114/2253] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:52:20.977422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbd7be-2489-41f3-9f0f-d5fae68b2cb1 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:20.990260 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-18b8330e-c857-4ff0-bda7-8084a008fd13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a58729b0e7d84f6eae6ad03e51b69fc3'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:20.990853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbd7be-2489-41f3-9f0f-d5fae68b2cb1 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:20.997213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1930485-3662-474f-beb6-8f90d062e46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:20.998319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1930485-3662-474f-beb6-8f90d062e46c admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:20.998797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1930485-3662-474f-beb6-8f90d062e46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:20.999403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1930485-3662-474f-beb6-8f90d062e46c admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:21.000627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1930485-3662-474f-beb6-8f90d062e46c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:21.002222 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1930485-3662-474f-beb6-8f90d062e46c admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:21.106179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-18b8330e-c857-4ff0-bda7-8084a008fd13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a58729b0e7d84f6eae6ad03e51b69fc3'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:21.107380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-18b8330e-c857-4ff0-bda7-8084a008fd13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a58729b0e7d84f6eae6ad03e51b69fc3'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:21.108088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-18b8330e-c857-4ff0-bda7-8084a008fd13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a58729b0e7d84f6eae6ad03e51b69fc3'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:21.116633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-18b8330e-c857-4ff0-bda7-8084a008fd13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a58729b0e7d84f6eae6ad03e51b69fc3'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:21.140288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1140/2254] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:20 2022] DELETE /identity/v3/users/a58729b0e7d84f6eae6ad03e51b69fc3 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:21.157348 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:21.183714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1115/2255] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:20 2022] POST /identity/v3/projects => generated 381 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:52:21.188501 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8330e-c857-4ff0-bda7-8084a008fd13 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:21.190262 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-18b8330e-c857-4ff0-bda7-8084a008fd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:21.306977 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8330e-c857-4ff0-bda7-8084a008fd13 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:21.380456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a756d41-8db4-405c-9389-ca1b4e2d1b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:21.381242 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a756d41-8db4-405c-9389-ca1b4e2d1b8a admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:21.381616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a756d41-8db4-405c-9389-ca1b4e2d1b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:21.381894 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a756d41-8db4-405c-9389-ca1b4e2d1b8a admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:21.382534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a756d41-8db4-405c-9389-ca1b4e2d1b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:21.384497 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a756d41-8db4-405c-9389-ca1b4e2d1b8a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:21.556744 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1141/2256] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:21 2022] POST /identity/v3/users => generated 291 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:21.558041 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1930485-3662-474f-beb6-8f90d062e46c admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:21.561307 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a756d41-8db4-405c-9389-ca1b4e2d1b8a admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:21.563342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-6a756d41-8db4-405c-9389-ca1b4e2d1b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:21.569926 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1930485-3662-474f-beb6-8f90d062e46c admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:21.577156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f637c1-9218-4d00-a021-5af1de17b43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:21.578271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f637c1-9218-4d00-a021-5af1de17b43f admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:21.578688 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f637c1-9218-4d00-a021-5af1de17b43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:21.579445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a756d41-8db4-405c-9389-ca1b4e2d1b8a admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:21.580206 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f637c1-9218-4d00-a021-5af1de17b43f admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:21.581781 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f637c1-9218-4d00-a021-5af1de17b43f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:21.584372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f637c1-9218-4d00-a021-5af1de17b43f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:21.600271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1116/2257] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:21.610765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f637c1-9218-4d00-a021-5af1de17b43f admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:21.618594 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1d2d1-5624-45d3-954b-06c4e2b454d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:21.619356 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1d2d1-5624-45d3-954b-06c4e2b454d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:21.619725 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1d2d1-5624-45d3-954b-06c4e2b454d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:21.620114 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1d2d1-5624-45d3-954b-06c4e2b454d9 admin admin] PATH_INFO: `/v3/projects/aa831bc73ba7411b8aad7da420a6f98f` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:21.622041 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1d2d1-5624-45d3-954b-06c4e2b454d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa831bc73ba7411b8aad7da420a6f98f)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:21.626768 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1d2d1-5624-45d3-954b-06c4e2b454d9 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:21.661370 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f637c1-9218-4d00-a021-5af1de17b43f admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:21.671512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674616e6-3fef-48cd-925e-163483bc6ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:21.672408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674616e6-3fef-48cd-925e-163483bc6ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:21.672820 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674616e6-3fef-48cd-925e-163483bc6ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:21.673629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674616e6-3fef-48cd-925e-163483bc6ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:21.674962 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674616e6-3fef-48cd-925e-163483bc6ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:21.679823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674616e6-3fef-48cd-925e-163483bc6ec8 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:21.697925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1117/2258] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:21.699019 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674616e6-3fef-48cd-925e-163483bc6ec8 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:21.709439 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674616e6-3fef-48cd-925e-163483bc6ec8 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:21.714132 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c05be-c2ee-4f0f-adba-803dd9a17884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:21.714820 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c05be-c2ee-4f0f-adba-803dd9a17884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:21.715098 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c05be-c2ee-4f0f-adba-803dd9a17884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:21.715371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c05be-c2ee-4f0f-adba-803dd9a17884 admin admin] PATH_INFO: `/v3/projects/c33bb5c34b1349bebf0d174488bec2d6/users/71ae88d86f5c443480038a166a5c50b2/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:21.734593 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c05be-c2ee-4f0f-adba-803dd9a17884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33bb5c34b1349bebf0d174488bec2d6, user_id=71ae88d86f5c443480038a166a5c50b2, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:21.737412 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c05be-c2ee-4f0f-adba-803dd9a17884 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:21.844852 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1118/2259] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:21 2022] PUT /identity/v3/projects/c33bb5c34b1349bebf0d174488bec2d6/users/71ae88d86f5c443480038a166a5c50b2/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:21.845720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c05be-c2ee-4f0f-adba-803dd9a17884 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:21.848193 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-517c05be-c2ee-4f0f-adba-803dd9a17884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:21.872651 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-deb1d2d1-5624-45d3-954b-06c4e2b454d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa831bc73ba7411b8aad7da420a6f98f', 'request_id': 'req-deb1d2d1-5624-45d3-954b-06c4e2b454d9'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:21.882874 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-deb1d2d1-5624-45d3-954b-06c4e2b454d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa831bc73ba7411b8aad7da420a6f98f', 'request_id': 'req-deb1d2d1-5624-45d3-954b-06c4e2b454d9'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:21.941963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c05be-c2ee-4f0f-adba-803dd9a17884 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:21.979635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-deb1d2d1-5624-45d3-954b-06c4e2b454d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa831bc73ba7411b8aad7da420a6f98f', 'request_id': 'req-deb1d2d1-5624-45d3-954b-06c4e2b454d9'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:21.995854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-deb1d2d1-5624-45d3-954b-06c4e2b454d9 admin admin] The token cache is being invalidate because project aa831bc73ba7411b8aad7da420a6f98f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:21.996593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-deb1d2d1-5624-45d3-954b-06c4e2b454d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:21.997437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-deb1d2d1-5624-45d3-954b-06c4e2b454d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:21.999930 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1142/2260] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:21 2022] DELETE /identity/v3/projects/aa831bc73ba7411b8aad7da420a6f98f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:22.004561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcde3dd-a621-4a30-8083-13edb9f50de5 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:22.004846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcde3dd-a621-4a30-8083-13edb9f50de5 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:22.005336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcde3dd-a621-4a30-8083-13edb9f50de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:22.025431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7390d-1059-47ab-9446-cdf06e79199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:22.026352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7390d-1059-47ab-9446-cdf06e79199e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:22.026686 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7390d-1059-47ab-9446-cdf06e79199e admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:22.027060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7390d-1059-47ab-9446-cdf06e79199e admin admin] PATH_INFO: `/v3/projects/242958a625c647238a3e3bbeb7d2500b` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:22.030089 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7390d-1059-47ab-9446-cdf06e79199e admin admin] RBAC: Authorizing `identity:delete_project(project_id=242958a625c647238a3e3bbeb7d2500b)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:22.032340 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7390d-1059-47ab-9446-cdf06e79199e admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:22.035102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-1fcde3dd-a621-4a30-8083-13edb9f50de5 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:22.036927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1fcde3dd-a621-4a30-8083-13edb9f50de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:22.056006 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1143/2261] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:22.071913 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcde3dd-a621-4a30-8083-13edb9f50de5 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:22.071913 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1fcde3dd-a621-4a30-8083-13edb9f50de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:22.075204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcde3dd-a621-4a30-8083-13edb9f50de5 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:22.083848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0bf0a-c5f3-4401-97d9-8ac9251ab21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:22.085331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0bf0a-c5f3-4401-97d9-8ac9251ab21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:22.085747 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0bf0a-c5f3-4401-97d9-8ac9251ab21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:22.086264 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0bf0a-c5f3-4401-97d9-8ac9251ab21b admin admin] PATH_INFO: `/v3/users/a95b9e79f49c48d38b0941d54d445035` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:22.087812 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0bf0a-c5f3-4401-97d9-8ac9251ab21b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a95b9e79f49c48d38b0941d54d445035)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:22.092606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0bf0a-c5f3-4401-97d9-8ac9251ab21b admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:22.220540 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0fd7390d-1059-47ab-9446-cdf06e79199e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '242958a625c647238a3e3bbeb7d2500b', 'request_id': 'req-0fd7390d-1059-47ab-9446-cdf06e79199e'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:22.368669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0fd7390d-1059-47ab-9446-cdf06e79199e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '242958a625c647238a3e3bbeb7d2500b', 'request_id': 'req-0fd7390d-1059-47ab-9446-cdf06e79199e'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:22.376451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0fd7390d-1059-47ab-9446-cdf06e79199e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '242958a625c647238a3e3bbeb7d2500b', 'request_id': 'req-0fd7390d-1059-47ab-9446-cdf06e79199e'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:22.385184 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-96d0bf0a-c5f3-4401-97d9-8ac9251ab21b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a95b9e79f49c48d38b0941d54d445035'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:22.388208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0fd7390d-1059-47ab-9446-cdf06e79199e admin admin] The token cache is being invalidate because project 242958a625c647238a3e3bbeb7d2500b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:22.388861 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0fd7390d-1059-47ab-9446-cdf06e79199e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:22.389979 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0fd7390d-1059-47ab-9446-cdf06e79199e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:22.392439 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1119/2262] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:21 2022] DELETE /identity/v3/projects/242958a625c647238a3e3bbeb7d2500b => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:22.394174 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7390d-1059-47ab-9446-cdf06e79199e admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:22.395982 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0fd7390d-1059-47ab-9446-cdf06e79199e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:22.470708 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7390d-1059-47ab-9446-cdf06e79199e admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:22.475919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edb265-06df-421e-b249-12702fb6b5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:22.476352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edb265-06df-421e-b249-12702fb6b5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:22.476627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edb265-06df-421e-b249-12702fb6b5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:22.476896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edb265-06df-421e-b249-12702fb6b5d4 admin admin] PATH_INFO: `/v3/users/d8d3d8487ab54f9281438d289338f956` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:22.478104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edb265-06df-421e-b249-12702fb6b5d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d3d8487ab54f9281438d289338f956)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:22.480082 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edb265-06df-421e-b249-12702fb6b5d4 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:22.511605 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-96d0bf0a-c5f3-4401-97d9-8ac9251ab21b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a95b9e79f49c48d38b0941d54d445035'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:22.512220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-96d0bf0a-c5f3-4401-97d9-8ac9251ab21b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a95b9e79f49c48d38b0941d54d445035'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:22.512812 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-96d0bf0a-c5f3-4401-97d9-8ac9251ab21b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a95b9e79f49c48d38b0941d54d445035'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:22.520438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-96d0bf0a-c5f3-4401-97d9-8ac9251ab21b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a95b9e79f49c48d38b0941d54d445035'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:22.542286 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1144/2263] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:22 2022] DELETE /identity/v3/users/a95b9e79f49c48d38b0941d54d445035 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:22.542286 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0bf0a-c5f3-4401-97d9-8ac9251ab21b admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:22.549459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-96d0bf0a-c5f3-4401-97d9-8ac9251ab21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:22.611929 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0bf0a-c5f3-4401-97d9-8ac9251ab21b admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:22.615785 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ed0c2-9982-425b-9464-13dd5071958e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:22.616398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ed0c2-9982-425b-9464-13dd5071958e service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:22.616675 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ed0c2-9982-425b-9464-13dd5071958e service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:22.616944 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ed0c2-9982-425b-9464-13dd5071958e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:22.618880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-331ed0c2-9982-425b-9464-13dd5071958e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:22.691975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ed0c2-9982-425b-9464-13dd5071958e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:22.694650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ed0c2-9982-425b-9464-13dd5071958e service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:22.707335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1145/2264] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:22.720538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b111fb-ff32-4a83-a241-20ffe77ee822 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:22.720538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b111fb-ff32-4a83-a241-20ffe77ee822 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:22.720538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b111fb-ff32-4a83-a241-20ffe77ee822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:22.720808 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:DELETE=18,keystone:SELECT=78,keystone:INSERT=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:22.730598 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-95b111fb-ff32-4a83-a241-20ffe77ee822 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:22.731765 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-95b111fb-ff32-4a83-a241-20ffe77ee822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:22.735150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c9edb265-06df-421e-b249-12702fb6b5d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d3d8487ab54f9281438d289338f956'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:22.735443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c9edb265-06df-421e-b249-12702fb6b5d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d3d8487ab54f9281438d289338f956'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:22.748267 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1146/2265] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:22.748267 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71fa79-41dd-47aa-b5bc-7ecbbe8781ab None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:22.748267 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71fa79-41dd-47aa-b5bc-7ecbbe8781ab None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:22.748267 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71fa79-41dd-47aa-b5bc-7ecbbe8781ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:22.749078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c9edb265-06df-421e-b249-12702fb6b5d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d3d8487ab54f9281438d289338f956'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:22.764032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-5f71fa79-41dd-47aa-b5bc-7ecbbe8781ab None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:22.765661 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5f71fa79-41dd-47aa-b5bc-7ecbbe8781ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:22.769673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c9edb265-06df-421e-b249-12702fb6b5d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d3d8487ab54f9281438d289338f956'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:22.770439 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c9edb265-06df-421e-b249-12702fb6b5d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d3d8487ab54f9281438d289338f956'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:22.774020 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1147/2266] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:22.775119 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9ff99-d181-48a5-98f3-20a55ab6018a None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:22.775400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9ff99-d181-48a5-98f3-20a55ab6018a None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:22.775809 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9ff99-d181-48a5-98f3-20a55ab6018a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:22.797934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-cda9ff99-d181-48a5-98f3-20a55ab6018a None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:22.799775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-cda9ff99-d181-48a5-98f3-20a55ab6018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:22.809035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1148/2267] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:22.809986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9ff99-d181-48a5-98f3-20a55ab6018a None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:22.811498 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-cda9ff99-d181-48a5-98f3-20a55ab6018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:22.824730 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9ff99-d181-48a5-98f3-20a55ab6018a None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:22.831285 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80124c0e-1466-4a20-b30c-169b27bf752d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:22.831972 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80124c0e-1466-4a20-b30c-169b27bf752d service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:22.832411 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80124c0e-1466-4a20-b30c-169b27bf752d service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:22.832759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80124c0e-1466-4a20-b30c-169b27bf752d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:22.846559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80124c0e-1466-4a20-b30c-169b27bf752d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:22.848985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80124c0e-1466-4a20-b30c-169b27bf752d service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:22.868191 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1149/2268] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:22.868795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80124c0e-1466-4a20-b30c-169b27bf752d service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:22.879062 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80124c0e-1466-4a20-b30c-169b27bf752d service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:22.895845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1120/2269] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:22 2022] DELETE /identity/v3/users/d8d3d8487ab54f9281438d289338f956 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:22.897621 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2ad74-a7a4-42d8-8b34-12e88e2979f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:22.906378 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2ad74-a7a4-42d8-8b34-12e88e2979f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:22.906378 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2ad74-a7a4-42d8-8b34-12e88e2979f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:22.906378 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2ad74-a7a4-42d8-8b34-12e88e2979f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:22.906378 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2ad74-a7a4-42d8-8b34-12e88e2979f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:52:22.906378 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2ad74-a7a4-42d8-8b34-12e88e2979f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:22.906378 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2ad74-a7a4-42d8-8b34-12e88e2979f7 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:22.921868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1150/2270] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:52:22.928536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edb265-06df-421e-b249-12702fb6b5d4 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:23.027171 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edb265-06df-421e-b249-12702fb6b5d4 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:23.033653 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bbd26-5afd-4379-bfdd-71847638bc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:23.034374 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bbd26-5afd-4379-bfdd-71847638bc40 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:23.034703 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bbd26-5afd-4379-bfdd-71847638bc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:23.038017 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bbd26-5afd-4379-bfdd-71847638bc40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:23.038017 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bbd26-5afd-4379-bfdd-71847638bc40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:23.038017 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bbd26-5afd-4379-bfdd-71847638bc40 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:23.217165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1121/2271] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:22 2022] POST /identity/v3/projects => generated 385 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:52:23.221208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2ad74-a7a4-42d8-8b34-12e88e2979f7 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:23.231635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2ad74-a7a4-42d8-8b34-12e88e2979f7 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:23.324710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfd16b-fd82-4803-a757-610509a31c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:23.325362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd16b-fd82-4803-a757-610509a31c50 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:23.325744 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd16b-fd82-4803-a757-610509a31c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:23.326958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd16b-fd82-4803-a757-610509a31c50 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:23.327826 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfd16b-fd82-4803-a757-610509a31c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:23.330282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfd16b-fd82-4803-a757-610509a31c50 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:23.593829 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bbd26-5afd-4379-bfdd-71847638bc40 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:23.595955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-189bbd26-5afd-4379-bfdd-71847638bc40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:23.601380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1151/2272] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:23 2022] POST /identity/v3/users => generated 293 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:23.605598 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfd16b-fd82-4803-a757-610509a31c50 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:23.615725 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bbd26-5afd-4379-bfdd-71847638bc40 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:23.618564 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfd16b-fd82-4803-a757-610509a31c50 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:23.621042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899632d9-479d-44a7-b06c-71ae7201a534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:23.621688 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899632d9-479d-44a7-b06c-71ae7201a534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:23.621966 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899632d9-479d-44a7-b06c-71ae7201a534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:23.622245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899632d9-479d-44a7-b06c-71ae7201a534 admin admin] PATH_INFO: `/v3/projects/64920e968a4c43ea93f01fb12c9949b8` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:23.624401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899632d9-479d-44a7-b06c-71ae7201a534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64920e968a4c43ea93f01fb12c9949b8)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:23.626271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899632d9-479d-44a7-b06c-71ae7201a534 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:23.660158 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c0fa9-5b87-4080-91b7-38fcceceeec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:23.660757 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c0fa9-5b87-4080-91b7-38fcceceeec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:23.661059 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c0fa9-5b87-4080-91b7-38fcceceeec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:23.661332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c0fa9-5b87-4080-91b7-38fcceceeec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:23.663196 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c0fa9-5b87-4080-91b7-38fcceceeec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:23.664864 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c0fa9-5b87-4080-91b7-38fcceceeec8 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:23.680102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1152/2273] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:52:23.681039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c0fa9-5b87-4080-91b7-38fcceceeec8 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:23.682793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-0f3c0fa9-5b87-4080-91b7-38fcceceeec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:23.703770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c0fa9-5b87-4080-91b7-38fcceceeec8 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:23.708888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a936c6-33d7-4588-9d34-e24aa3f234ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:23.709602 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a936c6-33d7-4588-9d34-e24aa3f234ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:23.709887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a936c6-33d7-4588-9d34-e24aa3f234ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:23.710169 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a936c6-33d7-4588-9d34-e24aa3f234ae admin admin] PATH_INFO: `/v3/projects/8d36db25fffc4f6baa62bff25bcb32a6` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:23.711382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a936c6-33d7-4588-9d34-e24aa3f234ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d36db25fffc4f6baa62bff25bcb32a6)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:23.713381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a936c6-33d7-4588-9d34-e24aa3f234ae admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:23.827433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-899632d9-479d-44a7-b06c-71ae7201a534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64920e968a4c43ea93f01fb12c9949b8', 'request_id': 'req-899632d9-479d-44a7-b06c-71ae7201a534'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:23.871515 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-78a936c6-33d7-4588-9d34-e24aa3f234ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d36db25fffc4f6baa62bff25bcb32a6', 'request_id': 'req-78a936c6-33d7-4588-9d34-e24aa3f234ae'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:23.875963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-78a936c6-33d7-4588-9d34-e24aa3f234ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d36db25fffc4f6baa62bff25bcb32a6', 'request_id': 'req-78a936c6-33d7-4588-9d34-e24aa3f234ae'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:23.969103 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-899632d9-479d-44a7-b06c-71ae7201a534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64920e968a4c43ea93f01fb12c9949b8', 'request_id': 'req-899632d9-479d-44a7-b06c-71ae7201a534'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:23.970635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:23.978765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-899632d9-479d-44a7-b06c-71ae7201a534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64920e968a4c43ea93f01fb12c9949b8', 'request_id': 'req-899632d9-479d-44a7-b06c-71ae7201a534'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:23.994591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-899632d9-479d-44a7-b06c-71ae7201a534 admin admin] The token cache is being invalidate because project 64920e968a4c43ea93f01fb12c9949b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:23.995911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-899632d9-479d-44a7-b06c-71ae7201a534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:23.996764 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-899632d9-479d-44a7-b06c-71ae7201a534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:23.999128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1122/2274] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:23 2022] DELETE /identity/v3/projects/64920e968a4c43ea93f01fb12c9949b8 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:52:24.000389 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899632d9-479d-44a7-b06c-71ae7201a534 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:24.002022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-899632d9-479d-44a7-b06c-71ae7201a534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:24.082125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899632d9-479d-44a7-b06c-71ae7201a534 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:24.108455 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-78a936c6-33d7-4588-9d34-e24aa3f234ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d36db25fffc4f6baa62bff25bcb32a6', 'request_id': 'req-78a936c6-33d7-4588-9d34-e24aa3f234ae'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:24.127098 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-78a936c6-33d7-4588-9d34-e24aa3f234ae admin admin] The token cache is being invalidate because project 8d36db25fffc4f6baa62bff25bcb32a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:24.127616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-78a936c6-33d7-4588-9d34-e24aa3f234ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:24.129234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-78a936c6-33d7-4588-9d34-e24aa3f234ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:24.132287 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1153/2275] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:23 2022] DELETE /identity/v3/projects/8d36db25fffc4f6baa62bff25bcb32a6 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:24.143280 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb33c24-4165-484b-8ba5-9e188d9fbd1e None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:24.143280 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb33c24-4165-484b-8ba5-9e188d9fbd1e None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:24.143280 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb33c24-4165-484b-8ba5-9e188d9fbd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:24.165148 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-cfb33c24-4165-484b-8ba5-9e188d9fbd1e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:24.166352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-cfb33c24-4165-484b-8ba5-9e188d9fbd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:24.186672 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81408f4-2ccf-4f52-8f20-27d1b346f367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:24.189072 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81408f4-2ccf-4f52-8f20-27d1b346f367 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:24.189072 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81408f4-2ccf-4f52-8f20-27d1b346f367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:24.189072 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81408f4-2ccf-4f52-8f20-27d1b346f367 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:24.189892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81408f4-2ccf-4f52-8f20-27d1b346f367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:24.192244 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81408f4-2ccf-4f52-8f20-27d1b346f367 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:24.205448 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1123/2276] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:24.206666 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81408f4-2ccf-4f52-8f20-27d1b346f367 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:24.209528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c81408f4-2ccf-4f52-8f20-27d1b346f367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:24.225266 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81408f4-2ccf-4f52-8f20-27d1b346f367 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:24.237591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a1c45-1900-4ee1-9964-8b3a3e266da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:24.238271 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a1c45-1900-4ee1-9964-8b3a3e266da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:24.238552 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a1c45-1900-4ee1-9964-8b3a3e266da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:24.238829 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a1c45-1900-4ee1-9964-8b3a3e266da6 admin admin] PATH_INFO: `/v3/users/272e45f5aa2e43c1b597306213bbe791` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:24.244450 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a1c45-1900-4ee1-9964-8b3a3e266da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=272e45f5aa2e43c1b597306213bbe791)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:24.247315 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a1c45-1900-4ee1-9964-8b3a3e266da6 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:24.260862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1154/2277] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:24.261835 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb33c24-4165-484b-8ba5-9e188d9fbd1e None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:24.263899 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-cfb33c24-4165-484b-8ba5-9e188d9fbd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:24.282790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb33c24-4165-484b-8ba5-9e188d9fbd1e None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:24.290433 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bfc67-9586-408b-81a9-6f118f0a0d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:24.291464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bfc67-9586-408b-81a9-6f118f0a0d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:24.291790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bfc67-9586-408b-81a9-6f118f0a0d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:24.292117 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bfc67-9586-408b-81a9-6f118f0a0d01 admin admin] PATH_INFO: `/v3/projects/8fa3f5ac811b4dc2bc97c8f65c96ffdb/users/8851c340bc964644bfb950b459637bc9/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:24.312958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805bfc67-9586-408b-81a9-6f118f0a0d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa3f5ac811b4dc2bc97c8f65c96ffdb, user_id=8851c340bc964644bfb950b459637bc9, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:24.315784 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805bfc67-9586-408b-81a9-6f118f0a0d01 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:24.477000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1155/2278] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:24 2022] PUT /identity/v3/projects/8fa3f5ac811b4dc2bc97c8f65c96ffdb/users/8851c340bc964644bfb950b459637bc9/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:24.477000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131f0f3-d434-4770-b47b-fc3d7337689f None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:24.477000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131f0f3-d434-4770-b47b-fc3d7337689f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:24.477000 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131f0f3-d434-4770-b47b-fc3d7337689f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:24.513980 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8131f0f3-d434-4770-b47b-fc3d7337689f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:24.515209 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8131f0f3-d434-4770-b47b-fc3d7337689f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:24.557200 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c50a1c45-1900-4ee1-9964-8b3a3e266da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '272e45f5aa2e43c1b597306213bbe791'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:24.558605 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c50a1c45-1900-4ee1-9964-8b3a3e266da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '272e45f5aa2e43c1b597306213bbe791'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:24.581890 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c50a1c45-1900-4ee1-9964-8b3a3e266da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '272e45f5aa2e43c1b597306213bbe791'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:24.611032 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1156/2279] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:24.612370 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c50a1c45-1900-4ee1-9964-8b3a3e266da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '272e45f5aa2e43c1b597306213bbe791'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:24.613718 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251aad54-6f48-4cc0-9545-27ddbb70d982 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:24.614298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251aad54-6f48-4cc0-9545-27ddbb70d982 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:24.615456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251aad54-6f48-4cc0-9545-27ddbb70d982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:24.615684 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c50a1c45-1900-4ee1-9964-8b3a3e266da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '272e45f5aa2e43c1b597306213bbe791'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:24.698986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-251aad54-6f48-4cc0-9545-27ddbb70d982 None None] MFA Rules not processed for user `8851c340bc964644bfb950b459637bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:24.700261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-251aad54-6f48-4cc0-9545-27ddbb70d982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:24.778124 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1124/2280] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:24 2022] DELETE /identity/v3/users/272e45f5aa2e43c1b597306213bbe791 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:24.779021 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a1c45-1900-4ee1-9964-8b3a3e266da6 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:24.800436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1157/2281] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:24.808054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251aad54-6f48-4cc0-9545-27ddbb70d982 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:24.809492 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-251aad54-6f48-4cc0-9545-27ddbb70d982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:24.826779 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251aad54-6f48-4cc0-9545-27ddbb70d982 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:24.871809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a1c45-1900-4ee1-9964-8b3a3e266da6 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:24.879746 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078240f-9f29-4e54-a14f-b7d6be5249ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:24.884999 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078240f-9f29-4e54-a14f-b7d6be5249ab admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:24.884999 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078240f-9f29-4e54-a14f-b7d6be5249ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:24.884999 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078240f-9f29-4e54-a14f-b7d6be5249ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:24.884999 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078240f-9f29-4e54-a14f-b7d6be5249ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:52:24.884999 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078240f-9f29-4e54-a14f-b7d6be5249ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:24.884999 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078240f-9f29-4e54-a14f-b7d6be5249ab admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:24.905964 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1125/2282] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:52:24.907520 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078240f-9f29-4e54-a14f-b7d6be5249ab admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:24.929505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078240f-9f29-4e54-a14f-b7d6be5249ab admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:24.930421 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31ba82-209c-4a25-bab1-fa5ef44c206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:24.931174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31ba82-209c-4a25-bab1-fa5ef44c206f admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:24.931614 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31ba82-209c-4a25-bab1-fa5ef44c206f admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:24.931962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31ba82-209c-4a25-bab1-fa5ef44c206f admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:24.932670 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31ba82-209c-4a25-bab1-fa5ef44c206f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:24.934739 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31ba82-209c-4a25-bab1-fa5ef44c206f admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:24.934852 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec07fe-96fb-4eff-b6cf-2e818e1941a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:24.936331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec07fe-96fb-4eff-b6cf-2e818e1941a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:24.936694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec07fe-96fb-4eff-b6cf-2e818e1941a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:24.937007 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec07fe-96fb-4eff-b6cf-2e818e1941a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:24.937714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec07fe-96fb-4eff-b6cf-2e818e1941a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:24.939735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec07fe-96fb-4eff-b6cf-2e818e1941a9 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:25.064062 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1126/2283] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:24 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:25.064312 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1158/2284] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:24 2022] POST /identity/v3/projects => generated 385 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:52:25.066863 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec07fe-96fb-4eff-b6cf-2e818e1941a9 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:25.066985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31ba82-209c-4a25-bab1-fa5ef44c206f admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:25.164494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec07fe-96fb-4eff-b6cf-2e818e1941a9 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:25.238920 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f12e5-46d8-4e13-b9b1-466eea2ad91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:25.239583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f12e5-46d8-4e13-b9b1-466eea2ad91d admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:25.239865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f12e5-46d8-4e13-b9b1-466eea2ad91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:25.240133 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f12e5-46d8-4e13-b9b1-466eea2ad91d admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:25.241039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f12e5-46d8-4e13-b9b1-466eea2ad91d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:25.243624 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f12e5-46d8-4e13-b9b1-466eea2ad91d admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:25.263454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31ba82-209c-4a25-bab1-fa5ef44c206f admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:25.271900 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd1486-bdab-4418-97fb-e84a53db325e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:25.272894 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd1486-bdab-4418-97fb-e84a53db325e admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:25.273396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd1486-bdab-4418-97fb-e84a53db325e admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:25.274835 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd1486-bdab-4418-97fb-e84a53db325e admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:25.275875 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd1486-bdab-4418-97fb-e84a53db325e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:25.278027 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd1486-bdab-4418-97fb-e84a53db325e admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:25.510585 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1159/2285] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:25 2022] POST /identity/v3/users => generated 293 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:25.515309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd1486-bdab-4418-97fb-e84a53db325e admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:25.516018 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1127/2286] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:25 2022] POST /identity/v3/users => generated 286 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:25.520207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f12e5-46d8-4e13-b9b1-466eea2ad91d admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:25.529822 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c5dd1486-bdab-4418-97fb-e84a53db325e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:25.539985 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f12e5-46d8-4e13-b9b1-466eea2ad91d admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:25.556839 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c50d8-a357-465d-a852-280add0d666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:25.557929 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd1486-bdab-4418-97fb-e84a53db325e admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:25.559541 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c50d8-a357-465d-a852-280add0d666c admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:25.560756 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c50d8-a357-465d-a852-280add0d666c admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:25.564175 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c50d8-a357-465d-a852-280add0d666c admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:25.565516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c50d8-a357-465d-a852-280add0d666c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:25.571466 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333d156-3e30-4fc7-a4ae-481f8368f217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:25.571809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c50d8-a357-465d-a852-280add0d666c admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:25.571903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333d156-3e30-4fc7-a4ae-481f8368f217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:25.571903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333d156-3e30-4fc7-a4ae-481f8368f217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:25.571903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333d156-3e30-4fc7-a4ae-481f8368f217 admin admin] PATH_INFO: `/v3/projects/01ed6a5a34bb4f93ad88e398c81d89ae` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:25.575656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333d156-3e30-4fc7-a4ae-481f8368f217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ed6a5a34bb4f93ad88e398c81d89ae)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:25.579035 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333d156-3e30-4fc7-a4ae-481f8368f217 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:25.598427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1128/2287] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:25.598427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c50d8-a357-465d-a852-280add0d666c admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:25.614821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c50d8-a357-465d-a852-280add0d666c admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:25.621240 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f6106-59d4-444a-a3f5-d4459e7b65b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:25.622154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f6106-59d4-444a-a3f5-d4459e7b65b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:25.623239 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f6106-59d4-444a-a3f5-d4459e7b65b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:25.623854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f6106-59d4-444a-a3f5-d4459e7b65b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:25.624860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f6106-59d4-444a-a3f5-d4459e7b65b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:25.627404 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f6106-59d4-444a-a3f5-d4459e7b65b5 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:25.647680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1129/2288] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:25.647680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f6106-59d4-444a-a3f5-d4459e7b65b5 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:25.656034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f6106-59d4-444a-a3f5-d4459e7b65b5 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:25.661977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebea646-dd70-4fd7-a837-1356c241d084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:25.662893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebea646-dd70-4fd7-a837-1356c241d084 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:25.663280 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebea646-dd70-4fd7-a837-1356c241d084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:25.663687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebea646-dd70-4fd7-a837-1356c241d084 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:25.664456 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebea646-dd70-4fd7-a837-1356c241d084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:25.666238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebea646-dd70-4fd7-a837-1356c241d084 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:25.684079 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1130/2289] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:25.686188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebea646-dd70-4fd7-a837-1356c241d084 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:25.707720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebea646-dd70-4fd7-a837-1356c241d084 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:25.717814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4888c7f-b5b1-4a05-974b-1a7c4e7cd7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:25.718920 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4888c7f-b5b1-4a05-974b-1a7c4e7cd7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:25.719408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4888c7f-b5b1-4a05-974b-1a7c4e7cd7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:25.719941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4888c7f-b5b1-4a05-974b-1a7c4e7cd7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:25.721412 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4888c7f-b5b1-4a05-974b-1a7c4e7cd7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:25.727168 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4888c7f-b5b1-4a05-974b-1a7c4e7cd7f0 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:25.748026 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1131/2290] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:25.749901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4888c7f-b5b1-4a05-974b-1a7c4e7cd7f0 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:25.769042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4888c7f-b5b1-4a05-974b-1a7c4e7cd7f0 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:25.782507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0271d-dd5e-4a65-be81-7b6982849ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:25.783719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0271d-dd5e-4a65-be81-7b6982849ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:25.784049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0271d-dd5e-4a65-be81-7b6982849ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:25.784602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0271d-dd5e-4a65-be81-7b6982849ebb admin admin] PATH_INFO: `/v3/projects/a061acf0126346b1aa6b6b48ee1e2004/users/2e0bd62012ca444a866dad545af24524/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:25.811506 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0271d-dd5e-4a65-be81-7b6982849ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a061acf0126346b1aa6b6b48ee1e2004, user_id=2e0bd62012ca444a866dad545af24524, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:25.817206 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0271d-dd5e-4a65-be81-7b6982849ebb admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:25.825588 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:DELETE=19,keystone:SELECT=80,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:25.836107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9333d156-3e30-4fc7-a4ae-481f8368f217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ed6a5a34bb4f93ad88e398c81d89ae', 'request_id': 'req-9333d156-3e30-4fc7-a4ae-481f8368f217'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:25.851110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9333d156-3e30-4fc7-a4ae-481f8368f217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ed6a5a34bb4f93ad88e398c81d89ae', 'request_id': 'req-9333d156-3e30-4fc7-a4ae-481f8368f217'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:25.947451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1132/2291] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:25 2022] PUT /identity/v3/projects/a061acf0126346b1aa6b6b48ee1e2004/users/2e0bd62012ca444a866dad545af24524/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:25.947451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0271d-dd5e-4a65-be81-7b6982849ebb admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:25.975044 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9333d156-3e30-4fc7-a4ae-481f8368f217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ed6a5a34bb4f93ad88e398c81d89ae', 'request_id': 'req-9333d156-3e30-4fc7-a4ae-481f8368f217'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:25.995861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9333d156-3e30-4fc7-a4ae-481f8368f217 admin admin] The token cache is being invalidate because project 01ed6a5a34bb4f93ad88e398c81d89ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:25.996155 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9333d156-3e30-4fc7-a4ae-481f8368f217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:25.996853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9333d156-3e30-4fc7-a4ae-481f8368f217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:26.002030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1160/2292] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:25 2022] DELETE /identity/v3/projects/01ed6a5a34bb4f93ad88e398c81d89ae => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:26.004483 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57937e-990e-4cc8-8fb8-20dcfd258617 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:26.004667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57937e-990e-4cc8-8fb8-20dcfd258617 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:26.004919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57937e-990e-4cc8-8fb8-20dcfd258617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:26.027941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-2a57937e-990e-4cc8-8fb8-20dcfd258617 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:26.029696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2a57937e-990e-4cc8-8fb8-20dcfd258617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:26.054098 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0271d-dd5e-4a65-be81-7b6982849ebb admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:26.059158 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14e23d-1311-4d48-b5c7-6c31635b48a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:26.059853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14e23d-1311-4d48-b5c7-6c31635b48a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:26.061092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14e23d-1311-4d48-b5c7-6c31635b48a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:26.061447 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14e23d-1311-4d48-b5c7-6c31635b48a5 admin admin] PATH_INFO: `/v3/projects/f17d596e7fb346a0bde91735f3bb4111/users/3e413c3feb0e46f58d0b5040a0e98bc4/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:26.080632 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14e23d-1311-4d48-b5c7-6c31635b48a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17d596e7fb346a0bde91735f3bb4111, user_id=3e413c3feb0e46f58d0b5040a0e98bc4, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:26.083920 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14e23d-1311-4d48-b5c7-6c31635b48a5 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:26.155437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1161/2293] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:26.159768 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81884de9-f15f-40d6-88d0-e192f51a0cca None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:26.160231 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81884de9-f15f-40d6-88d0-e192f51a0cca None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:26.160426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81884de9-f15f-40d6-88d0-e192f51a0cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:26.185979 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-81884de9-f15f-40d6-88d0-e192f51a0cca None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:26.187543 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-81884de9-f15f-40d6-88d0-e192f51a0cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:26.196680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1162/2294] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:26.197738 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81884de9-f15f-40d6-88d0-e192f51a0cca None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:26.206821 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-81884de9-f15f-40d6-88d0-e192f51a0cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:26.220295 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1133/2295] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:25 2022] PUT /identity/v3/projects/f17d596e7fb346a0bde91735f3bb4111/users/3e413c3feb0e46f58d0b5040a0e98bc4/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:26.222794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b85b7-00c2-47e2-ba19-3e3aeeabc2e7 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:26.223363 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b85b7-00c2-47e2-ba19-3e3aeeabc2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:26.223704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b85b7-00c2-47e2-ba19-3e3aeeabc2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:26.265470 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-f52b85b7-00c2-47e2-ba19-3e3aeeabc2e7 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:26.267010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f52b85b7-00c2-47e2-ba19-3e3aeeabc2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:26.280128 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81884de9-f15f-40d6-88d0-e192f51a0cca None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:26.342565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2ea74-da5b-447b-9b25-17f3ec4904ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:26.343503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2ea74-da5b-447b-9b25-17f3ec4904ec service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:26.343975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2ea74-da5b-447b-9b25-17f3ec4904ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:26.344704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2ea74-da5b-447b-9b25-17f3ec4904ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:26.406281 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1134/2296] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:26.409367 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a93711-b28c-4500-8191-8a0f185c9ddb None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:26.410359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a93711-b28c-4500-8191-8a0f185c9ddb None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:26.411046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a93711-b28c-4500-8191-8a0f185c9ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:26.461533 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2ea74-da5b-447b-9b25-17f3ec4904ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:26.465883 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2ea74-da5b-447b-9b25-17f3ec4904ec service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:26.475809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-d4a93711-b28c-4500-8191-8a0f185c9ddb None None] MFA Rules not processed for user `3e413c3feb0e46f58d0b5040a0e98bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:26.477904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d4a93711-b28c-4500-8191-8a0f185c9ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:26.485452 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1163/2297] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:26.487325 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2ea74-da5b-447b-9b25-17f3ec4904ec service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:26.501782 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2ea74-da5b-447b-9b25-17f3ec4904ec service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:26.511094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516bc6f-56ff-4c84-a7a8-8aa1f0bafd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:26.512141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516bc6f-56ff-4c84-a7a8-8aa1f0bafd0f admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:26.512426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516bc6f-56ff-4c84-a7a8-8aa1f0bafd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:26.512696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516bc6f-56ff-4c84-a7a8-8aa1f0bafd0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:26.518115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516bc6f-56ff-4c84-a7a8-8aa1f0bafd0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:52:26.518115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516bc6f-56ff-4c84-a7a8-8aa1f0bafd0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:26.518438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516bc6f-56ff-4c84-a7a8-8aa1f0bafd0f admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:26.539247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1164/2298] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:52:26.543845 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516bc6f-56ff-4c84-a7a8-8aa1f0bafd0f admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:26.571725 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516bc6f-56ff-4c84-a7a8-8aa1f0bafd0f admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:26.585486 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a3f36-b9ac-484f-be22-038781945c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:26.588723 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a3f36-b9ac-484f-be22-038781945c97 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:26.590445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a3f36-b9ac-484f-be22-038781945c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:26.590972 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a3f36-b9ac-484f-be22-038781945c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:26.592472 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a3f36-b9ac-484f-be22-038781945c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:26.594720 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a3f36-b9ac-484f-be22-038781945c97 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:26.638830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1135/2299] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:26.647425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a93711-b28c-4500-8191-8a0f185c9ddb None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:26.668495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d4a93711-b28c-4500-8191-8a0f185c9ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:26.688540 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a93711-b28c-4500-8191-8a0f185c9ddb None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:26.695080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df8c1b-10f7-4ec0-9d03-bbfbead7bb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:26.696976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df8c1b-10f7-4ec0-9d03-bbfbead7bb02 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:26.696976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df8c1b-10f7-4ec0-9d03-bbfbead7bb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:26.696976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df8c1b-10f7-4ec0-9d03-bbfbead7bb02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:26.697463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df8c1b-10f7-4ec0-9d03-bbfbead7bb02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:26.700441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df8c1b-10f7-4ec0-9d03-bbfbead7bb02 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:26.775092 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1165/2300] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:26 2022] POST /identity/v3/projects => generated 377 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:52:26.776093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a3f36-b9ac-484f-be22-038781945c97 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:26.905394 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1136/2301] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:26 2022] POST /identity/v3/projects => generated 385 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:26.907285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df8c1b-10f7-4ec0-9d03-bbfbead7bb02 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:26.917877 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:27.006746 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a3f36-b9ac-484f-be22-038781945c97 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:27.089429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df8c1b-10f7-4ec0-9d03-bbfbead7bb02 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:27.098756 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56d862-a83c-4f88-8e4f-248d9efd46ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:27.099782 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56d862-a83c-4f88-8e4f-248d9efd46ca admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:27.100379 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56d862-a83c-4f88-8e4f-248d9efd46ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:27.100691 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56d862-a83c-4f88-8e4f-248d9efd46ca admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:27.101357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56d862-a83c-4f88-8e4f-248d9efd46ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:27.103742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56d862-a83c-4f88-8e4f-248d9efd46ca admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:27.144098 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29366421-c6b5-4e99-a66b-2004b97e15fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:27.145291 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29366421-c6b5-4e99-a66b-2004b97e15fa admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:27.146052 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29366421-c6b5-4e99-a66b-2004b97e15fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:27.146052 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29366421-c6b5-4e99-a66b-2004b97e15fa admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:27.146730 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29366421-c6b5-4e99-a66b-2004b97e15fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:27.149988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29366421-c6b5-4e99-a66b-2004b97e15fa admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:27.270129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1137/2302] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:26 2022] POST /identity/v3/users => generated 299 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:27.273819 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56d862-a83c-4f88-8e4f-248d9efd46ca admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:27.295028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56d862-a83c-4f88-8e4f-248d9efd46ca admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:27.301041 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735b9d8-ae67-4a4d-962a-5c45702e748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:27.302186 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735b9d8-ae67-4a4d-962a-5c45702e748b admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:27.302843 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735b9d8-ae67-4a4d-962a-5c45702e748b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:27.303721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735b9d8-ae67-4a4d-962a-5c45702e748b admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:27.304983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735b9d8-ae67-4a4d-962a-5c45702e748b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:27.307653 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735b9d8-ae67-4a4d-962a-5c45702e748b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:27.322550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1138/2303] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:27.327058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735b9d8-ae67-4a4d-962a-5c45702e748b admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:27.339533 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735b9d8-ae67-4a4d-962a-5c45702e748b admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:27.345591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b610f2-5e23-4e89-900e-c79e02a5790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:27.346421 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b610f2-5e23-4e89-900e-c79e02a5790f admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:27.346782 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b610f2-5e23-4e89-900e-c79e02a5790f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:27.347212 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b610f2-5e23-4e89-900e-c79e02a5790f admin admin] PATH_INFO: `/v3/projects/5cf45fafc9cd4cf79319b15b3acd2a7c/users/acb9ae162fec4e7383a83c27efac8f2d/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:27.364257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b610f2-5e23-4e89-900e-c79e02a5790f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf45fafc9cd4cf79319b15b3acd2a7c, user_id=acb9ae162fec4e7383a83c27efac8f2d, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:27.366940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b610f2-5e23-4e89-900e-c79e02a5790f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:27.376401 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1166/2304] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:26 2022] POST /identity/v3/users => generated 289 bytes in 601 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:27.380883 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29366421-c6b5-4e99-a66b-2004b97e15fa admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:27.392504 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29366421-c6b5-4e99-a66b-2004b97e15fa admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:27.397803 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12741ab2-f9a4-4537-ab21-c224229c1c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:27.398451 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12741ab2-f9a4-4537-ab21-c224229c1c2b admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:27.398745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12741ab2-f9a4-4537-ab21-c224229c1c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:27.399047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12741ab2-f9a4-4537-ab21-c224229c1c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:27.399769 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12741ab2-f9a4-4537-ab21-c224229c1c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:27.401535 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12741ab2-f9a4-4537-ab21-c224229c1c2b admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:27.414045 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1167/2305] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:52:27.418559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12741ab2-f9a4-4537-ab21-c224229c1c2b admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:27.436624 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12741ab2-f9a4-4537-ab21-c224229c1c2b admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:27.441601 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208568d-4a0c-478a-8c15-88bc3cfbad37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:27.442220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208568d-4a0c-478a-8c15-88bc3cfbad37 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:27.442508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208568d-4a0c-478a-8c15-88bc3cfbad37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:27.442782 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208568d-4a0c-478a-8c15-88bc3cfbad37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:27.443456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208568d-4a0c-478a-8c15-88bc3cfbad37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:27.445096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208568d-4a0c-478a-8c15-88bc3cfbad37 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:27.457881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1168/2306] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:52:27.465338 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208568d-4a0c-478a-8c15-88bc3cfbad37 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:27.478489 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208568d-4a0c-478a-8c15-88bc3cfbad37 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:27.485699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654e59d-7e91-4c6e-9849-069397f2d378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:27.486428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654e59d-7e91-4c6e-9849-069397f2d378 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:27.486804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654e59d-7e91-4c6e-9849-069397f2d378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:27.487142 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654e59d-7e91-4c6e-9849-069397f2d378 admin admin] PATH_INFO: `/v3/projects/6099f484f33b4e75ae81980c2fd2714f/users/80ff6141d0004dea90a2d67bda426a2c/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:27.525945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654e59d-7e91-4c6e-9849-069397f2d378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6099f484f33b4e75ae81980c2fd2714f, user_id=80ff6141d0004dea90a2d67bda426a2c, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:27.529542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654e59d-7e91-4c6e-9849-069397f2d378 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:27.556503 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1139/2307] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:27 2022] PUT /identity/v3/projects/5cf45fafc9cd4cf79319b15b3acd2a7c/users/acb9ae162fec4e7383a83c27efac8f2d/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:27.560704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b610f2-5e23-4e89-900e-c79e02a5790f admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:27.661078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b610f2-5e23-4e89-900e-c79e02a5790f admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:27.667092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38603dd8-bb95-41c5-86f3-620a9df63c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:27.667877 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38603dd8-bb95-41c5-86f3-620a9df63c2c admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:27.668155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38603dd8-bb95-41c5-86f3-620a9df63c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:27.668429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38603dd8-bb95-41c5-86f3-620a9df63c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:27.669270 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38603dd8-bb95-41c5-86f3-620a9df63c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:27.672022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38603dd8-bb95-41c5-86f3-620a9df63c2c admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:27.682750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1169/2308] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:27 2022] PUT /identity/v3/projects/6099f484f33b4e75ae81980c2fd2714f/users/80ff6141d0004dea90a2d67bda426a2c/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:27.699787 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496044d-bfc7-457f-ac5e-fbbeda66bb86 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:27.699787 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496044d-bfc7-457f-ac5e-fbbeda66bb86 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:27.700347 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496044d-bfc7-457f-ac5e-fbbeda66bb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:27.700849 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1140/2309] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:27.702445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38603dd8-bb95-41c5-86f3-620a9df63c2c admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:27.717773 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38603dd8-bb95-41c5-86f3-620a9df63c2c admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:27.791968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-1496044d-bfc7-457f-ac5e-fbbeda66bb86 None None] MFA Rules not processed for user `80ff6141d0004dea90a2d67bda426a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:27.794051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1496044d-bfc7-457f-ac5e-fbbeda66bb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:27.828621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e35a30-99ab-437e-91fb-236585149dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:27.829578 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e35a30-99ab-437e-91fb-236585149dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:27.829870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e35a30-99ab-437e-91fb-236585149dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:27.830176 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e35a30-99ab-437e-91fb-236585149dbe admin admin] PATH_INFO: `/v3/projects/5cf45fafc9cd4cf79319b15b3acd2a7c/users/acb9ae162fec4e7383a83c27efac8f2d/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:27.832433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e35a30-99ab-437e-91fb-236585149dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf45fafc9cd4cf79319b15b3acd2a7c, user_id=acb9ae162fec4e7383a83c27efac8f2d, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:27.840103 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e35a30-99ab-437e-91fb-236585149dbe admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:27.885754 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1141/2310] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:27 2022] PUT /identity/v3/projects/5cf45fafc9cd4cf79319b15b3acd2a7c/users/acb9ae162fec4e7383a83c27efac8f2d/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:27.896994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d59e30-0280-44b5-9339-aba272df7b31 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:27.897283 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d59e30-0280-44b5-9339-aba272df7b31 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:27.897560 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d59e30-0280-44b5-9339-aba272df7b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:27.910103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1170/2311] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:52:27.920929 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496044d-bfc7-457f-ac5e-fbbeda66bb86 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:27.923324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1496044d-bfc7-457f-ac5e-fbbeda66bb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:27.962451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-99d59e30-0280-44b5-9339-aba272df7b31 None None] MFA Rules not processed for user `acb9ae162fec4e7383a83c27efac8f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:27.963738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-99d59e30-0280-44b5-9339-aba272df7b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:28.075805 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496044d-bfc7-457f-ac5e-fbbeda66bb86 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:28.096943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1142/2312] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:52:28.117213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d59e30-0280-44b5-9339-aba272df7b31 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:28.120893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-99d59e30-0280-44b5-9339-aba272df7b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:28.152540 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984312f2-6dc4-4f19-b06a-a6cf9bb31978 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52705fc64cd54b1985ef2cb02f6c47fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:28.154285 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984312f2-6dc4-4f19-b06a-a6cf9bb31978 service glance] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:28.154616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984312f2-6dc4-4f19-b06a-a6cf9bb31978 service glance] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:28.154901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984312f2-6dc4-4f19-b06a-a6cf9bb31978 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:28.254574 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d59e30-0280-44b5-9339-aba272df7b31 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:28.260226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da7e9b-2e5c-4085-ae9f-f991ad74450e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:28.260955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da7e9b-2e5c-4085-ae9f-f991ad74450e service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:28.261286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da7e9b-2e5c-4085-ae9f-f991ad74450e service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:28.261566 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da7e9b-2e5c-4085-ae9f-f991ad74450e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:28.264990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-53da7e9b-2e5c-4085-ae9f-f991ad74450e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:28.292690 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984312f2-6dc4-4f19-b06a-a6cf9bb31978 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:28.297697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984312f2-6dc4-4f19-b06a-a6cf9bb31978 service glance] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:28.335829 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1171/2313] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:28.462289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da7e9b-2e5c-4085-ae9f-f991ad74450e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:28.466923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da7e9b-2e5c-4085-ae9f-f991ad74450e service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:28.482836 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1143/2314] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:28.852213 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9109a-6ef5-48e3-9d34-7d31bfc4c6bc None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:28.852877 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9109a-6ef5-48e3-9d34-7d31bfc4c6bc None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:28.852877 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9109a-6ef5-48e3-9d34-7d31bfc4c6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:28.925929 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-3da9109a-6ef5-48e3-9d34-7d31bfc4c6bc None None] MFA Rules not processed for user `2e0bd62012ca444a866dad545af24524`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:28.927384 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3da9109a-6ef5-48e3-9d34-7d31bfc4c6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:29.111083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1172/2315] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:29.116203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da7e9b-2e5c-4085-ae9f-f991ad74450e service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:29.118042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-53da7e9b-2e5c-4085-ae9f-f991ad74450e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:29.346083 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da7e9b-2e5c-4085-ae9f-f991ad74450e service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:29.346083 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024d0b2-2388-4637-bbb9-870644916fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:29.346083 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024d0b2-2388-4637-bbb9-870644916fab admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:29.346083 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024d0b2-2388-4637-bbb9-870644916fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:29.346426 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024d0b2-2388-4637-bbb9-870644916fab admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:29.346426 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024d0b2-2388-4637-bbb9-870644916fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:29.346426 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024d0b2-2388-4637-bbb9-870644916fab admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:29.471633 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:29.480804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1144/2316] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:29 2022] POST /identity/v3/projects => generated 371 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:52:29.486938 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9109a-6ef5-48e3-9d34-7d31bfc4c6bc None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:29.501960 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9109a-6ef5-48e3-9d34-7d31bfc4c6bc None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:29.614491 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2b10c-1bdc-426e-8a43-43b4228a5602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:29.618742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2b10c-1bdc-426e-8a43-43b4228a5602 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:29.618742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2b10c-1bdc-426e-8a43-43b4228a5602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:29.618742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2b10c-1bdc-426e-8a43-43b4228a5602 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:29.618742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2b10c-1bdc-426e-8a43-43b4228a5602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:29.618742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2b10c-1bdc-426e-8a43-43b4228a5602 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:29.627004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:29.733323 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1173/2317] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:29 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:29.734156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024d0b2-2388-4637-bbb9-870644916fab admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:29.751150 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024d0b2-2388-4637-bbb9-870644916fab admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:29.756943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aeff1e-8491-4711-a99a-d2ee0229356f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:29.757567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aeff1e-8491-4711-a99a-d2ee0229356f admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:29.757846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aeff1e-8491-4711-a99a-d2ee0229356f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:29.758115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aeff1e-8491-4711-a99a-d2ee0229356f admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:29.759125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aeff1e-8491-4711-a99a-d2ee0229356f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:29.760964 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aeff1e-8491-4711-a99a-d2ee0229356f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:29.801176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2b10c-1bdc-426e-8a43-43b4228a5602 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:29.801539 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1145/2318] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:29.828608 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2b10c-1bdc-426e-8a43-43b4228a5602 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:29.835237 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e25e57-2b4f-4b4a-b023-a3a270766f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:29.836419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e25e57-2b4f-4b4a-b023-a3a270766f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:29.837475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e25e57-2b4f-4b4a-b023-a3a270766f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:29.838502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e25e57-2b4f-4b4a-b023-a3a270766f45 admin admin] PATH_INFO: `/v3/projects/cd8c68b133a643e895d46b302da3a163/users/2a9f8d1e8d9c4a09bd1f282c670be646/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:29.893411 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e25e57-2b4f-4b4a-b023-a3a270766f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8c68b133a643e895d46b302da3a163, user_id=2a9f8d1e8d9c4a09bd1f282c670be646, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:29.896445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e25e57-2b4f-4b4a-b023-a3a270766f45 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:30.134221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1174/2319] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:29 2022] PUT /identity/v3/projects/cd8c68b133a643e895d46b302da3a163/users/2a9f8d1e8d9c4a09bd1f282c670be646/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:30.143214 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aeff1e-8491-4711-a99a-d2ee0229356f admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:30.152530 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aeff1e-8491-4711-a99a-d2ee0229356f admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:30.223822 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f403559-081c-4129-8a69-2870a05fb69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:30.224444 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f403559-081c-4129-8a69-2870a05fb69a admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:30.224892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f403559-081c-4129-8a69-2870a05fb69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:30.225317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f403559-081c-4129-8a69-2870a05fb69a admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:30.226145 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f403559-081c-4129-8a69-2870a05fb69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:30.228218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f403559-081c-4129-8a69-2870a05fb69a admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:30.243058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1146/2320] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:30.249258 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e25e57-2b4f-4b4a-b023-a3a270766f45 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:30.261461 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e25e57-2b4f-4b4a-b023-a3a270766f45 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:30.269790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613f6fa-4995-4ede-9072-d631fefbd2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:30.270899 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613f6fa-4995-4ede-9072-d631fefbd2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:30.271430 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613f6fa-4995-4ede-9072-d631fefbd2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:30.271972 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613f6fa-4995-4ede-9072-d631fefbd2a6 admin admin] PATH_INFO: `/v3/projects/cd8c68b133a643e895d46b302da3a163/users/2a9f8d1e8d9c4a09bd1f282c670be646/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:30.275310 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613f6fa-4995-4ede-9072-d631fefbd2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8c68b133a643e895d46b302da3a163, user_id=2a9f8d1e8d9c4a09bd1f282c670be646, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:30.279525 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613f6fa-4995-4ede-9072-d631fefbd2a6 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:30.294687 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1175/2321] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:30 2022] PUT /identity/v3/projects/cd8c68b133a643e895d46b302da3a163/users/2a9f8d1e8d9c4a09bd1f282c670be646/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:31.442904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3a3de-59a1-497a-b60e-00538274c2f8 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:31.442904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3a3de-59a1-497a-b60e-00538274c2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:31.443428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3a3de-59a1-497a-b60e-00538274c2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:31.502443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613f6fa-4995-4ede-9072-d631fefbd2a6 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:31.510221 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-56b3a3de-59a1-497a-b60e-00538274c2f8 None None] MFA Rules not processed for user `7a3f8b78523e4c3790b049fc783c96fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:31.511815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-56b3a3de-59a1-497a-b60e-00538274c2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:31.649829 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613f6fa-4995-4ede-9072-d631fefbd2a6 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:31.655404 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab942f8-9d4a-4573-a124-e596afb4328e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:31.656122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab942f8-9d4a-4573-a124-e596afb4328e service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:31.656457 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab942f8-9d4a-4573-a124-e596afb4328e service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:31.656738 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab942f8-9d4a-4573-a124-e596afb4328e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:31.675887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1147/2322] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:31.802488 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab942f8-9d4a-4573-a124-e596afb4328e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:31.807537 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab942f8-9d4a-4573-a124-e596afb4328e service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:31.831956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1176/2323] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:32.161519 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:32.532105 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ca3cc-5f2b-4ce1-b08b-d8d000e69468 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:32.532607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ca3cc-5f2b-4ce1-b08b-d8d000e69468 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:32.533539 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ca3cc-5f2b-4ce1-b08b-d8d000e69468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:32.605105 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-a74ca3cc-5f2b-4ce1-b08b-d8d000e69468 None None] MFA Rules not processed for user `2a9f8d1e8d9c4a09bd1f282c670be646`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:32.607449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a74ca3cc-5f2b-4ce1-b08b-d8d000e69468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:32.725864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1148/2324] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:32.726094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2776e2-bf86-463b-9144-e49f67651d4c None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:32.726563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2776e2-bf86-463b-9144-e49f67651d4c None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:32.726655 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2776e2-bf86-463b-9144-e49f67651d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:32.757218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-7e2776e2-bf86-463b-9144-e49f67651d4c None None] MFA Rules not processed for user `2e0bd62012ca444a866dad545af24524`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:32.965491 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7e2776e2-bf86-463b-9144-e49f67651d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:32.965491 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1177/2325] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:32.966926 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ca3cc-5f2b-4ce1-b08b-d8d000e69468 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:32.966926 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a74ca3cc-5f2b-4ce1-b08b-d8d000e69468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:33.141549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ca3cc-5f2b-4ce1-b08b-d8d000e69468 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:33.156277 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca8506-6a23-42cf-8a28-a4dd4e0f54e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:33.157561 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca8506-6a23-42cf-8a28-a4dd4e0f54e2 service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:33.158196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca8506-6a23-42cf-8a28-a4dd4e0f54e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:33.163833 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca8506-6a23-42cf-8a28-a4dd4e0f54e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:33.194044 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca8506-6a23-42cf-8a28-a4dd4e0f54e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:33.196286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca8506-6a23-42cf-8a28-a4dd4e0f54e2 service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:33.212697 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1149/2326] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:33.351971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210fe2a-a17b-4f10-8032-3be7ba2fd1ac None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:33.352197 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210fe2a-a17b-4f10-8032-3be7ba2fd1ac None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:33.352476 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210fe2a-a17b-4f10-8032-3be7ba2fd1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:33.456928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-5210fe2a-a17b-4f10-8032-3be7ba2fd1ac None None] MFA Rules not processed for user `71ae88d86f5c443480038a166a5c50b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:33.458665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5210fe2a-a17b-4f10-8032-3be7ba2fd1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:33.658329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1178/2327] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:33.659255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca8506-6a23-42cf-8a28-a4dd4e0f54e2 service nova] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:33.661948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-85ca8506-6a23-42cf-8a28-a4dd4e0f54e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:33.727757 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:33.818387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca8506-6a23-42cf-8a28-a4dd4e0f54e2 service nova] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:33.823545 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d8acd-31da-4242-a4e2-ca99eb97599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:33.824589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d8acd-31da-4242-a4e2-ca99eb97599e admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:33.824855 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d8acd-31da-4242-a4e2-ca99eb97599e admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:33.825291 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d8acd-31da-4242-a4e2-ca99eb97599e admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:33.826095 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d8acd-31da-4242-a4e2-ca99eb97599e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:33.828504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d8acd-31da-4242-a4e2-ca99eb97599e admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:33.948480 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1150/2328] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:33 2022] POST /identity/v3/projects => generated 385 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:33.952467 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210fe2a-a17b-4f10-8032-3be7ba2fd1ac None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:33.972654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210fe2a-a17b-4f10-8032-3be7ba2fd1ac None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:34.088931 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97787c9-7ff7-457d-a6e6-aaf261d669f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:34.094620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97787c9-7ff7-457d-a6e6-aaf261d669f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:34.104335 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97787c9-7ff7-457d-a6e6-aaf261d669f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:34.104721 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97787c9-7ff7-457d-a6e6-aaf261d669f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:34.105505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97787c9-7ff7-457d-a6e6-aaf261d669f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:34.111139 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97787c9-7ff7-457d-a6e6-aaf261d669f0 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:34.261796 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1179/2329] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:33 2022] POST /identity/v3/users => generated 299 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:52:34.266143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d8acd-31da-4242-a4e2-ca99eb97599e admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:34.281495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d8acd-31da-4242-a4e2-ca99eb97599e admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:34.304391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1839f4-e9b2-407d-b284-7540dc2cd912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:34.304801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1839f4-e9b2-407d-b284-7540dc2cd912 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:34.305081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1839f4-e9b2-407d-b284-7540dc2cd912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:34.305633 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1839f4-e9b2-407d-b284-7540dc2cd912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:34.306468 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1839f4-e9b2-407d-b284-7540dc2cd912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:34.310679 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1839f4-e9b2-407d-b284-7540dc2cd912 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:34.351810 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1151/2330] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:34.353434 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97787c9-7ff7-457d-a6e6-aaf261d669f0 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:34.369655 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97787c9-7ff7-457d-a6e6-aaf261d669f0 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:34.378794 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7deef9-ee8c-49d2-9c75-163683e38cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:34.379825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7deef9-ee8c-49d2-9c75-163683e38cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:34.380165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7deef9-ee8c-49d2-9c75-163683e38cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:34.380510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7deef9-ee8c-49d2-9c75-163683e38cd6 admin admin] PATH_INFO: `/v3/projects/2bef6e07d5a44783bfd8b1144b3fa6eb/users/89fabc9685ba44eda83e3470fdd3a2c2/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:34.414468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7deef9-ee8c-49d2-9c75-163683e38cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bef6e07d5a44783bfd8b1144b3fa6eb, user_id=89fabc9685ba44eda83e3470fdd3a2c2, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:34.414468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7deef9-ee8c-49d2-9c75-163683e38cd6 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:34.491340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1180/2331] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:34 2022] PUT /identity/v3/projects/2bef6e07d5a44783bfd8b1144b3fa6eb/users/89fabc9685ba44eda83e3470fdd3a2c2/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:34.494952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1839f4-e9b2-407d-b284-7540dc2cd912 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:34.510515 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1839f4-e9b2-407d-b284-7540dc2cd912 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:34.540133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7deef9-ee8c-49d2-9c75-163683e38cd6 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:34.601328 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e30880-fb81-4581-9c54-53d3f876a7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:34.602563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e30880-fb81-4581-9c54-53d3f876a7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:34.602903 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e30880-fb81-4581-9c54-53d3f876a7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:34.603185 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e30880-fb81-4581-9c54-53d3f876a7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:34.604306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e30880-fb81-4581-9c54-53d3f876a7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:34.611809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e30880-fb81-4581-9c54-53d3f876a7c3 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:34.622934 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1152/2332] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:34.627202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e30880-fb81-4581-9c54-53d3f876a7c3 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:34.631848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7deef9-ee8c-49d2-9c75-163683e38cd6 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:34.636467 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487a596-b9fd-4a78-9c7b-24f9d079ec74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:34.637088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487a596-b9fd-4a78-9c7b-24f9d079ec74 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:34.637362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487a596-b9fd-4a78-9c7b-24f9d079ec74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:34.637632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487a596-b9fd-4a78-9c7b-24f9d079ec74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:34.637773 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e30880-fb81-4581-9c54-53d3f876a7c3 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:34.643702 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c77ec5-48e6-4bd3-9b24-2cacfd0c0dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:34.644667 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c77ec5-48e6-4bd3-9b24-2cacfd0c0dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:34.644945 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c77ec5-48e6-4bd3-9b24-2cacfd0c0dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:34.645224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c77ec5-48e6-4bd3-9b24-2cacfd0c0dc6 admin admin] PATH_INFO: `/v3/projects/2bef6e07d5a44783bfd8b1144b3fa6eb/users/89fabc9685ba44eda83e3470fdd3a2c2/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:34.647273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c77ec5-48e6-4bd3-9b24-2cacfd0c0dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bef6e07d5a44783bfd8b1144b3fa6eb, user_id=89fabc9685ba44eda83e3470fdd3a2c2, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:34.650224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c77ec5-48e6-4bd3-9b24-2cacfd0c0dc6 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:34.672827 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1153/2333] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:34 2022] PUT /identity/v3/projects/2bef6e07d5a44783bfd8b1144b3fa6eb/users/89fabc9685ba44eda83e3470fdd3a2c2/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:52:34.712396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487a596-b9fd-4a78-9c7b-24f9d079ec74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:34.713864 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487a596-b9fd-4a78-9c7b-24f9d079ec74 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:34.724640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1181/2334] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:35.249770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:35.518363 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143249f8-16e0-4ea5-9dd6-5ea1e1011d2a None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:35.519162 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143249f8-16e0-4ea5-9dd6-5ea1e1011d2a None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:35.519442 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143249f8-16e0-4ea5-9dd6-5ea1e1011d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:35.543864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-143249f8-16e0-4ea5-9dd6-5ea1e1011d2a None None] MFA Rules not processed for user `7dc367b3f3e04ec48665feef4094715a`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:35.545622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-143249f8-16e0-4ea5-9dd6-5ea1e1011d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:35.632151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1154/2335] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:36.106212 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:38.475663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:39.180655 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:40.334709 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:40.908621 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487a596-b9fd-4a78-9c7b-24f9d079ec74 service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:40.935382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487a596-b9fd-4a78-9c7b-24f9d079ec74 service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:41.061904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383d068-e3f6-4799-aa5d-90808df584d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:41.062910 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383d068-e3f6-4799-aa5d-90808df584d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:41.063367 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383d068-e3f6-4799-aa5d-90808df584d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:41.064245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383d068-e3f6-4799-aa5d-90808df584d9 admin admin] PATH_INFO: `/v3/users/8851c340bc964644bfb950b459637bc9` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:41.066469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383d068-e3f6-4799-aa5d-90808df584d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8851c340bc964644bfb950b459637bc9)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:41.070138 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383d068-e3f6-4799-aa5d-90808df584d9 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:41.297077 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:41.431510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-8383d068-e3f6-4799-aa5d-90808df584d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8851c340bc964644bfb950b459637bc9'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:41.602758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-8383d068-e3f6-4799-aa5d-90808df584d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8851c340bc964644bfb950b459637bc9'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:41.603570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-8383d068-e3f6-4799-aa5d-90808df584d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8851c340bc964644bfb950b459637bc9'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:41.604212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-8383d068-e3f6-4799-aa5d-90808df584d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8851c340bc964644bfb950b459637bc9'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:41.614329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-8383d068-e3f6-4799-aa5d-90808df584d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8851c340bc964644bfb950b459637bc9'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:41.674861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1182/2336] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:40 2022] DELETE /identity/v3/users/8851c340bc964644bfb950b459637bc9 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:41.676007 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28112633-df25-4c31-b784-5ed856ac00ee None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:41.676295 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28112633-df25-4c31-b784-5ed856ac00ee None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:41.676575 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28112633-df25-4c31-b784-5ed856ac00ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:41.734995 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-28112633-df25-4c31-b784-5ed856ac00ee None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:41.743822 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-28112633-df25-4c31-b784-5ed856ac00ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:41.825812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1155/2337] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:41.840781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383d068-e3f6-4799-aa5d-90808df584d9 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:41.844558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8383d068-e3f6-4799-aa5d-90808df584d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:41.964025 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383d068-e3f6-4799-aa5d-90808df584d9 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:41.973466 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f67333-383a-4bd0-81de-8fd4d6226327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:41.974863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f67333-383a-4bd0-81de-8fd4d6226327 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:41.975941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f67333-383a-4bd0-81de-8fd4d6226327 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:41.977812 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f67333-383a-4bd0-81de-8fd4d6226327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:42.013280 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f67333-383a-4bd0-81de-8fd4d6226327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:42.013280 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f67333-383a-4bd0-81de-8fd4d6226327 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:42.050894 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1183/2338] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:43.594562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28112633-df25-4c31-b784-5ed856ac00ee None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:43.597789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-28112633-df25-4c31-b784-5ed856ac00ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:43.612437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28112633-df25-4c31-b784-5ed856ac00ee None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:43.620474 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:43.621509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:43.621977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:43.622499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3 admin admin] PATH_INFO: `/v3/projects/8fa3f5ac811b4dc2bc97c8f65c96ffdb` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:43.624274 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa3f5ac811b4dc2bc97c8f65c96ffdb)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:43.626757 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:43.787401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa3f5ac811b4dc2bc97c8f65c96ffdb', 'request_id': 'req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:43.792630 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:43.918280 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa3f5ac811b4dc2bc97c8f65c96ffdb', 'request_id': 'req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:43.928197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa3f5ac811b4dc2bc97c8f65c96ffdb', 'request_id': 'req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:43.957316 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3 admin admin] The token cache is being invalidate because project 8fa3f5ac811b4dc2bc97c8f65c96ffdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:43.957992 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:43.959925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:43.964184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1156/2339] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:43 2022] DELETE /identity/v3/projects/8fa3f5ac811b4dc2bc97c8f65c96ffdb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:43.969143 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f67333-383a-4bd0-81de-8fd4d6226327 service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:43.983089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f67333-383a-4bd0-81de-8fd4d6226327 service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:44.092826 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d03525-46dc-4b6e-868e-6a55e23353c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:44.094043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d03525-46dc-4b6e-868e-6a55e23353c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:44.094359 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d03525-46dc-4b6e-868e-6a55e23353c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:44.094668 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d03525-46dc-4b6e-868e-6a55e23353c2 admin admin] PATH_INFO: `/v3/users/3e413c3feb0e46f58d0b5040a0e98bc4` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:44.095982 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d03525-46dc-4b6e-868e-6a55e23353c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e413c3feb0e46f58d0b5040a0e98bc4)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:44.098129 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d03525-46dc-4b6e-868e-6a55e23353c2 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:44.595376 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-70d03525-46dc-4b6e-868e-6a55e23353c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e413c3feb0e46f58d0b5040a0e98bc4'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:44.677419 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:44.752722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-70d03525-46dc-4b6e-868e-6a55e23353c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e413c3feb0e46f58d0b5040a0e98bc4'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:44.754701 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-70d03525-46dc-4b6e-868e-6a55e23353c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e413c3feb0e46f58d0b5040a0e98bc4'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:44.756630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-70d03525-46dc-4b6e-868e-6a55e23353c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e413c3feb0e46f58d0b5040a0e98bc4'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:44.779618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-70d03525-46dc-4b6e-868e-6a55e23353c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e413c3feb0e46f58d0b5040a0e98bc4'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:44.848386 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1184/2340] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:43 2022] DELETE /identity/v3/users/3e413c3feb0e46f58d0b5040a0e98bc4 => generated 0 bytes in 880 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:52:46.652501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:46.657152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:46.722661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5650be6-1349-4d6f-aaf5-1030b5ed4df3 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:46.883925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:46.884860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:46.885136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:46.885737 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100 admin admin] PATH_INFO: `/v3/projects/f17d596e7fb346a0bde91735f3bb4111` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:46.887446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17d596e7fb346a0bde91735f3bb4111)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:46.891251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:47.115071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17d596e7fb346a0bde91735f3bb4111', 'request_id': 'req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:47.260686 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17d596e7fb346a0bde91735f3bb4111', 'request_id': 'req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:47.271781 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17d596e7fb346a0bde91735f3bb4111', 'request_id': 'req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:47.335673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100 admin admin] The token cache is being invalidate because project f17d596e7fb346a0bde91735f3bb4111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:47.337407 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:47.344598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:47.354546 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1157/2341] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:46 2022] DELETE /identity/v3/projects/f17d596e7fb346a0bde91735f3bb4111 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:47.359174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d03525-46dc-4b6e-868e-6a55e23353c2 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:47.361534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-70d03525-46dc-4b6e-868e-6a55e23353c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:47.384076 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d03525-46dc-4b6e-868e-6a55e23353c2 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:47.578356 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782a3ef-4da1-49be-9f1f-fdd14cdaffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:47.579654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782a3ef-4da1-49be-9f1f-fdd14cdaffb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:47.580235 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782a3ef-4da1-49be-9f1f-fdd14cdaffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:47.581020 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782a3ef-4da1-49be-9f1f-fdd14cdaffb3 admin admin] PATH_INFO: `/v3/users/acb9ae162fec4e7383a83c27efac8f2d` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:47.584294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782a3ef-4da1-49be-9f1f-fdd14cdaffb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acb9ae162fec4e7383a83c27efac8f2d)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:47.589246 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782a3ef-4da1-49be-9f1f-fdd14cdaffb3 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:47.873188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:47.876043 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:47.879759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:47.898669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d21ffb-d4a1-4449-85cf-b8ea9a97a100 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:47.905437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-5782a3ef-4da1-49be-9f1f-fdd14cdaffb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acb9ae162fec4e7383a83c27efac8f2d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:47.915821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461afc5-5417-4e54-ae2b-678c5063e9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:47.916976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461afc5-5417-4e54-ae2b-678c5063e9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:47.917456 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461afc5-5417-4e54-ae2b-678c5063e9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:47.917897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461afc5-5417-4e54-ae2b-678c5063e9dc admin admin] PATH_INFO: `/v3/users/80ff6141d0004dea90a2d67bda426a2c` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:47.921897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461afc5-5417-4e54-ae2b-678c5063e9dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ff6141d0004dea90a2d67bda426a2c)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:47.924437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461afc5-5417-4e54-ae2b-678c5063e9dc admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:47.980316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-5782a3ef-4da1-49be-9f1f-fdd14cdaffb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acb9ae162fec4e7383a83c27efac8f2d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:47.981905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-5782a3ef-4da1-49be-9f1f-fdd14cdaffb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acb9ae162fec4e7383a83c27efac8f2d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:47.982892 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-5782a3ef-4da1-49be-9f1f-fdd14cdaffb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acb9ae162fec4e7383a83c27efac8f2d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:47.999438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-5782a3ef-4da1-49be-9f1f-fdd14cdaffb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acb9ae162fec4e7383a83c27efac8f2d'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:48.070261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1185/2342] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:47 2022] DELETE /identity/v3/users/acb9ae162fec4e7383a83c27efac8f2d => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:48.220640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a461afc5-5417-4e54-ae2b-678c5063e9dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ff6141d0004dea90a2d67bda426a2c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:48.221387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a461afc5-5417-4e54-ae2b-678c5063e9dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ff6141d0004dea90a2d67bda426a2c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:48.232598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a461afc5-5417-4e54-ae2b-678c5063e9dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ff6141d0004dea90a2d67bda426a2c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:48.265870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a461afc5-5417-4e54-ae2b-678c5063e9dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ff6141d0004dea90a2d67bda426a2c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:48.266652 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a461afc5-5417-4e54-ae2b-678c5063e9dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ff6141d0004dea90a2d67bda426a2c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:48.401672 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1158/2343] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:52:47 2022] DELETE /identity/v3/users/80ff6141d0004dea90a2d67bda426a2c => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:48.403618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b232b-8964-489c-8c07-4d98983e193f None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:48.404922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b232b-8964-489c-8c07-4d98983e193f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:48.404922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b232b-8964-489c-8c07-4d98983e193f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:48.456054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-b38b232b-8964-489c-8c07-4d98983e193f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:48.456054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b38b232b-8964-489c-8c07-4d98983e193f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:48.620017 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1186/2344] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:48.628321 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461afc5-5417-4e54-ae2b-678c5063e9dc admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:48.629877 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a461afc5-5417-4e54-ae2b-678c5063e9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:48.725381 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461afc5-5417-4e54-ae2b-678c5063e9dc admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:48.730117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdc691-81c1-42d8-b9c8-57b911947a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:48.730827 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdc691-81c1-42d8-b9c8-57b911947a0c service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:48.731165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdc691-81c1-42d8-b9c8-57b911947a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:48.731630 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdc691-81c1-42d8-b9c8-57b911947a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:48.752956 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdc691-81c1-42d8-b9c8-57b911947a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:48.755284 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdc691-81c1-42d8-b9c8-57b911947a0c service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:48.770808 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1159/2345] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:48.774454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:48.849632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60f9a4-909c-470d-9521-b17c6bb00d7c None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:48.849909 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60f9a4-909c-470d-9521-b17c6bb00d7c None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:48.850535 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60f9a4-909c-470d-9521-b17c6bb00d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:48.895166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-7c60f9a4-909c-470d-9521-b17c6bb00d7c None None] MFA Rules not processed for user `89fabc9685ba44eda83e3470fdd3a2c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:48.897022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7c60f9a4-909c-470d-9521-b17c6bb00d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:49.082847 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1187/2346] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:49.093545 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdc691-81c1-42d8-b9c8-57b911947a0c service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:49.100558 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-18cdc691-81c1-42d8-b9c8-57b911947a0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:49.117060 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60f9a4-909c-470d-9521-b17c6bb00d7c None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:49.123443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7c60f9a4-909c-470d-9521-b17c6bb00d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:49.164918 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60f9a4-909c-470d-9521-b17c6bb00d7c None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:49.179166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb15cf8-bbd7-4a20-9519-a768bbced704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:49.180061 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb15cf8-bbd7-4a20-9519-a768bbced704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:49.180778 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb15cf8-bbd7-4a20-9519-a768bbced704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:49.181173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb15cf8-bbd7-4a20-9519-a768bbced704 admin admin] PATH_INFO: `/v3/projects/5cf45fafc9cd4cf79319b15b3acd2a7c` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:49.184416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb15cf8-bbd7-4a20-9519-a768bbced704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cf45fafc9cd4cf79319b15b3acd2a7c)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:49.192087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb15cf8-bbd7-4a20-9519-a768bbced704 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:49.281337 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdc691-81c1-42d8-b9c8-57b911947a0c service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:49.293379 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd201e-3e3a-40c7-a917-a81adbfb3872 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52705fc64cd54b1985ef2cb02f6c47fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:49.295186 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd201e-3e3a-40c7-a917-a81adbfb3872 service glance] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:49.297130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd201e-3e3a-40c7-a917-a81adbfb3872 service glance] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:49.297582 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd201e-3e3a-40c7-a917-a81adbfb3872 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:49.302076 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c8cd201e-3e3a-40c7-a917-a81adbfb3872 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:49.385188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd201e-3e3a-40c7-a917-a81adbfb3872 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:49.387078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd201e-3e3a-40c7-a917-a81adbfb3872 service glance] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:49.395649 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-fdb15cf8-bbd7-4a20-9519-a768bbced704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cf45fafc9cd4cf79319b15b3acd2a7c', 'request_id': 'req-fdb15cf8-bbd7-4a20-9519-a768bbced704'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:49.402496 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1160/2347] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:52:49.410324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-fdb15cf8-bbd7-4a20-9519-a768bbced704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cf45fafc9cd4cf79319b15b3acd2a7c', 'request_id': 'req-fdb15cf8-bbd7-4a20-9519-a768bbced704'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:49.512020 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-fdb15cf8-bbd7-4a20-9519-a768bbced704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cf45fafc9cd4cf79319b15b3acd2a7c', 'request_id': 'req-fdb15cf8-bbd7-4a20-9519-a768bbced704'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:49.568489 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-fdb15cf8-bbd7-4a20-9519-a768bbced704 admin admin] The token cache is being invalidate because project 5cf45fafc9cd4cf79319b15b3acd2a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:49.569048 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-fdb15cf8-bbd7-4a20-9519-a768bbced704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:49.572130 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-fdb15cf8-bbd7-4a20-9519-a768bbced704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:49.578735 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1188/2348] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:49 2022] DELETE /identity/v3/projects/5cf45fafc9cd4cf79319b15b3acd2a7c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:49.586148 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c339e44-9e04-4679-8ed2-e6c193b2575f None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:49.586616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c339e44-9e04-4679-8ed2-e6c193b2575f None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:49.587461 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c339e44-9e04-4679-8ed2-e6c193b2575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:49.675701 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-3c339e44-9e04-4679-8ed2-e6c193b2575f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:49.676979 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3c339e44-9e04-4679-8ed2-e6c193b2575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:49.799436 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb15cf8-bbd7-4a20-9519-a768bbced704 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:49.800997 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-fdb15cf8-bbd7-4a20-9519-a768bbced704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:49.809354 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1161/2349] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:49.822512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba19a28-c54b-4699-9977-ecba5d945154 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:49.822512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba19a28-c54b-4699-9977-ecba5d945154 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:49.822512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba19a28-c54b-4699-9977-ecba5d945154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:49.830527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb15cf8-bbd7-4a20-9519-a768bbced704 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:49.836883 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e639f6a-4db5-46c8-a9c5-827af71a9a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:49.837963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e639f6a-4db5-46c8-a9c5-827af71a9a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:49.837963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e639f6a-4db5-46c8-a9c5-827af71a9a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:49.838305 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e639f6a-4db5-46c8-a9c5-827af71a9a75 admin admin] PATH_INFO: `/v3/projects/6099f484f33b4e75ae81980c2fd2714f` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:49.840790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e639f6a-4db5-46c8-a9c5-827af71a9a75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6099f484f33b4e75ae81980c2fd2714f)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:49.846176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e639f6a-4db5-46c8-a9c5-827af71a9a75 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:49.883794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-3ba19a28-c54b-4699-9977-ecba5d945154 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:49.885279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3ba19a28-c54b-4699-9977-ecba5d945154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:49.898509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1162/2350] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:52:49.900457 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc1c1d-db67-4973-a16d-84f5ce00b047 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:49.900847 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc1c1d-db67-4973-a16d-84f5ce00b047 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:49.901224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc1c1d-db67-4973-a16d-84f5ce00b047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:49.924780 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-d1fc1c1d-db67-4973-a16d-84f5ce00b047 None None] MFA Rules not processed for user `87ba67fc171b4258b6fda72094ed11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:49.926285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d1fc1c1d-db67-4973-a16d-84f5ce00b047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:49.993920 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1163/2351] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Sep 7 16:52:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:52:49.994790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc1c1d-db67-4973-a16d-84f5ce00b047 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:50.007908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc1c1d-db67-4973-a16d-84f5ce00b047 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:50.053413 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7e639f6a-4db5-46c8-a9c5-827af71a9a75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6099f484f33b4e75ae81980c2fd2714f', 'request_id': 'req-7e639f6a-4db5-46c8-a9c5-827af71a9a75'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:50.062743 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7e639f6a-4db5-46c8-a9c5-827af71a9a75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6099f484f33b4e75ae81980c2fd2714f', 'request_id': 'req-7e639f6a-4db5-46c8-a9c5-827af71a9a75'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:50.103046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df035d5c-5514-43ae-8b97-021797fb4cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:50.104607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df035d5c-5514-43ae-8b97-021797fb4cbc admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:50.105048 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df035d5c-5514-43ae-8b97-021797fb4cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:50.105507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df035d5c-5514-43ae-8b97-021797fb4cbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:50.106399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df035d5c-5514-43ae-8b97-021797fb4cbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:52:50.106895 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df035d5c-5514-43ae-8b97-021797fb4cbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:50.109008 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df035d5c-5514-43ae-8b97-021797fb4cbc admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:50.124137 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1164/2352] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:52:50.125998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df035d5c-5514-43ae-8b97-021797fb4cbc admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:50.127706 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-df035d5c-5514-43ae-8b97-021797fb4cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:50.174280 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7e639f6a-4db5-46c8-a9c5-827af71a9a75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6099f484f33b4e75ae81980c2fd2714f', 'request_id': 'req-7e639f6a-4db5-46c8-a9c5-827af71a9a75'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:50.202942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7e639f6a-4db5-46c8-a9c5-827af71a9a75 admin admin] The token cache is being invalidate because project 6099f484f33b4e75ae81980c2fd2714f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:52:50.206224 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7e639f6a-4db5-46c8-a9c5-827af71a9a75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:50.206224 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7e639f6a-4db5-46c8-a9c5-827af71a9a75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:52:50.224053 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1189/2353] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:52:49 2022] DELETE /identity/v3/projects/6099f484f33b4e75ae81980c2fd2714f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:52:50.225328 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e639f6a-4db5-46c8-a9c5-827af71a9a75 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:50.252856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7e639f6a-4db5-46c8-a9c5-827af71a9a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:50.265661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df035d5c-5514-43ae-8b97-021797fb4cbc admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:50.272531 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e4704-2cc7-46fa-bb69-bf8b0a0a8ef0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56cd868e866d436aa1d601f7791e812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:50.273185 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e4704-2cc7-46fa-bb69-bf8b0a0a8ef0 service swift] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:50.273466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e4704-2cc7-46fa-bb69-bf8b0a0a8ef0 service swift] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:50.273810 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e4704-2cc7-46fa-bb69-bf8b0a0a8ef0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:50.277166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ae1e4704-2cc7-46fa-bb69-bf8b0a0a8ef0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:50.312053 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e639f6a-4db5-46c8-a9c5-827af71a9a75 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:50.327688 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ffa94-045d-4d06-83a9-8cad27e8c4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:50.328715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ffa94-045d-4d06-83a9-8cad27e8c4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:50.329205 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ffa94-045d-4d06-83a9-8cad27e8c4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:50.329691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ffa94-045d-4d06-83a9-8cad27e8c4e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:50.330907 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ffa94-045d-4d06-83a9-8cad27e8c4e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:50.337073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ffa94-045d-4d06-83a9-8cad27e8c4e1 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:50.404248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e4704-2cc7-46fa-bb69-bf8b0a0a8ef0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:50.407815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e4704-2cc7-46fa-bb69-bf8b0a0a8ef0 service swift] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:50.446957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1165/2354] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Sep 7 16:52:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:52:50.516674 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1190/2355] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:52:50 2022] POST /identity/v3/projects => generated 363 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:52:50.521093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e4704-2cc7-46fa-bb69-bf8b0a0a8ef0 service swift] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:50.540783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e4704-2cc7-46fa-bb69-bf8b0a0a8ef0 service swift] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:50.665825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed471928-0bc2-4b9a-b479-6db9d37a0eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:50.667368 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed471928-0bc2-4b9a-b479-6db9d37a0eea admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:50.668704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed471928-0bc2-4b9a-b479-6db9d37a0eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:50.669739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed471928-0bc2-4b9a-b479-6db9d37a0eea admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:50.671187 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed471928-0bc2-4b9a-b479-6db9d37a0eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:50.675723 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed471928-0bc2-4b9a-b479-6db9d37a0eea admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:50.848376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1166/2356] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:52:50 2022] POST /identity/v3/users => generated 282 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:52:50.854060 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ffa94-045d-4d06-83a9-8cad27e8c4e1 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:50.872705 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ffa94-045d-4d06-83a9-8cad27e8c4e1 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:50.879542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83be9f2-6b1e-4cac-bba6-15e592c847aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:50.880897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83be9f2-6b1e-4cac-bba6-15e592c847aa admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:50.881372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83be9f2-6b1e-4cac-bba6-15e592c847aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:50.881798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83be9f2-6b1e-4cac-bba6-15e592c847aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:50.882613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83be9f2-6b1e-4cac-bba6-15e592c847aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:50.884535 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83be9f2-6b1e-4cac-bba6-15e592c847aa admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:50.913773 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1191/2357] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:52:50.918887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed471928-0bc2-4b9a-b479-6db9d37a0eea admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:50.936625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed471928-0bc2-4b9a-b479-6db9d37a0eea admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:50.942961 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b1e95-630c-465c-b2f8-1c6bbefde497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:50.943820 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b1e95-630c-465c-b2f8-1c6bbefde497 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:50.944118 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b1e95-630c-465c-b2f8-1c6bbefde497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:50.944396 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b1e95-630c-465c-b2f8-1c6bbefde497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:50.945100 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b1e95-630c-465c-b2f8-1c6bbefde497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:50.946751 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b1e95-630c-465c-b2f8-1c6bbefde497 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:50.971287 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1167/2358] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:52:50.971398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83be9f2-6b1e-4cac-bba6-15e592c847aa admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:50.985448 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83be9f2-6b1e-4cac-bba6-15e592c847aa admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:50.990991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04b8c5-2dbe-4c73-bf66-1f8343fe09a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:50.991760 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04b8c5-2dbe-4c73-bf66-1f8343fe09a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:50.992044 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04b8c5-2dbe-4c73-bf66-1f8343fe09a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:50.992321 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04b8c5-2dbe-4c73-bf66-1f8343fe09a5 admin admin] PATH_INFO: `/v3/projects/2f8e3d36c4084738ae6d5a2074e33191/users/39c89dec6ffd4fda963b43549f365813/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:51.022541 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04b8c5-2dbe-4c73-bf66-1f8343fe09a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f8e3d36c4084738ae6d5a2074e33191, user_id=39c89dec6ffd4fda963b43549f365813, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:51.034544 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04b8c5-2dbe-4c73-bf66-1f8343fe09a5 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:51.140788 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1192/2359] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:52:50 2022] PUT /identity/v3/projects/2f8e3d36c4084738ae6d5a2074e33191/users/39c89dec6ffd4fda963b43549f365813/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:52:51.145488 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5581ebe-0f22-482c-a0f7-56665c5148a5 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:51.147837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5581ebe-0f22-482c-a0f7-56665c5148a5 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:51.148408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5581ebe-0f22-482c-a0f7-56665c5148a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:51.217931 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-e5581ebe-0f22-482c-a0f7-56665c5148a5 None None] MFA Rules not processed for user `39c89dec6ffd4fda963b43549f365813`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:52:51.220546 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-e5581ebe-0f22-482c-a0f7-56665c5148a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:51.368515 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1168/2360] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:52:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:52:51.387043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04b8c5-2dbe-4c73-bf66-1f8343fe09a5 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:52:51.389767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-fe04b8c5-2dbe-4c73-bf66-1f8343fe09a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:52:51.522204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04b8c5-2dbe-4c73-bf66-1f8343fe09a5 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:52:51.528010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585edb2-9f2d-4dc7-894c-e53edb1e1733 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:52:51.529369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585edb2-9f2d-4dc7-894c-e53edb1e1733 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:52:51.529975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585edb2-9f2d-4dc7-894c-e53edb1e1733 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:52:51.530457 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585edb2-9f2d-4dc7-894c-e53edb1e1733 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:52:51.551249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585edb2-9f2d-4dc7-894c-e53edb1e1733 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:52:51.552806 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585edb2-9f2d-4dc7-894c-e53edb1e1733 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:52:51.578988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1193/2361] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:52:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:52:51.739661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:52.620469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:55.152313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:55.926149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:57.991896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:52:58.742574 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:00.533613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5581ebe-0f22-482c-a0f7-56665c5148a5 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:00.545270 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5581ebe-0f22-482c-a0f7-56665c5148a5 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:00.552241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a235341-d8c2-4de7-8bdf-a4eee4db8ae2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:00.553286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a235341-d8c2-4de7-8bdf-a4eee4db8ae2 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:00.553797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a235341-d8c2-4de7-8bdf-a4eee4db8ae2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:00.557508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a235341-d8c2-4de7-8bdf-a4eee4db8ae2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:00.560932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1a235341-d8c2-4de7-8bdf-a4eee4db8ae2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:00.698180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a235341-d8c2-4de7-8bdf-a4eee4db8ae2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:00.701379 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a235341-d8c2-4de7-8bdf-a4eee4db8ae2 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:00.722518 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1169/2362] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:53:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:53:00.919686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:01.313521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:02.239054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:02.826298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:02.884917 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:03.060677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:04.391906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=82,keystone:INSERT=5,keystone:DELETE=13 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:05.232490 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:06.549063 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761904d2-4256-44aa-b4ca-5867b03e460f None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:06.549913 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761904d2-4256-44aa-b4ca-5867b03e460f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:06.549913 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761904d2-4256-44aa-b4ca-5867b03e460f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:06.579680 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-761904d2-4256-44aa-b4ca-5867b03e460f None None] MFA Rules not processed for user `71ae88d86f5c443480038a166a5c50b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:06.581601 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-761904d2-4256-44aa-b4ca-5867b03e460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:06.676226 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1194/2363] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:53:06.718956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:06.775888 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:08.168774 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:09.015281 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:10.431213 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:11.267562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:11.613121 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86ab3d-9b63-4418-9b7a-a60aeb3c75ba None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:11.613121 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86ab3d-9b63-4418-9b7a-a60aeb3c75ba None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:11.613121 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86ab3d-9b63-4418-9b7a-a60aeb3c75ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:11.645053 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-5d86ab3d-9b63-4418-9b7a-a60aeb3c75ba None None] MFA Rules not processed for user `87ba67fc171b4258b6fda72094ed11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:11.645053 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-5d86ab3d-9b63-4418-9b7a-a60aeb3c75ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:11.739705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1170/2364] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Sep 7 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:53:11.753005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761904d2-4256-44aa-b4ca-5867b03e460f None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:11.759817 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-761904d2-4256-44aa-b4ca-5867b03e460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:11.856752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761904d2-4256-44aa-b4ca-5867b03e460f None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:11.864803 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06da96-0a38-4879-8f9c-6e7ed83e00a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56cd868e866d436aa1d601f7791e812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:11.868624 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06da96-0a38-4879-8f9c-6e7ed83e00a6 service swift] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:11.868624 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06da96-0a38-4879-8f9c-6e7ed83e00a6 service swift] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:11.868624 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06da96-0a38-4879-8f9c-6e7ed83e00a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:11.883111 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06da96-0a38-4879-8f9c-6e7ed83e00a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:11.885163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06da96-0a38-4879-8f9c-6e7ed83e00a6 service swift] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:11.900658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1195/2365] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Sep 7 16:53:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:53:12.581606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:12.649023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:15.461345 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:15.516887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:17.676930 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:17.973852 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:18.100412 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:18.226414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:18.311596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:18.467799 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:18.493700 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:19.639460 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:19.781799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:20.478578 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:20.530288 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:20.886248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:20.918505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:22.032171 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:23.123796 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:23.173860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:23.710264 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:23.798354 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:24.100067 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:24.562431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:24.928430 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:25.091607 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=80,keystone:INSERT=5,keystone:DELETE=15 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:25.243644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:25.335827 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:25.476833 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:25.884290 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:26.179433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:26.359885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86ab3d-9b63-4418-9b7a-a60aeb3c75ba None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:26.363179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-5d86ab3d-9b63-4418-9b7a-a60aeb3c75ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:26.545531 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86ab3d-9b63-4418-9b7a-a60aeb3c75ba None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:26.562289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71fde8-e3ff-4da4-87ad-af99c922f719 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256e8478e5fb4c01acde0d597bae0b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:26.563749 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71fde8-e3ff-4da4-87ad-af99c922f719 service placement] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:26.564826 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71fde8-e3ff-4da4-87ad-af99c922f719 service placement] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:26.565452 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71fde8-e3ff-4da4-87ad-af99c922f719 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:26.581049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4f71fde8-e3ff-4da4-87ad-af99c922f719 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:26.598419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71fde8-e3ff-4da4-87ad-af99c922f719 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:26.602207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71fde8-e3ff-4da4-87ad-af99c922f719 service placement] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:26.619054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1171/2366] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:53:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:53:26.734927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:26.804536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:27.030891 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:27.157202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:27.293863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:27.467192 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:27.547142 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:27.907986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:27.992720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:28.078163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:29.019467 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:29.116839 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:29.791616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:29.882881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:30.495179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:30.939774 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:31.105361 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:31.376355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:31.461198 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:31.550976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:31.901644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:31.946052 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:32.334525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:32.734486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:32.859742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:33.225925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:33.278310 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06da96-0a38-4879-8f9c-6e7ed83e00a6 service swift] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:33.281185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-fa06da96-0a38-4879-8f9c-6e7ed83e00a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:33.333858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:33.373511 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06da96-0a38-4879-8f9c-6e7ed83e00a6 service swift] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:33.379583 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c1e59-dd32-4540-ad2a-c1d47be3ed74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:33.380216 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c1e59-dd32-4540-ad2a-c1d47be3ed74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:33.380493 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c1e59-dd32-4540-ad2a-c1d47be3ed74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:33.380761 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c1e59-dd32-4540-ad2a-c1d47be3ed74 admin admin] PATH_INFO: `/v3/users/2e0bd62012ca444a866dad545af24524` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:33.381956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c1e59-dd32-4540-ad2a-c1d47be3ed74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e0bd62012ca444a866dad545af24524)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:33.383952 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c1e59-dd32-4540-ad2a-c1d47be3ed74 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:33.653470 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-df3c1e59-dd32-4540-ad2a-c1d47be3ed74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e0bd62012ca444a866dad545af24524'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:33.738982 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-df3c1e59-dd32-4540-ad2a-c1d47be3ed74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e0bd62012ca444a866dad545af24524'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:33.739691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-df3c1e59-dd32-4540-ad2a-c1d47be3ed74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e0bd62012ca444a866dad545af24524'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:33.740322 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-df3c1e59-dd32-4540-ad2a-c1d47be3ed74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e0bd62012ca444a866dad545af24524'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:33.749012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-df3c1e59-dd32-4540-ad2a-c1d47be3ed74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e0bd62012ca444a866dad545af24524'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:33.776790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1196/2367] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:53:33 2022] DELETE /identity/v3/users/2e0bd62012ca444a866dad545af24524 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:53:34.108334 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71fde8-e3ff-4da4-87ad-af99c922f719 service placement] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:34.120030 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71fde8-e3ff-4da4-87ad-af99c922f719 service placement] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:34.207297 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87351a1d-9be8-450c-9476-165db4d3460e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:34.208060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87351a1d-9be8-450c-9476-165db4d3460e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:34.208442 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87351a1d-9be8-450c-9476-165db4d3460e admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:34.208775 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87351a1d-9be8-450c-9476-165db4d3460e admin admin] PATH_INFO: `/v3/projects/a061acf0126346b1aa6b6b48ee1e2004` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:34.210086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87351a1d-9be8-450c-9476-165db4d3460e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a061acf0126346b1aa6b6b48ee1e2004)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:34.212534 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87351a1d-9be8-450c-9476-165db4d3460e admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:34.383736 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-87351a1d-9be8-450c-9476-165db4d3460e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a061acf0126346b1aa6b6b48ee1e2004', 'request_id': 'req-87351a1d-9be8-450c-9476-165db4d3460e'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:34.494953 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-87351a1d-9be8-450c-9476-165db4d3460e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a061acf0126346b1aa6b6b48ee1e2004', 'request_id': 'req-87351a1d-9be8-450c-9476-165db4d3460e'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:34.513441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-87351a1d-9be8-450c-9476-165db4d3460e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a061acf0126346b1aa6b6b48ee1e2004', 'request_id': 'req-87351a1d-9be8-450c-9476-165db4d3460e'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:34.542747 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-87351a1d-9be8-450c-9476-165db4d3460e admin admin] The token cache is being invalidate because project a061acf0126346b1aa6b6b48ee1e2004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:53:34.544092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-87351a1d-9be8-450c-9476-165db4d3460e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:34.547029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-87351a1d-9be8-450c-9476-165db4d3460e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:34.551596 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1172/2368] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:53:34 2022] DELETE /identity/v3/projects/a061acf0126346b1aa6b6b48ee1e2004 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:53:34.555755 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c1e59-dd32-4540-ad2a-c1d47be3ed74 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:34.563520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-df3c1e59-dd32-4540-ad2a-c1d47be3ed74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:34.592626 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c1e59-dd32-4540-ad2a-c1d47be3ed74 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:34.679071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5c95b-04d2-4369-a0ec-e44d54094b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:34.679839 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5c95b-04d2-4369-a0ec-e44d54094b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:34.680369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5c95b-04d2-4369-a0ec-e44d54094b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:34.680718 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5c95b-04d2-4369-a0ec-e44d54094b3f admin admin] PATH_INFO: `/v3/users/2a9f8d1e8d9c4a09bd1f282c670be646` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:34.682260 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5c95b-04d2-4369-a0ec-e44d54094b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a9f8d1e8d9c4a09bd1f282c670be646)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:34.684756 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5c95b-04d2-4369-a0ec-e44d54094b3f admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:34.912093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b3f5c95b-04d2-4369-a0ec-e44d54094b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a9f8d1e8d9c4a09bd1f282c670be646'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:34.912093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:34.998533 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b3f5c95b-04d2-4369-a0ec-e44d54094b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a9f8d1e8d9c4a09bd1f282c670be646'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:34.999442 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b3f5c95b-04d2-4369-a0ec-e44d54094b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a9f8d1e8d9c4a09bd1f282c670be646'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:35.000365 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b3f5c95b-04d2-4369-a0ec-e44d54094b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a9f8d1e8d9c4a09bd1f282c670be646'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:35.008664 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b3f5c95b-04d2-4369-a0ec-e44d54094b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a9f8d1e8d9c4a09bd1f282c670be646'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:35.026892 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1197/2369] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:53:34 2022] DELETE /identity/v3/users/2a9f8d1e8d9c4a09bd1f282c670be646 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:53:35.432664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87351a1d-9be8-450c-9476-165db4d3460e admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:35.436093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-87351a1d-9be8-450c-9476-165db4d3460e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:35.450573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87351a1d-9be8-450c-9476-165db4d3460e admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:35.532719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed76691-b279-4416-91d6-56d2de1d272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:35.533957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed76691-b279-4416-91d6-56d2de1d272f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:35.534496 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed76691-b279-4416-91d6-56d2de1d272f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:35.535050 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed76691-b279-4416-91d6-56d2de1d272f admin admin] PATH_INFO: `/v3/projects/cd8c68b133a643e895d46b302da3a163` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:35.537070 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed76691-b279-4416-91d6-56d2de1d272f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8c68b133a643e895d46b302da3a163)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:35.541069 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed76691-b279-4416-91d6-56d2de1d272f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:35.691284 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:35.715012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-9ed76691-b279-4416-91d6-56d2de1d272f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8c68b133a643e895d46b302da3a163', 'request_id': 'req-9ed76691-b279-4416-91d6-56d2de1d272f'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:35.826647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-9ed76691-b279-4416-91d6-56d2de1d272f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8c68b133a643e895d46b302da3a163', 'request_id': 'req-9ed76691-b279-4416-91d6-56d2de1d272f'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:35.838388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-9ed76691-b279-4416-91d6-56d2de1d272f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8c68b133a643e895d46b302da3a163', 'request_id': 'req-9ed76691-b279-4416-91d6-56d2de1d272f'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:35.861303 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-9ed76691-b279-4416-91d6-56d2de1d272f admin admin] The token cache is being invalidate because project cd8c68b133a643e895d46b302da3a163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:53:35.862030 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-9ed76691-b279-4416-91d6-56d2de1d272f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:35.863151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-9ed76691-b279-4416-91d6-56d2de1d272f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:35.865965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1173/2370] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:53:35 2022] DELETE /identity/v3/projects/cd8c68b133a643e895d46b302da3a163 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:53:35.873997 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cb9dd-11a0-4c3e-b571-60d52e6a9d10 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:35.874946 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cb9dd-11a0-4c3e-b571-60d52e6a9d10 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:35.874946 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cb9dd-11a0-4c3e-b571-60d52e6a9d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:35.933227 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-507cb9dd-11a0-4c3e-b571-60d52e6a9d10 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:35.935544 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-507cb9dd-11a0-4c3e-b571-60d52e6a9d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:36.017553 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1198/2371] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:53:36.030407 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b47e4-f052-45ab-b7f2-40adf2942097 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:36.030727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b47e4-f052-45ab-b7f2-40adf2942097 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:36.030987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b47e4-f052-45ab-b7f2-40adf2942097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:36.067034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-8c4b47e4-f052-45ab-b7f2-40adf2942097 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:36.068394 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-8c4b47e4-f052-45ab-b7f2-40adf2942097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:36.078096 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1174/2372] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:53:36.082834 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cb9dd-11a0-4c3e-b571-60d52e6a9d10 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:36.094064 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cb9dd-11a0-4c3e-b571-60d52e6a9d10 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:36.099734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3adf29-ecc7-4abe-9459-c51715366104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:36.100376 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3adf29-ecc7-4abe-9459-c51715366104 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:36.100770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3adf29-ecc7-4abe-9459-c51715366104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:36.101107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3adf29-ecc7-4abe-9459-c51715366104 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:36.101801 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3adf29-ecc7-4abe-9459-c51715366104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:53:36.102122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3adf29-ecc7-4abe-9459-c51715366104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:36.103833 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3adf29-ecc7-4abe-9459-c51715366104 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:36.119978 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1199/2373] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:53:36.127635 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b47e4-f052-45ab-b7f2-40adf2942097 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:36.140855 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b47e4-f052-45ab-b7f2-40adf2942097 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:36.149241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f2a57-24fd-40af-8adc-17b3a04b63db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:36.149935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f2a57-24fd-40af-8adc-17b3a04b63db admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:36.150232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f2a57-24fd-40af-8adc-17b3a04b63db admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:36.150501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f2a57-24fd-40af-8adc-17b3a04b63db admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:36.151187 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f2a57-24fd-40af-8adc-17b3a04b63db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:36.154003 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f2a57-24fd-40af-8adc-17b3a04b63db admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:36.310704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1175/2374] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:53:36 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:53:36.315202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3adf29-ecc7-4abe-9459-c51715366104 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:36.335888 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f2a57-24fd-40af-8adc-17b3a04b63db admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:36.337048 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3adf29-ecc7-4abe-9459-c51715366104 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:36.338713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ed9f2a57-24fd-40af-8adc-17b3a04b63db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:36.467824 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46503447-dccc-4dd7-9cd5-274d22bf71a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:36.468980 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46503447-dccc-4dd7-9cd5-274d22bf71a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:36.469448 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46503447-dccc-4dd7-9cd5-274d22bf71a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:36.469913 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46503447-dccc-4dd7-9cd5-274d22bf71a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:36.471145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46503447-dccc-4dd7-9cd5-274d22bf71a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:36.475024 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46503447-dccc-4dd7-9cd5-274d22bf71a6 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:36.488199 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f2a57-24fd-40af-8adc-17b3a04b63db admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:36.499152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c61bf1-75b8-4d7a-a0db-bdfe10838eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:36.501161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c61bf1-75b8-4d7a-a0db-bdfe10838eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:36.501161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c61bf1-75b8-4d7a-a0db-bdfe10838eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:36.501161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c61bf1-75b8-4d7a-a0db-bdfe10838eec admin admin] PATH_INFO: `/v3/users/39c89dec6ffd4fda963b43549f365813` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:36.502742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c61bf1-75b8-4d7a-a0db-bdfe10838eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=39c89dec6ffd4fda963b43549f365813)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:36.505198 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c61bf1-75b8-4d7a-a0db-bdfe10838eec admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:36.583639 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1200/2375] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:53:36 2022] POST /identity/v3/users => generated 286 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:53:36.588613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46503447-dccc-4dd7-9cd5-274d22bf71a6 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:36.601205 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46503447-dccc-4dd7-9cd5-274d22bf71a6 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:36.606336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc1e1a-2b05-4970-b7a2-405a970a784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:36.607052 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc1e1a-2b05-4970-b7a2-405a970a784a admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:36.607332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc1e1a-2b05-4970-b7a2-405a970a784a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:36.607637 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc1e1a-2b05-4970-b7a2-405a970a784a admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:36.608288 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc1e1a-2b05-4970-b7a2-405a970a784a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:36.609940 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc1e1a-2b05-4970-b7a2-405a970a784a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:36.623916 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1201/2376] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:53:36.628297 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc1e1a-2b05-4970-b7a2-405a970a784a admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:36.639689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc1e1a-2b05-4970-b7a2-405a970a784a admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:36.644759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa926f8-1be2-4793-8d87-488205284164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:36.645503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa926f8-1be2-4793-8d87-488205284164 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:36.645913 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa926f8-1be2-4793-8d87-488205284164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:36.646281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa926f8-1be2-4793-8d87-488205284164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:36.651584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa926f8-1be2-4793-8d87-488205284164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:36.651584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa926f8-1be2-4793-8d87-488205284164 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:36.664855 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1202/2377] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:53:36.670638 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa926f8-1be2-4793-8d87-488205284164 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:36.682513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa926f8-1be2-4793-8d87-488205284164 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:36.690354 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee169f0-dc35-444a-8206-f4440a156f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:36.691744 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee169f0-dc35-444a-8206-f4440a156f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:36.692223 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee169f0-dc35-444a-8206-f4440a156f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:36.692694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee169f0-dc35-444a-8206-f4440a156f5c admin admin] PATH_INFO: `/v3/projects/665f80b49fdc4174bf6a933bd6c2520d/users/df9b830d836849989a2ddaa4f9caf9b0/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:36.716605 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee169f0-dc35-444a-8206-f4440a156f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=665f80b49fdc4174bf6a933bd6c2520d, user_id=df9b830d836849989a2ddaa4f9caf9b0, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:36.719245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee169f0-dc35-444a-8206-f4440a156f5c admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:36.723187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:36.767093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f0c61bf1-75b8-4d7a-a0db-bdfe10838eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39c89dec6ffd4fda963b43549f365813'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:36.767828 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f0c61bf1-75b8-4d7a-a0db-bdfe10838eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39c89dec6ffd4fda963b43549f365813'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:36.775959 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f0c61bf1-75b8-4d7a-a0db-bdfe10838eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39c89dec6ffd4fda963b43549f365813'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:36.792516 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f0c61bf1-75b8-4d7a-a0db-bdfe10838eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39c89dec6ffd4fda963b43549f365813'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:36.794502 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-f0c61bf1-75b8-4d7a-a0db-bdfe10838eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39c89dec6ffd4fda963b43549f365813'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:36.868073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1203/2378] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:53:36 2022] PUT /identity/v3/projects/665f80b49fdc4174bf6a933bd6c2520d/users/df9b830d836849989a2ddaa4f9caf9b0/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:53:36.881631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea4c99-349a-44f1-af88-1755b8f3d119 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:36.881631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea4c99-349a-44f1-af88-1755b8f3d119 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:36.882883 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea4c99-349a-44f1-af88-1755b8f3d119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:36.907638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1176/2379] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:53:36 2022] DELETE /identity/v3/users/39c89dec6ffd4fda963b43549f365813 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:53:36.912941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed9fc0-940e-4bae-909f-3b657f1effdb None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:36.913343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed9fc0-940e-4bae-909f-3b657f1effdb None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:36.913682 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed9fc0-940e-4bae-909f-3b657f1effdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:36.924771 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8fea4c99-349a-44f1-af88-1755b8f3d119 None None] MFA Rules not processed for user `df9b830d836849989a2ddaa4f9caf9b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:36.926811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8fea4c99-349a-44f1-af88-1755b8f3d119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:36.942609 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-73ed9fc0-940e-4bae-909f-3b657f1effdb None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:36.945233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-73ed9fc0-940e-4bae-909f-3b657f1effdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:36.957081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:37.032028 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1204/2380] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:53:37.038004 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1177/2381] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:53:37.049927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea4c99-349a-44f1-af88-1755b8f3d119 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:37.050389 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed9fc0-940e-4bae-909f-3b657f1effdb None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:37.051569 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8fea4c99-349a-44f1-af88-1755b8f3d119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:37.051931 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-73ed9fc0-940e-4bae-909f-3b657f1effdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:37.134095 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea4c99-349a-44f1-af88-1755b8f3d119 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:37.139188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed9fc0-940e-4bae-909f-3b657f1effdb None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:37.141094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bd8b9-13a0-416b-8e5c-8504e02688db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:37.142120 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bd8b9-13a0-416b-8e5c-8504e02688db service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:37.142639 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bd8b9-13a0-416b-8e5c-8504e02688db service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:37.143124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bd8b9-13a0-416b-8e5c-8504e02688db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:37.143997 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23760ef7-2b71-48a7-a251-86671e63b53e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:37.144631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23760ef7-2b71-48a7-a251-86671e63b53e service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:37.144906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23760ef7-2b71-48a7-a251-86671e63b53e service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:37.145174 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23760ef7-2b71-48a7-a251-86671e63b53e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:37.155785 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23760ef7-2b71-48a7-a251-86671e63b53e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:37.157338 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23760ef7-2b71-48a7-a251-86671e63b53e service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:37.160155 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bd8b9-13a0-416b-8e5c-8504e02688db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:37.162220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bd8b9-13a0-416b-8e5c-8504e02688db service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:37.169300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1178/2382] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:53:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:53:37.178741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1205/2383] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:53:37.204117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23760ef7-2b71-48a7-a251-86671e63b53e service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:37.205880 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-23760ef7-2b71-48a7-a251-86671e63b53e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:37.224231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23760ef7-2b71-48a7-a251-86671e63b53e service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:37.229921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98b359-ea64-48c0-9821-11b660471ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:37.230688 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98b359-ea64-48c0-9821-11b660471ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:37.231207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98b359-ea64-48c0-9821-11b660471ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:37.231207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98b359-ea64-48c0-9821-11b660471ef5 admin admin] PATH_INFO: `/v3/users/df9b830d836849989a2ddaa4f9caf9b0` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:37.242826 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98b359-ea64-48c0-9821-11b660471ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9b830d836849989a2ddaa4f9caf9b0)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:37.242826 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98b359-ea64-48c0-9821-11b660471ef5 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:37.502367 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-6c98b359-ea64-48c0-9821-11b660471ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9b830d836849989a2ddaa4f9caf9b0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:37.503524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-6c98b359-ea64-48c0-9821-11b660471ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9b830d836849989a2ddaa4f9caf9b0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:37.511257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-6c98b359-ea64-48c0-9821-11b660471ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9b830d836849989a2ddaa4f9caf9b0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:37.526908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-6c98b359-ea64-48c0-9821-11b660471ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9b830d836849989a2ddaa4f9caf9b0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:37.527163 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-6c98b359-ea64-48c0-9821-11b660471ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9b830d836849989a2ddaa4f9caf9b0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:37.648776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1179/2384] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:53:37 2022] DELETE /identity/v3/users/df9b830d836849989a2ddaa4f9caf9b0 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:53:37.655248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71fa48-942d-4cec-92d5-5063a2e63310 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:37.655878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71fa48-942d-4cec-92d5-5063a2e63310 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:37.656413 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71fa48-942d-4cec-92d5-5063a2e63310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:37.685907 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-3d71fa48-942d-4cec-92d5-5063a2e63310 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:37.687412 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3d71fa48-942d-4cec-92d5-5063a2e63310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:37.692850 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98b359-ea64-48c0-9821-11b660471ef5 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:37.696862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-6c98b359-ea64-48c0-9821-11b660471ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:37.757908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:37.784633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1206/2385] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:53:37.798837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98b359-ea64-48c0-9821-11b660471ef5 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:37.803799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ea677-1cfd-4d4b-99ac-636cb0539bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:37.804471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ea677-1cfd-4d4b-99ac-636cb0539bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:37.804753 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ea677-1cfd-4d4b-99ac-636cb0539bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:37.805028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ea677-1cfd-4d4b-99ac-636cb0539bac admin admin] PATH_INFO: `/v3/projects/2f8e3d36c4084738ae6d5a2074e33191` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:37.806288 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ea677-1cfd-4d4b-99ac-636cb0539bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f8e3d36c4084738ae6d5a2074e33191)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:37.806424 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71fa48-942d-4cec-92d5-5063a2e63310 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:37.807927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3d71fa48-942d-4cec-92d5-5063a2e63310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:37.808302 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ea677-1cfd-4d4b-99ac-636cb0539bac admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:37.850597 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:37.896460 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71fa48-942d-4cec-92d5-5063a2e63310 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:37.903397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360dda4d-6946-4f03-b589-ae0e82254a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:37.904437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dda4d-6946-4f03-b589-ae0e82254a33 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:37.904905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dda4d-6946-4f03-b589-ae0e82254a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:37.905422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dda4d-6946-4f03-b589-ae0e82254a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:37.924455 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360dda4d-6946-4f03-b589-ae0e82254a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:37.926945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360dda4d-6946-4f03-b589-ae0e82254a33 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:37.946175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1207/2386] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:53:37.952420 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b21ea677-1cfd-4d4b-99ac-636cb0539bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f8e3d36c4084738ae6d5a2074e33191', 'request_id': 'req-b21ea677-1cfd-4d4b-99ac-636cb0539bac'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:38.019396 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b21ea677-1cfd-4d4b-99ac-636cb0539bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f8e3d36c4084738ae6d5a2074e33191', 'request_id': 'req-b21ea677-1cfd-4d4b-99ac-636cb0539bac'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:38.027998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b21ea677-1cfd-4d4b-99ac-636cb0539bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f8e3d36c4084738ae6d5a2074e33191', 'request_id': 'req-b21ea677-1cfd-4d4b-99ac-636cb0539bac'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:38.042288 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b21ea677-1cfd-4d4b-99ac-636cb0539bac admin admin] The token cache is being invalidate because project 2f8e3d36c4084738ae6d5a2074e33191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:53:38.042616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b21ea677-1cfd-4d4b-99ac-636cb0539bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:38.044243 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-b21ea677-1cfd-4d4b-99ac-636cb0539bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:38.046248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1180/2387] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:53:37 2022] DELETE /identity/v3/projects/2f8e3d36c4084738ae6d5a2074e33191 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:53:38.052928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb949a4-099f-4518-9ef4-8c515fdbc0c4 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:38.053527 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb949a4-099f-4518-9ef4-8c515fdbc0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:38.054320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb949a4-099f-4518-9ef4-8c515fdbc0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:38.087601 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-0fb949a4-099f-4518-9ef4-8c515fdbc0c4 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:38.091862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-0fb949a4-099f-4518-9ef4-8c515fdbc0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:38.192114 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1208/2388] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:53:38.205097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d120f-6fa1-4b60-a45c-48376a91cebf None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:38.205386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d120f-6fa1-4b60-a45c-48376a91cebf None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:38.205670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d120f-6fa1-4b60-a45c-48376a91cebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:38.234876 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-9c9d120f-6fa1-4b60-a45c-48376a91cebf None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:38.237736 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-9c9d120f-6fa1-4b60-a45c-48376a91cebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:38.251541 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1181/2389] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:53:38.257956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb949a4-099f-4518-9ef4-8c515fdbc0c4 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:38.271623 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb949a4-099f-4518-9ef4-8c515fdbc0c4 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:38.278712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faac579-5c4c-434d-8615-36178cbd1fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:38.279676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faac579-5c4c-434d-8615-36178cbd1fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:38.280388 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faac579-5c4c-434d-8615-36178cbd1fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:38.281137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faac579-5c4c-434d-8615-36178cbd1fa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:38.282560 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faac579-5c4c-434d-8615-36178cbd1fa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:53:38.283046 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faac579-5c4c-434d-8615-36178cbd1fa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:38.286524 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faac579-5c4c-434d-8615-36178cbd1fa0 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:38.303178 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1209/2390] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:53:38.316991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d120f-6fa1-4b60-a45c-48376a91cebf None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:38.332820 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d120f-6fa1-4b60-a45c-48376a91cebf None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:38.342103 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a91fbd-92a7-471b-bc47-fc295a0646fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:38.343064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a91fbd-92a7-471b-bc47-fc295a0646fd admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:38.346489 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a91fbd-92a7-471b-bc47-fc295a0646fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:38.346489 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a91fbd-92a7-471b-bc47-fc295a0646fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:38.346489 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a91fbd-92a7-471b-bc47-fc295a0646fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:38.348699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a91fbd-92a7-471b-bc47-fc295a0646fd admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:38.472673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1182/2391] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:53:38 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:53:38.476903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faac579-5c4c-434d-8615-36178cbd1fa0 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:38.488176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faac579-5c4c-434d-8615-36178cbd1fa0 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:38.552717 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878dc23-5e67-4657-8d31-8b6b05c6944e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:38.553330 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878dc23-5e67-4657-8d31-8b6b05c6944e admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:38.553611 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878dc23-5e67-4657-8d31-8b6b05c6944e admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:38.553887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878dc23-5e67-4657-8d31-8b6b05c6944e admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:38.554561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878dc23-5e67-4657-8d31-8b6b05c6944e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:38.556536 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878dc23-5e67-4657-8d31-8b6b05c6944e admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:38.569092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a91fbd-92a7-471b-bc47-fc295a0646fd admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:38.590959 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-15a91fbd-92a7-471b-bc47-fc295a0646fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:38.600689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a91fbd-92a7-471b-bc47-fc295a0646fd admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:38.606694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2a42a-fae8-4494-820f-837a42b2fff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:38.607861 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2a42a-fae8-4494-820f-837a42b2fff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:38.607861 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2a42a-fae8-4494-820f-837a42b2fff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:38.608155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2a42a-fae8-4494-820f-837a42b2fff7 admin admin] PATH_INFO: `/v3/projects/665f80b49fdc4174bf6a933bd6c2520d` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:38.610045 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2a42a-fae8-4494-820f-837a42b2fff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=665f80b49fdc4174bf6a933bd6c2520d)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:38.611142 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2a42a-fae8-4494-820f-837a42b2fff7 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:38.699882 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1210/2392] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:53:38 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:53:38.709683 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878dc23-5e67-4657-8d31-8b6b05c6944e admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:38.720892 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878dc23-5e67-4657-8d31-8b6b05c6944e admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:38.725889 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbc850-b09d-4887-a8aa-e1cb82f38193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:38.726442 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc850-b09d-4887-a8aa-e1cb82f38193 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:38.726722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc850-b09d-4887-a8aa-e1cb82f38193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:38.727027 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc850-b09d-4887-a8aa-e1cb82f38193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:38.727871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbc850-b09d-4887-a8aa-e1cb82f38193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:38.729482 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbc850-b09d-4887-a8aa-e1cb82f38193 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:38.741727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1211/2393] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:53:38.745748 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbc850-b09d-4887-a8aa-e1cb82f38193 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:38.757137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbc850-b09d-4887-a8aa-e1cb82f38193 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:38.763305 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97058490-2068-4daa-b9e6-9158286d1678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:38.764298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97058490-2068-4daa-b9e6-9158286d1678 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:38.764734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97058490-2068-4daa-b9e6-9158286d1678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:38.765013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97058490-2068-4daa-b9e6-9158286d1678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:38.765897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97058490-2068-4daa-b9e6-9158286d1678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:38.768358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97058490-2068-4daa-b9e6-9158286d1678 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:38.781055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1212/2394] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:53:38.785129 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97058490-2068-4daa-b9e6-9158286d1678 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:38.796368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97058490-2068-4daa-b9e6-9158286d1678 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:38.801192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184a2cc-c481-4d18-ac1b-b4ed9a475465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:38.801945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184a2cc-c481-4d18-ac1b-b4ed9a475465 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:38.803428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184a2cc-c481-4d18-ac1b-b4ed9a475465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:38.803428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184a2cc-c481-4d18-ac1b-b4ed9a475465 admin admin] PATH_INFO: `/v3/projects/3f9127487289425a8a0ce0d45e9d2f55/users/f87da15c2ff74c61b9312c47780a0da7/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:38.818511 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184a2cc-c481-4d18-ac1b-b4ed9a475465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9127487289425a8a0ce0d45e9d2f55, user_id=f87da15c2ff74c61b9312c47780a0da7, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:38.821184 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184a2cc-c481-4d18-ac1b-b4ed9a475465 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:38.976225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1213/2395] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:53:38 2022] PUT /identity/v3/projects/3f9127487289425a8a0ce0d45e9d2f55/users/f87da15c2ff74c61b9312c47780a0da7/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:53:38.987298 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-7cd2a42a-fae8-4494-820f-837a42b2fff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665f80b49fdc4174bf6a933bd6c2520d', 'request_id': 'req-7cd2a42a-fae8-4494-820f-837a42b2fff7'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:38.988155 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9985a2e-aa5a-485c-a332-d7fdaff05861 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:38.988450 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9985a2e-aa5a-485c-a332-d7fdaff05861 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:38.989383 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9985a2e-aa5a-485c-a332-d7fdaff05861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:38.999919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:39.024546 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-e9985a2e-aa5a-485c-a332-d7fdaff05861 None None] MFA Rules not processed for user `f87da15c2ff74c61b9312c47780a0da7`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:39.025530 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e9985a2e-aa5a-485c-a332-d7fdaff05861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:39.087883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-7cd2a42a-fae8-4494-820f-837a42b2fff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665f80b49fdc4174bf6a933bd6c2520d', 'request_id': 'req-7cd2a42a-fae8-4494-820f-837a42b2fff7'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:39.101725 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-7cd2a42a-fae8-4494-820f-837a42b2fff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665f80b49fdc4174bf6a933bd6c2520d', 'request_id': 'req-7cd2a42a-fae8-4494-820f-837a42b2fff7'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:39.115790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1214/2396] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:53:39.120788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-7cd2a42a-fae8-4494-820f-837a42b2fff7 admin admin] The token cache is being invalidate because project 665f80b49fdc4174bf6a933bd6c2520d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:53:39.120998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-7cd2a42a-fae8-4494-820f-837a42b2fff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:39.122370 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-7cd2a42a-fae8-4494-820f-837a42b2fff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:39.124165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1183/2397] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:53:38 2022] DELETE /identity/v3/projects/665f80b49fdc4174bf6a933bd6c2520d => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:53:39.128842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b97c17-866d-46dc-b165-a16e4468b66d None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:39.129323 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b97c17-866d-46dc-b165-a16e4468b66d None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:39.129752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b97c17-866d-46dc-b165-a16e4468b66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:39.131677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2a42a-fae8-4494-820f-837a42b2fff7 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:39.133335 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-7cd2a42a-fae8-4494-820f-837a42b2fff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:39.149261 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:39.155215 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-75b97c17-866d-46dc-b165-a16e4468b66d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:39.156485 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-75b97c17-866d-46dc-b165-a16e4468b66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:39.212194 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2a42a-fae8-4494-820f-837a42b2fff7 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:39.216343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649c897-0297-48a5-b2b2-0e81db5f4387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:39.216958 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649c897-0297-48a5-b2b2-0e81db5f4387 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:39.217275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649c897-0297-48a5-b2b2-0e81db5f4387 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:39.221139 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649c897-0297-48a5-b2b2-0e81db5f4387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:39.227186 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f649c897-0297-48a5-b2b2-0e81db5f4387 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:39.241206 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649c897-0297-48a5-b2b2-0e81db5f4387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:39.242867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649c897-0297-48a5-b2b2-0e81db5f4387 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:39.254667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1215/2398] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:53:39.264954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daffa4-44e1-438f-9b4b-46892a7cfc48 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:39.265380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daffa4-44e1-438f-9b4b-46892a7cfc48 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:39.265497 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daffa4-44e1-438f-9b4b-46892a7cfc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:39.270151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1184/2399] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:53:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:53:39.288665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-14daffa4-44e1-438f-9b4b-46892a7cfc48 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:39.290079 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-14daffa4-44e1-438f-9b4b-46892a7cfc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:39.299818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1216/2400] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:53:39.304552 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649c897-0297-48a5-b2b2-0e81db5f4387 service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:39.320316 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649c897-0297-48a5-b2b2-0e81db5f4387 service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:39.329966 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee78b5f-4ce6-4b1b-b9fd-4b13f4586c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:39.331001 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee78b5f-4ce6-4b1b-b9fd-4b13f4586c49 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:39.331455 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee78b5f-4ce6-4b1b-b9fd-4b13f4586c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:39.331776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee78b5f-4ce6-4b1b-b9fd-4b13f4586c49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:39.332894 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee78b5f-4ce6-4b1b-b9fd-4b13f4586c49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:53:39.333233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee78b5f-4ce6-4b1b-b9fd-4b13f4586c49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:39.335526 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee78b5f-4ce6-4b1b-b9fd-4b13f4586c49 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:39.357029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1185/2401] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:53:39.431166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14daffa4-44e1-438f-9b4b-46892a7cfc48 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:39.443941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14daffa4-44e1-438f-9b4b-46892a7cfc48 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:39.452237 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1685151-b3d8-415a-9136-02e4a095dfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:39.453039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1685151-b3d8-415a-9136-02e4a095dfa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:39.453475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1685151-b3d8-415a-9136-02e4a095dfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:39.454148 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1685151-b3d8-415a-9136-02e4a095dfa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:39.454900 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1685151-b3d8-415a-9136-02e4a095dfa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:39.457591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1685151-b3d8-415a-9136-02e4a095dfa6 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:39.502814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee78b5f-4ce6-4b1b-b9fd-4b13f4586c49 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:39.504944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-bee78b5f-4ce6-4b1b-b9fd-4b13f4586c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:39.574806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee78b5f-4ce6-4b1b-b9fd-4b13f4586c49 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:39.578953 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d290e7-12dd-417c-89de-3e3492c8cfe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:39.579968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d290e7-12dd-417c-89de-3e3492c8cfe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:39.580275 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d290e7-12dd-417c-89de-3e3492c8cfe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:39.580564 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d290e7-12dd-417c-89de-3e3492c8cfe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:39.583006 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c8d290e7-12dd-417c-89de-3e3492c8cfe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:39.589226 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1217/2402] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:53:39 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:53:39.594361 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1685151-b3d8-415a-9136-02e4a095dfa6 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:39.687528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d290e7-12dd-417c-89de-3e3492c8cfe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:39.687750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1685151-b3d8-415a-9136-02e4a095dfa6 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:39.689994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d290e7-12dd-417c-89de-3e3492c8cfe3 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:39.692863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbe344-6425-4a88-ad39-bb9823e41327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:39.693488 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbe344-6425-4a88-ad39-bb9823e41327 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:39.693765 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbe344-6425-4a88-ad39-bb9823e41327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:39.694036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbe344-6425-4a88-ad39-bb9823e41327 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:39.694674 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbe344-6425-4a88-ad39-bb9823e41327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:39.696933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbe344-6425-4a88-ad39-bb9823e41327 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:39.704212 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1186/2403] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:53:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:53:39.709071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:39.815004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1218/2404] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:53:39 2022] POST /identity/v3/users => generated 281 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:53:39.821134 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d290e7-12dd-417c-89de-3e3492c8cfe3 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:39.838590 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d290e7-12dd-417c-89de-3e3492c8cfe3 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:39.846701 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18946441-fb90-46ed-9e73-3db6ea336ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:39.847787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18946441-fb90-46ed-9e73-3db6ea336ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:39.848273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18946441-fb90-46ed-9e73-3db6ea336ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:39.848572 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18946441-fb90-46ed-9e73-3db6ea336ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:39.849742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18946441-fb90-46ed-9e73-3db6ea336ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:39.852872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18946441-fb90-46ed-9e73-3db6ea336ab5 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:39.870249 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1187/2405] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:53:39.875880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbe344-6425-4a88-ad39-bb9823e41327 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:39.894237 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbe344-6425-4a88-ad39-bb9823e41327 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:39.899284 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfb433-59bb-4097-9d89-8d50214f3abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:39.899955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfb433-59bb-4097-9d89-8d50214f3abe admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:39.900234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfb433-59bb-4097-9d89-8d50214f3abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:39.900503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfb433-59bb-4097-9d89-8d50214f3abe admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:39.901458 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfb433-59bb-4097-9d89-8d50214f3abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:39.902951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfb433-59bb-4097-9d89-8d50214f3abe admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:39.914748 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1219/2406] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:53:39.919238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18946441-fb90-46ed-9e73-3db6ea336ab5 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:39.929781 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18946441-fb90-46ed-9e73-3db6ea336ab5 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:39.935905 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb817c-df34-4765-b447-821f1b02dd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:39.936585 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb817c-df34-4765-b447-821f1b02dd6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:39.936873 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb817c-df34-4765-b447-821f1b02dd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:39.937216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb817c-df34-4765-b447-821f1b02dd6d admin admin] PATH_INFO: `/v3/projects/8fb15367ac094dbab966a3dd440a11e1/users/26c63fd9527a45f88f893a2666ef39e3/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:39.956213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb817c-df34-4765-b447-821f1b02dd6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb15367ac094dbab966a3dd440a11e1, user_id=26c63fd9527a45f88f893a2666ef39e3, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:39.959147 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb817c-df34-4765-b447-821f1b02dd6d admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:40.096828 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1188/2407] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:53:39 2022] PUT /identity/v3/projects/8fb15367ac094dbab966a3dd440a11e1/users/26c63fd9527a45f88f893a2666ef39e3/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:53:40.115019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8e1b4-2552-4ee1-ab05-b845463218bf None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:40.115605 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8e1b4-2552-4ee1-ab05-b845463218bf None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:40.115605 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8e1b4-2552-4ee1-ab05-b845463218bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:40.148920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f2c8e1b4-2552-4ee1-ab05-b845463218bf None None] MFA Rules not processed for user `26c63fd9527a45f88f893a2666ef39e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:40.150715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f2c8e1b4-2552-4ee1-ab05-b845463218bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:40.226843 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1220/2408] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:53:40.269862 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb817c-df34-4765-b447-821f1b02dd6d admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:40.310285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:40.365668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb817c-df34-4765-b447-821f1b02dd6d admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:40.369792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82630470-3791-492a-8897-9fa66a6096ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:40.370419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82630470-3791-492a-8897-9fa66a6096ef service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:40.370694 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82630470-3791-492a-8897-9fa66a6096ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:40.371738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82630470-3791-492a-8897-9fa66a6096ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:40.381543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82630470-3791-492a-8897-9fa66a6096ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:40.383702 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82630470-3791-492a-8897-9fa66a6096ef service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:40.398395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1189/2409] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:53:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:53:40.423421 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8e1b4-2552-4ee1-ab05-b845463218bf None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:40.550834 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8e1b4-2552-4ee1-ab05-b845463218bf None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:40.559717 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452f040-1a73-4d0b-8127-2db3d5bf90cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:40.561140 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452f040-1a73-4d0b-8127-2db3d5bf90cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:40.561646 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452f040-1a73-4d0b-8127-2db3d5bf90cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:40.562118 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452f040-1a73-4d0b-8127-2db3d5bf90cc admin admin] PATH_INFO: `/v3/users/26c63fd9527a45f88f893a2666ef39e3` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:40.564377 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452f040-1a73-4d0b-8127-2db3d5bf90cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=26c63fd9527a45f88f893a2666ef39e3)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:40.570028 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452f040-1a73-4d0b-8127-2db3d5bf90cc admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:40.813396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-a452f040-1a73-4d0b-8127-2db3d5bf90cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26c63fd9527a45f88f893a2666ef39e3'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:40.882302 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-a452f040-1a73-4d0b-8127-2db3d5bf90cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26c63fd9527a45f88f893a2666ef39e3'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:40.883123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-a452f040-1a73-4d0b-8127-2db3d5bf90cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26c63fd9527a45f88f893a2666ef39e3'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:40.883773 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-a452f040-1a73-4d0b-8127-2db3d5bf90cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26c63fd9527a45f88f893a2666ef39e3'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:40.894193 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-a452f040-1a73-4d0b-8127-2db3d5bf90cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26c63fd9527a45f88f893a2666ef39e3'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:40.905126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:40.916022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1221/2410] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:53:40 2022] DELETE /identity/v3/users/26c63fd9527a45f88f893a2666ef39e3 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:53:40.920879 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7cb80-1a41-4198-8c21-251d0de921b1 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:40.921487 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7cb80-1a41-4198-8c21-251d0de921b1 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:40.921487 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7cb80-1a41-4198-8c21-251d0de921b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:40.940953 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-d8d7cb80-1a41-4198-8c21-251d0de921b1 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:40.942208 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d8d7cb80-1a41-4198-8c21-251d0de921b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:41.017636 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1190/2411] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:53:41.034574 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452f040-1a73-4d0b-8127-2db3d5bf90cc admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:41.036002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a452f040-1a73-4d0b-8127-2db3d5bf90cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:41.105037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452f040-1a73-4d0b-8127-2db3d5bf90cc admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:41.109804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3560c-9f9a-403f-8801-bad9ee28406a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:41.110426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3560c-9f9a-403f-8801-bad9ee28406a service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:41.110707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3560c-9f9a-403f-8801-bad9ee28406a service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:41.110982 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3560c-9f9a-403f-8801-bad9ee28406a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:41.120943 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3560c-9f9a-403f-8801-bad9ee28406a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:41.123014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3560c-9f9a-403f-8801-bad9ee28406a service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:41.134057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1222/2412] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:53:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:53:41.787874 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7cb80-1a41-4198-8c21-251d0de921b1 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:41.789502 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d8d7cb80-1a41-4198-8c21-251d0de921b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:41.810993 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7cb80-1a41-4198-8c21-251d0de921b1 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:41.821397 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75061d-05f5-4b3e-a53b-5da8a80fed4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:41.822376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75061d-05f5-4b3e-a53b-5da8a80fed4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:41.823044 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75061d-05f5-4b3e-a53b-5da8a80fed4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:41.823660 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75061d-05f5-4b3e-a53b-5da8a80fed4f admin admin] PATH_INFO: `/v3/projects/8fb15367ac094dbab966a3dd440a11e1` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:41.827544 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75061d-05f5-4b3e-a53b-5da8a80fed4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fb15367ac094dbab966a3dd440a11e1)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:41.831920 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75061d-05f5-4b3e-a53b-5da8a80fed4f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:41.988378 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-fe75061d-05f5-4b3e-a53b-5da8a80fed4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fb15367ac094dbab966a3dd440a11e1', 'request_id': 'req-fe75061d-05f5-4b3e-a53b-5da8a80fed4f'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:42.133795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-fe75061d-05f5-4b3e-a53b-5da8a80fed4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fb15367ac094dbab966a3dd440a11e1', 'request_id': 'req-fe75061d-05f5-4b3e-a53b-5da8a80fed4f'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:42.147513 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-fe75061d-05f5-4b3e-a53b-5da8a80fed4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fb15367ac094dbab966a3dd440a11e1', 'request_id': 'req-fe75061d-05f5-4b3e-a53b-5da8a80fed4f'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:42.189963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-fe75061d-05f5-4b3e-a53b-5da8a80fed4f admin admin] The token cache is being invalidate because project 8fb15367ac094dbab966a3dd440a11e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:53:42.190263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-fe75061d-05f5-4b3e-a53b-5da8a80fed4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:42.191296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-fe75061d-05f5-4b3e-a53b-5da8a80fed4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:42.197667 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1191/2413] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:53:41 2022] DELETE /identity/v3/projects/8fb15367ac094dbab966a3dd440a11e1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:53:42.200203 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c940295-d968-4c13-a2e5-f4fcc0668991 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:42.200715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c940295-d968-4c13-a2e5-f4fcc0668991 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:42.201178 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c940295-d968-4c13-a2e5-f4fcc0668991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:42.238755 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-2c940295-d968-4c13-a2e5-f4fcc0668991 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:42.240945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2c940295-d968-4c13-a2e5-f4fcc0668991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:42.365845 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1223/2414] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:53:42.377867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75839-b295-479a-afa6-78738a7f74dd None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:42.378236 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75839-b295-479a-afa6-78738a7f74dd None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:42.378426 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d75839-b295-479a-afa6-78738a7f74dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:42.402015 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-70d75839-b295-479a-afa6-78738a7f74dd None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:42.403315 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-70d75839-b295-479a-afa6-78738a7f74dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:42.414110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1192/2415] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:53:42.420896 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c940295-d968-4c13-a2e5-f4fcc0668991 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:42.436500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c940295-d968-4c13-a2e5-f4fcc0668991 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:42.443282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b37a71-6232-4c96-a11a-86cecbb70f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:42.444196 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37a71-6232-4c96-a11a-86cecbb70f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:42.444582 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37a71-6232-4c96-a11a-86cecbb70f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:42.444945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37a71-6232-4c96-a11a-86cecbb70f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:42.445740 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b37a71-6232-4c96-a11a-86cecbb70f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:53:42.446156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b37a71-6232-4c96-a11a-86cecbb70f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:42.448444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b37a71-6232-4c96-a11a-86cecbb70f78 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:42.463241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1224/2416] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:53:42.489272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d75839-b295-479a-afa6-78738a7f74dd None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:42.508029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d75839-b295-479a-afa6-78738a7f74dd None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:42.518122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47007d39-d08a-4175-8c4a-0ff8fe46fdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:42.519175 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47007d39-d08a-4175-8c4a-0ff8fe46fdfd admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:42.519674 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47007d39-d08a-4175-8c4a-0ff8fe46fdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:42.521029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47007d39-d08a-4175-8c4a-0ff8fe46fdfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:42.522148 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47007d39-d08a-4175-8c4a-0ff8fe46fdfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:42.525864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47007d39-d08a-4175-8c4a-0ff8fe46fdfd admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:42.682396 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1193/2417] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:53:42 2022] POST /identity/v3/projects => generated 383 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:53:42.683451 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b37a71-6232-4c96-a11a-86cecbb70f78 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:42.696117 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b37a71-6232-4c96-a11a-86cecbb70f78 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:42.796822 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ee5c1-f2af-459f-ab32-86450f6f149a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:42.797866 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ee5c1-f2af-459f-ab32-86450f6f149a admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:42.798802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ee5c1-f2af-459f-ab32-86450f6f149a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:42.799294 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ee5c1-f2af-459f-ab32-86450f6f149a admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:42.800799 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ee5c1-f2af-459f-ab32-86450f6f149a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:42.804935 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ee5c1-f2af-459f-ab32-86450f6f149a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:42.930631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1225/2418] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:53:42 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:53:42.932656 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47007d39-d08a-4175-8c4a-0ff8fe46fdfd admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:42.951903 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47007d39-d08a-4175-8c4a-0ff8fe46fdfd admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:42.965069 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd92b68-2ce3-429f-9ca8-0b24f3c43e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:42.966225 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd92b68-2ce3-429f-9ca8-0b24f3c43e23 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:42.967046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd92b68-2ce3-429f-9ca8-0b24f3c43e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:42.968412 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd92b68-2ce3-429f-9ca8-0b24f3c43e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:42.969845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd92b68-2ce3-429f-9ca8-0b24f3c43e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:42.975108 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd92b68-2ce3-429f-9ca8-0b24f3c43e23 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:42.998586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1194/2419] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:53:43.003264 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ee5c1-f2af-459f-ab32-86450f6f149a admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:43.016914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ee5c1-f2af-459f-ab32-86450f6f149a admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:43.022832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661330b-3344-4a63-aa46-ab901e8b6837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:43.023452 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661330b-3344-4a63-aa46-ab901e8b6837 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:43.023779 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661330b-3344-4a63-aa46-ab901e8b6837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:43.024096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661330b-3344-4a63-aa46-ab901e8b6837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:43.024781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661330b-3344-4a63-aa46-ab901e8b6837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:43.026589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661330b-3344-4a63-aa46-ab901e8b6837 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:43.036545 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:43.046072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1226/2420] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:53:43.051144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd92b68-2ce3-429f-9ca8-0b24f3c43e23 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:43.063066 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:43.076120 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd92b68-2ce3-429f-9ca8-0b24f3c43e23 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:43.082818 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967e24c-7365-4317-8a40-10381694d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:43.083943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e24c-7365-4317-8a40-10381694d1a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:43.084378 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e24c-7365-4317-8a40-10381694d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:43.084848 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e24c-7365-4317-8a40-10381694d1a3 admin admin] PATH_INFO: `/v3/projects/aa402cafeb1e4f5a9e13497cfc4f2032/users/47d11a6f8606484a963407a88fb92b03/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:43.125403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967e24c-7365-4317-8a40-10381694d1a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa402cafeb1e4f5a9e13497cfc4f2032, user_id=47d11a6f8606484a963407a88fb92b03, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:43.131532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967e24c-7365-4317-8a40-10381694d1a3 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:43.279967 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1195/2421] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:53:43 2022] PUT /identity/v3/projects/aa402cafeb1e4f5a9e13497cfc4f2032/users/47d11a6f8606484a963407a88fb92b03/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:53:43.284537 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680230a-a976-49f9-9bcd-aebd50c95fa9 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:43.285097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680230a-a976-49f9-9bcd-aebd50c95fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:43.285097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680230a-a976-49f9-9bcd-aebd50c95fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:43.384088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8680230a-a976-49f9-9bcd-aebd50c95fa9 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:43.386499 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8680230a-a976-49f9-9bcd-aebd50c95fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:43.693036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1227/2422] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:53:43.705035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967e24c-7365-4317-8a40-10381694d1a3 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:43.713013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0967e24c-7365-4317-8a40-10381694d1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:43.875252 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967e24c-7365-4317-8a40-10381694d1a3 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:43.894486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91a19d-97c1-414f-b953-6cb918855a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:43.895128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91a19d-97c1-414f-b953-6cb918855a27 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:43.895605 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91a19d-97c1-414f-b953-6cb918855a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:43.895882 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91a19d-97c1-414f-b953-6cb918855a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:43.917519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91a19d-97c1-414f-b953-6cb918855a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:43.920000 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91a19d-97c1-414f-b953-6cb918855a27 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:43.935973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1196/2423] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:53:46.069981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544911f-8708-41cf-9d6e-f3949d2ccfa6 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:46.069981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544911f-8708-41cf-9d6e-f3949d2ccfa6 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:46.069981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544911f-8708-41cf-9d6e-f3949d2ccfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:46.118787 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8544911f-8708-41cf-9d6e-f3949d2ccfa6 None None] MFA Rules not processed for user `47d11a6f8606484a963407a88fb92b03`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:46.120570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8544911f-8708-41cf-9d6e-f3949d2ccfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:46.406061 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1228/2424] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:53:46.421706 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91a19d-97c1-414f-b953-6cb918855a27 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:46.426514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-6b91a19d-97c1-414f-b953-6cb918855a27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:46.597682 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91a19d-97c1-414f-b953-6cb918855a27 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:46.602878 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ba3d5-043a-4e81-a23d-1fd6b1c60cf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:46.603760 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ba3d5-043a-4e81-a23d-1fd6b1c60cf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:46.604143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ba3d5-043a-4e81-a23d-1fd6b1c60cf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:46.604518 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ba3d5-043a-4e81-a23d-1fd6b1c60cf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:46.616285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ba3d5-043a-4e81-a23d-1fd6b1c60cf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:46.617982 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ba3d5-043a-4e81-a23d-1fd6b1c60cf4 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:46.632533 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1197/2425] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:53:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:53:48.763599 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d084648-ea1e-4a5d-81e5-9d6001a40c1f None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:48.765372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d084648-ea1e-4a5d-81e5-9d6001a40c1f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:48.765372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d084648-ea1e-4a5d-81e5-9d6001a40c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:48.795802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-7d084648-ea1e-4a5d-81e5-9d6001a40c1f None None] MFA Rules not processed for user `47d11a6f8606484a963407a88fb92b03`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:48.798306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7d084648-ea1e-4a5d-81e5-9d6001a40c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:48.817276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1229/2426] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:53:54.580078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ba3d5-043a-4e81-a23d-1fd6b1c60cf4 service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:54.582141 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f81ba3d5-043a-4e81-a23d-1fd6b1c60cf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:54.603359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ba3d5-043a-4e81-a23d-1fd6b1c60cf4 service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:54.610258 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befbf8c-398b-426e-85a2-5af332524960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:54.611199 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befbf8c-398b-426e-85a2-5af332524960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:54.611757 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befbf8c-398b-426e-85a2-5af332524960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:54.612657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befbf8c-398b-426e-85a2-5af332524960 admin admin] PATH_INFO: `/v3/users/f87da15c2ff74c61b9312c47780a0da7` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:54.614971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befbf8c-398b-426e-85a2-5af332524960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f87da15c2ff74c61b9312c47780a0da7)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:54.618250 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befbf8c-398b-426e-85a2-5af332524960 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:54.901430 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8befbf8c-398b-426e-85a2-5af332524960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f87da15c2ff74c61b9312c47780a0da7'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:54.910645 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8befbf8c-398b-426e-85a2-5af332524960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f87da15c2ff74c61b9312c47780a0da7'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:54.916129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8befbf8c-398b-426e-85a2-5af332524960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f87da15c2ff74c61b9312c47780a0da7'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:54.939156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8befbf8c-398b-426e-85a2-5af332524960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f87da15c2ff74c61b9312c47780a0da7'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:54.940649 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8befbf8c-398b-426e-85a2-5af332524960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f87da15c2ff74c61b9312c47780a0da7'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:54.946047 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:55.024281 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1198/2427] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:53:54 2022] DELETE /identity/v3/users/f87da15c2ff74c61b9312c47780a0da7 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:53:55.031088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657a69d-1307-4854-a9a2-605253bfcc57 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:55.031701 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657a69d-1307-4854-a9a2-605253bfcc57 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:55.032083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657a69d-1307-4854-a9a2-605253bfcc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:55.064769 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-5657a69d-1307-4854-a9a2-605253bfcc57 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:55.066450 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5657a69d-1307-4854-a9a2-605253bfcc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:55.191530 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1230/2428] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:53:55.201393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befbf8c-398b-426e-85a2-5af332524960 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:55.203124 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-8befbf8c-398b-426e-85a2-5af332524960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:55.304755 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befbf8c-398b-426e-85a2-5af332524960 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:55.311579 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9744fac-2eb1-426d-8a64-bd364cb6078f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:55.312232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9744fac-2eb1-426d-8a64-bd364cb6078f service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:55.313986 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9744fac-2eb1-426d-8a64-bd364cb6078f service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:55.314559 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9744fac-2eb1-426d-8a64-bd364cb6078f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:55.343807 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9744fac-2eb1-426d-8a64-bd364cb6078f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:55.347023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9744fac-2eb1-426d-8a64-bd364cb6078f service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:55.367394 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1199/2429] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:53:56.273381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657a69d-1307-4854-a9a2-605253bfcc57 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:56.278323 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5657a69d-1307-4854-a9a2-605253bfcc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:56.288317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657a69d-1307-4854-a9a2-605253bfcc57 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:56.307503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f796f49-0068-435c-8a21-6b03b49032c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:56.307503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f796f49-0068-435c-8a21-6b03b49032c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:56.307764 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f796f49-0068-435c-8a21-6b03b49032c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:56.308051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f796f49-0068-435c-8a21-6b03b49032c5 admin admin] PATH_INFO: `/v3/projects/3f9127487289425a8a0ce0d45e9d2f55` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:56.310174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f796f49-0068-435c-8a21-6b03b49032c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f9127487289425a8a0ce0d45e9d2f55)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:56.312163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f796f49-0068-435c-8a21-6b03b49032c5 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:56.347973 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:56.524458 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-0f796f49-0068-435c-8a21-6b03b49032c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9127487289425a8a0ce0d45e9d2f55', 'request_id': 'req-0f796f49-0068-435c-8a21-6b03b49032c5'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:56.532279 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-0f796f49-0068-435c-8a21-6b03b49032c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9127487289425a8a0ce0d45e9d2f55', 'request_id': 'req-0f796f49-0068-435c-8a21-6b03b49032c5'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:56.670484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-0f796f49-0068-435c-8a21-6b03b49032c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9127487289425a8a0ce0d45e9d2f55', 'request_id': 'req-0f796f49-0068-435c-8a21-6b03b49032c5'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:56.681242 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-0f796f49-0068-435c-8a21-6b03b49032c5 admin admin] The token cache is being invalidate because project 3f9127487289425a8a0ce0d45e9d2f55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:53:56.681528 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-0f796f49-0068-435c-8a21-6b03b49032c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:56.682326 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-0f796f49-0068-435c-8a21-6b03b49032c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:53:56.684405 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1231/2430] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:53:56 2022] DELETE /identity/v3/projects/3f9127487289425a8a0ce0d45e9d2f55 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:53:56.689498 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350a1a6-cd20-4a04-8064-e63f7a706bac None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:56.690023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350a1a6-cd20-4a04-8064-e63f7a706bac None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:56.690023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350a1a6-cd20-4a04-8064-e63f7a706bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:56.709689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-5350a1a6-cd20-4a04-8064-e63f7a706bac None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:56.710792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-5350a1a6-cd20-4a04-8064-e63f7a706bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:56.773723 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1200/2431] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:53:56.782435 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40fd42-59f0-4ff7-bc76-f5bb9a02adfe None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:56.782796 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40fd42-59f0-4ff7-bc76-f5bb9a02adfe None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:56.783181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40fd42-59f0-4ff7-bc76-f5bb9a02adfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:56.804503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-2e40fd42-59f0-4ff7-bc76-f5bb9a02adfe None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:56.805772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2e40fd42-59f0-4ff7-bc76-f5bb9a02adfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:56.814955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1232/2432] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:53:56.819331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350a1a6-cd20-4a04-8064-e63f7a706bac None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:56.831318 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350a1a6-cd20-4a04-8064-e63f7a706bac None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:56.837226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043cedc-2a97-4f7a-96b5-24ac0acc63e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:56.838024 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043cedc-2a97-4f7a-96b5-24ac0acc63e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:56.843918 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043cedc-2a97-4f7a-96b5-24ac0acc63e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:56.843918 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043cedc-2a97-4f7a-96b5-24ac0acc63e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:56.843918 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043cedc-2a97-4f7a-96b5-24ac0acc63e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:53:56.843918 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043cedc-2a97-4f7a-96b5-24ac0acc63e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:56.843918 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043cedc-2a97-4f7a-96b5-24ac0acc63e0 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:56.861243 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1201/2433] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:53:56.863685 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40fd42-59f0-4ff7-bc76-f5bb9a02adfe None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:56.875380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40fd42-59f0-4ff7-bc76-f5bb9a02adfe None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:56.881702 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e90e0-1436-4043-98e7-e89b6386d856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:56.882453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e90e0-1436-4043-98e7-e89b6386d856 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:56.882919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e90e0-1436-4043-98e7-e89b6386d856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:56.883299 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e90e0-1436-4043-98e7-e89b6386d856 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:56.884079 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e90e0-1436-4043-98e7-e89b6386d856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:56.886330 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e90e0-1436-4043-98e7-e89b6386d856 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:56.990676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1233/2434] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:53:56 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:53:56.991890 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043cedc-2a97-4f7a-96b5-24ac0acc63e0 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:57.003829 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043cedc-2a97-4f7a-96b5-24ac0acc63e0 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:57.072326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5a239-f73f-446b-b5c0-e68dbc1eb3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:57.072942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5a239-f73f-446b-b5c0-e68dbc1eb3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:57.073221 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5a239-f73f-446b-b5c0-e68dbc1eb3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:57.073542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5a239-f73f-446b-b5c0-e68dbc1eb3e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:57.074238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5a239-f73f-446b-b5c0-e68dbc1eb3e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:57.076377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5a239-f73f-446b-b5c0-e68dbc1eb3e0 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:57.375424 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1202/2435] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:53:56 2022] POST /identity/v3/users => generated 287 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:53:57.379130 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e90e0-1436-4043-98e7-e89b6386d856 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:57.390554 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e90e0-1436-4043-98e7-e89b6386d856 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:57.395776 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efd530-26e4-4e9b-b6e7-573d28baeeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:57.396390 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efd530-26e4-4e9b-b6e7-573d28baeeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:57.396668 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efd530-26e4-4e9b-b6e7-573d28baeeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:57.397051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efd530-26e4-4e9b-b6e7-573d28baeeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:57.397698 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efd530-26e4-4e9b-b6e7-573d28baeeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:57.399333 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efd530-26e4-4e9b-b6e7-573d28baeeb1 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:57.410902 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1234/2436] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:53:57.415104 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5a239-f73f-446b-b5c0-e68dbc1eb3e0 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:57.457980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5a239-f73f-446b-b5c0-e68dbc1eb3e0 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:57.457980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019fa21-eff7-4ecd-9ada-048459406412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:57.457980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019fa21-eff7-4ecd-9ada-048459406412 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:57.457980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019fa21-eff7-4ecd-9ada-048459406412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:57.458437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019fa21-eff7-4ecd-9ada-048459406412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:57.458437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019fa21-eff7-4ecd-9ada-048459406412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:57.458437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019fa21-eff7-4ecd-9ada-048459406412 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:57.458437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1203/2437] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:53:57.460946 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efd530-26e4-4e9b-b6e7-573d28baeeb1 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:57.472612 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efd530-26e4-4e9b-b6e7-573d28baeeb1 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:57.477298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d7f2f-53dc-4aba-8591-a14ae49d37c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:57.477959 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d7f2f-53dc-4aba-8591-a14ae49d37c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:57.478240 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d7f2f-53dc-4aba-8591-a14ae49d37c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:57.478509 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d7f2f-53dc-4aba-8591-a14ae49d37c4 admin admin] PATH_INFO: `/v3/projects/dc36b3aba4fa4ad9bb26dfd87d95746c/users/542387948a8a4642acd2d4736acc854c/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:57.495336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d7f2f-53dc-4aba-8591-a14ae49d37c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc36b3aba4fa4ad9bb26dfd87d95746c, user_id=542387948a8a4642acd2d4736acc854c, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:57.498692 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d7f2f-53dc-4aba-8591-a14ae49d37c4 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:57.599321 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1235/2438] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:53:57 2022] PUT /identity/v3/projects/dc36b3aba4fa4ad9bb26dfd87d95746c/users/542387948a8a4642acd2d4736acc854c/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:53:57.610117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae2784-3d18-42a6-9514-30e545e26b74 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:57.611253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae2784-3d18-42a6-9514-30e545e26b74 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:57.611253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae2784-3d18-42a6-9514-30e545e26b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:57.623081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:53:57.645294 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-45ae2784-3d18-42a6-9514-30e545e26b74 None None] MFA Rules not processed for user `542387948a8a4642acd2d4736acc854c`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:57.646573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-45ae2784-3d18-42a6-9514-30e545e26b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:57.714947 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1204/2439] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:53:57.725761 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d7f2f-53dc-4aba-8591-a14ae49d37c4 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:53:57.727509 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-249d7f2f-53dc-4aba-8591-a14ae49d37c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:57.791756 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d7f2f-53dc-4aba-8591-a14ae49d37c4 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:53:57.795999 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66018b-7c27-4fd0-8a40-b9efa460fba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:53:57.796695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66018b-7c27-4fd0-8a40-b9efa460fba0 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:57.796969 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66018b-7c27-4fd0-8a40-b9efa460fba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:57.797239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66018b-7c27-4fd0-8a40-b9efa460fba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:57.809266 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66018b-7c27-4fd0-8a40-b9efa460fba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:53:57.813309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66018b-7c27-4fd0-8a40-b9efa460fba0 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:53:57.827088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1236/2440] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:53:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:53:59.773417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1bf28-6d2b-4c8d-903b-af3cb8620438 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:53:59.773938 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1bf28-6d2b-4c8d-903b-af3cb8620438 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:53:59.773938 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1bf28-6d2b-4c8d-903b-af3cb8620438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:53:59.798081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-2da1bf28-6d2b-4c8d-903b-af3cb8620438 None None] MFA Rules not processed for user `542387948a8a4642acd2d4736acc854c`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:53:59.799333 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2da1bf28-6d2b-4c8d-903b-af3cb8620438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:53:59.809236 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1205/2441] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:53:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:54:02.238385 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c4ed7-b549-4ae9-aed4-cce4d5823c20 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:02.238957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c4ed7-b549-4ae9-aed4-cce4d5823c20 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:02.239938 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c4ed7-b549-4ae9-aed4-cce4d5823c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:02.263091 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-fb3c4ed7-b549-4ae9-aed4-cce4d5823c20 None None] MFA Rules not processed for user `7a3f8b78523e4c3790b049fc783c96fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:54:02.264707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-fb3c4ed7-b549-4ae9-aed4-cce4d5823c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:02.322468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:54:02.344268 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1237/2442] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:54:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:54:09.790012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=33 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:54:11.202567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00860912-cdda-40f9-a527-c6f8fdefff81 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:11.203244 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00860912-cdda-40f9-a527-c6f8fdefff81 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:11.203244 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00860912-cdda-40f9-a527-c6f8fdefff81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:11.225751 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-00860912-cdda-40f9-a527-c6f8fdefff81 None None] MFA Rules not processed for user `7dc367b3f3e04ec48665feef4094715a`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:54:11.227356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-00860912-cdda-40f9-a527-c6f8fdefff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:11.298997 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1206/2443] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:54:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:54:13.053126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=4 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:54:21.283757 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=25 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:54:26.725727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff25a4-70c1-4845-902b-28ac656dc374 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:26.726358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff25a4-70c1-4845-902b-28ac656dc374 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:26.726684 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff25a4-70c1-4845-902b-28ac656dc374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:26.747761 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-04ff25a4-70c1-4845-902b-28ac656dc374 None None] MFA Rules not processed for user `87ba67fc171b4258b6fda72094ed11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:54:26.749024 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-04ff25a4-70c1-4845-902b-28ac656dc374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:26.812832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1238/2444] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Sep 7 16:54:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:54:26.875845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00860912-cdda-40f9-a527-c6f8fdefff81 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:54:26.878234 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-00860912-cdda-40f9-a527-c6f8fdefff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:26.968032 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00860912-cdda-40f9-a527-c6f8fdefff81 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:54:26.973183 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f88f9-92a1-46c4-81a9-2bb859228a46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56cd868e866d436aa1d601f7791e812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:54:26.973820 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f88f9-92a1-46c4-81a9-2bb859228a46 service swift] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:26.974094 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f88f9-92a1-46c4-81a9-2bb859228a46 service swift] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:26.974371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f88f9-92a1-46c4-81a9-2bb859228a46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:26.983529 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f88f9-92a1-46c4-81a9-2bb859228a46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:54:26.985131 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f88f9-92a1-46c4-81a9-2bb859228a46 service swift] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:54:26.993915 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1207/2445] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Sep 7 16:54:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:54:28.301145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74092c62-81dc-430a-a844-638dd60efb66 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:28.306754 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74092c62-81dc-430a-a844-638dd60efb66 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:28.306754 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74092c62-81dc-430a-a844-638dd60efb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:28.341236 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-74092c62-81dc-430a-a844-638dd60efb66 None None] MFA Rules not processed for user `87ba67fc171b4258b6fda72094ed11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:54:28.343524 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-74092c62-81dc-430a-a844-638dd60efb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:28.354951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1239/2446] 10.222.0.25 () {58 vars in 967 bytes} [Wed Sep 7 16:54:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:54:28.377214 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f88f9-92a1-46c4-81a9-2bb859228a46 service swift] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:54:28.396911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f88f9-92a1-46c4-81a9-2bb859228a46 service swift] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:54:28.405289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30c514-8bed-40cb-a37f-45afa533dc73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56cd868e866d436aa1d601f7791e812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:54:28.406198 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30c514-8bed-40cb-a37f-45afa533dc73 service swift] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:28.406711 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30c514-8bed-40cb-a37f-45afa533dc73 service swift] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:28.407376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30c514-8bed-40cb-a37f-45afa533dc73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:28.420072 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30c514-8bed-40cb-a37f-45afa533dc73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:54:28.422732 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30c514-8bed-40cb-a37f-45afa533dc73 service swift] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:54:28.435248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1208/2447] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Sep 7 16:54:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:54:29.261188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c66b5-380b-4fb0-aa2a-db4a53c47f2a None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:29.261469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c66b5-380b-4fb0-aa2a-db4a53c47f2a None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:29.261935 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c66b5-380b-4fb0-aa2a-db4a53c47f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:29.283232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-c91c66b5-380b-4fb0-aa2a-db4a53c47f2a None None] MFA Rules not processed for user `87ba67fc171b4258b6fda72094ed11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:54:29.284499 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c91c66b5-380b-4fb0-aa2a-db4a53c47f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:29.291772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1240/2448] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Sep 7 16:54:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:54:29.305315 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30c514-8bed-40cb-a37f-45afa533dc73 service swift] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:54:29.317446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30c514-8bed-40cb-a37f-45afa533dc73 service swift] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:54:29.325035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0101ad3-44e1-49d8-b550-b406ae721239 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56cd868e866d436aa1d601f7791e812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:54:29.325713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0101ad3-44e1-49d8-b550-b406ae721239 service swift] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:29.326003 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0101ad3-44e1-49d8-b550-b406ae721239 service swift] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:29.326290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0101ad3-44e1-49d8-b550-b406ae721239 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:29.336942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0101ad3-44e1-49d8-b550-b406ae721239 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:54:29.340019 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0101ad3-44e1-49d8-b550-b406ae721239 service swift] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:54:29.355198 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1209/2449] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Sep 7 16:54:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 16:54:29.473230 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641450d-a060-4969-82fa-aaf7a91b028c None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:29.473230 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641450d-a060-4969-82fa-aaf7a91b028c None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:29.473974 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641450d-a060-4969-82fa-aaf7a91b028c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:29.501653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-2641450d-a060-4969-82fa-aaf7a91b028c None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:54:29.503719 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2641450d-a060-4969-82fa-aaf7a91b028c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:29.582949 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1241/2450] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Sep 7 16:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:54:29.599106 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0101ad3-44e1-49d8-b550-b406ae721239 service swift] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:54:29.600698 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d0101ad3-44e1-49d8-b550-b406ae721239 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:29.717019 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0101ad3-44e1-49d8-b550-b406ae721239 service swift] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:54:29.727973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d940de8-d8cb-41f4-a2b5-f2a851ba0153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:54:29.730289 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d940de8-d8cb-41f4-a2b5-f2a851ba0153 service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:29.730966 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d940de8-d8cb-41f4-a2b5-f2a851ba0153 service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:29.731509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d940de8-d8cb-41f4-a2b5-f2a851ba0153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:29.750032 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d940de8-d8cb-41f4-a2b5-f2a851ba0153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:54:29.770882 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d940de8-d8cb-41f4-a2b5-f2a851ba0153 service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:54:29.770882 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1210/2451] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:54:30.285973 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaca686-2e2f-4d0b-8962-b59da49d41df None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:30.286463 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaca686-2e2f-4d0b-8962-b59da49d41df None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:30.286667 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaca686-2e2f-4d0b-8962-b59da49d41df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:30.309024 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-caaca686-2e2f-4d0b-8962-b59da49d41df None None] MFA Rules not processed for user `87ba67fc171b4258b6fda72094ed11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:54:30.310258 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-caaca686-2e2f-4d0b-8962-b59da49d41df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:30.318329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1242/2452] 10.222.0.25 () {58 vars in 967 bytes} [Wed Sep 7 16:54:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:54:30.335780 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d940de8-d8cb-41f4-a2b5-f2a851ba0153 service nova] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:54:30.349702 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d940de8-d8cb-41f4-a2b5-f2a851ba0153 service nova] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:54:30.355765 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee896eba-9521-4cf8-899c-56ae3e76c9aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56cd868e866d436aa1d601f7791e812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:54:30.356401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee896eba-9521-4cf8-899c-56ae3e76c9aa service swift] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:30.356681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee896eba-9521-4cf8-899c-56ae3e76c9aa service swift] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:30.356960 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee896eba-9521-4cf8-899c-56ae3e76c9aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:30.372690 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee896eba-9521-4cf8-899c-56ae3e76c9aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:54:30.374492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee896eba-9521-4cf8-899c-56ae3e76c9aa service swift] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:54:30.384022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1211/2453] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Sep 7 16:54:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:54:33.446929 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaca686-2e2f-4d0b-8962-b59da49d41df None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:54:33.461386 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaca686-2e2f-4d0b-8962-b59da49d41df None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:54:33.471767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b12d6-a6b4-49cf-ba87-579ccfa8d550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:54:33.472470 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b12d6-a6b4-49cf-ba87-579ccfa8d550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:33.472752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b12d6-a6b4-49cf-ba87-579ccfa8d550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:33.473026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b12d6-a6b4-49cf-ba87-579ccfa8d550 admin admin] PATH_INFO: `/v3/users/542387948a8a4642acd2d4736acc854c` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:33.474466 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b12d6-a6b4-49cf-ba87-579ccfa8d550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=542387948a8a4642acd2d4736acc854c)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:54:33.482100 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b12d6-a6b4-49cf-ba87-579ccfa8d550 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:54:33.786225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-cf9b12d6-a6b4-49cf-ba87-579ccfa8d550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542387948a8a4642acd2d4736acc854c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:54:33.846252 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37957f3-eff3-4c0f-ac1c-e8410fe8c5bc None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:33.847027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37957f3-eff3-4c0f-ac1c-e8410fe8c5bc None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:33.847242 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37957f3-eff3-4c0f-ac1c-e8410fe8c5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:33.866249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-cf9b12d6-a6b4-49cf-ba87-579ccfa8d550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542387948a8a4642acd2d4736acc854c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:54:33.867114 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-cf9b12d6-a6b4-49cf-ba87-579ccfa8d550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542387948a8a4642acd2d4736acc854c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:54:33.868175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-cf9b12d6-a6b4-49cf-ba87-579ccfa8d550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542387948a8a4642acd2d4736acc854c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:54:33.879522 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-cf9b12d6-a6b4-49cf-ba87-579ccfa8d550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542387948a8a4642acd2d4736acc854c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:54:33.882779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-d37957f3-eff3-4c0f-ac1c-e8410fe8c5bc None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:54:33.884981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d37957f3-eff3-4c0f-ac1c-e8410fe8c5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:33.900285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1212/2454] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Sep 7 16:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:54:33.904561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:54:33.911907 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1243/2455] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:54:33 2022] DELETE /identity/v3/users/542387948a8a4642acd2d4736acc854c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:54:33.921141 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbd0b1-ac61-4930-ba6d-9da3a1829a5f None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:33.921477 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbd0b1-ac61-4930-ba6d-9da3a1829a5f None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:33.922058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbd0b1-ac61-4930-ba6d-9da3a1829a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:33.922991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b12d6-a6b4-49cf-ba87-579ccfa8d550 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:54:33.924550 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-cf9b12d6-a6b4-49cf-ba87-579ccfa8d550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:33.955939 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-0ddbd0b1-ac61-4930-ba6d-9da3a1829a5f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:54:33.958187 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0ddbd0b1-ac61-4930-ba6d-9da3a1829a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:34.001904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:54:34.064259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1213/2456] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:54:34.064868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b12d6-a6b4-49cf-ba87-579ccfa8d550 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:54:34.075287 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d36cb-949b-4283-a423-03b6439cd2ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:54:34.076081 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d36cb-949b-4283-a423-03b6439cd2ce service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:34.076468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d36cb-949b-4283-a423-03b6439cd2ce service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:34.076946 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d36cb-949b-4283-a423-03b6439cd2ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:34.088762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d36cb-949b-4283-a423-03b6439cd2ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:54:34.092015 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbd0b1-ac61-4930-ba6d-9da3a1829a5f None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:54:34.094098 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0ddbd0b1-ac61-4930-ba6d-9da3a1829a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:34.096817 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d36cb-949b-4283-a423-03b6439cd2ce service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:54:34.109582 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1244/2457] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:54:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:54:34.190320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbd0b1-ac61-4930-ba6d-9da3a1829a5f None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:54:34.194562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019eea85-443d-4cfa-ac0a-0cbc005a1170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:54:34.195201 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019eea85-443d-4cfa-ac0a-0cbc005a1170 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:34.195512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019eea85-443d-4cfa-ac0a-0cbc005a1170 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:34.195778 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019eea85-443d-4cfa-ac0a-0cbc005a1170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:34.207145 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019eea85-443d-4cfa-ac0a-0cbc005a1170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:54:34.208622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019eea85-443d-4cfa-ac0a-0cbc005a1170 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:54:34.219854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1214/2458] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:54:34.559242 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d36cb-949b-4283-a423-03b6439cd2ce service nova] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:54:34.561784 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-713d36cb-949b-4283-a423-03b6439cd2ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:34.591627 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d36cb-949b-4283-a423-03b6439cd2ce service nova] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:54:34.600013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294dd0e-2215-4da3-9b50-b471c07344d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:54:34.601003 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294dd0e-2215-4da3-9b50-b471c07344d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:34.601410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294dd0e-2215-4da3-9b50-b471c07344d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:34.601808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294dd0e-2215-4da3-9b50-b471c07344d7 admin admin] PATH_INFO: `/v3/projects/dc36b3aba4fa4ad9bb26dfd87d95746c` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:34.603797 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294dd0e-2215-4da3-9b50-b471c07344d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc36b3aba4fa4ad9bb26dfd87d95746c)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:54:34.608252 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294dd0e-2215-4da3-9b50-b471c07344d7 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:54:34.784518 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f294dd0e-2215-4da3-9b50-b471c07344d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc36b3aba4fa4ad9bb26dfd87d95746c', 'request_id': 'req-f294dd0e-2215-4da3-9b50-b471c07344d7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:54:34.792305 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f294dd0e-2215-4da3-9b50-b471c07344d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc36b3aba4fa4ad9bb26dfd87d95746c', 'request_id': 'req-f294dd0e-2215-4da3-9b50-b471c07344d7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:54:34.846902 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f294dd0e-2215-4da3-9b50-b471c07344d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc36b3aba4fa4ad9bb26dfd87d95746c', 'request_id': 'req-f294dd0e-2215-4da3-9b50-b471c07344d7'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:54:34.861124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f294dd0e-2215-4da3-9b50-b471c07344d7 admin admin] The token cache is being invalidate because project dc36b3aba4fa4ad9bb26dfd87d95746c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:54:34.861421 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f294dd0e-2215-4da3-9b50-b471c07344d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:54:34.862171 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f294dd0e-2215-4da3-9b50-b471c07344d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:54:34.864332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1245/2459] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:54:34 2022] DELETE /identity/v3/projects/dc36b3aba4fa4ad9bb26dfd87d95746c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:54:39.421916 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874df3e-964c-459b-8ff7-15e4acac5c90 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:39.422471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874df3e-964c-459b-8ff7-15e4acac5c90 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:39.422471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874df3e-964c-459b-8ff7-15e4acac5c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:39.445058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-6874df3e-964c-459b-8ff7-15e4acac5c90 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:54:39.450016 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-6874df3e-964c-459b-8ff7-15e4acac5c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:39.514577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1215/2460] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Sep 7 16:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:54:39.529261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294dd0e-2215-4da3-9b50-b471c07344d7 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:54:39.530742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f294dd0e-2215-4da3-9b50-b471c07344d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:39.630454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:54:39.635796 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294dd0e-2215-4da3-9b50-b471c07344d7 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:54:39.642209 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc9e94-6b6f-4c14-af23-4d2095e1dbf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:54:39.642838 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc9e94-6b6f-4c14-af23-4d2095e1dbf4 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:39.643122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc9e94-6b6f-4c14-af23-4d2095e1dbf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:39.643397 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc9e94-6b6f-4c14-af23-4d2095e1dbf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:39.655902 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc9e94-6b6f-4c14-af23-4d2095e1dbf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:54:39.657526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc9e94-6b6f-4c14-af23-4d2095e1dbf4 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:54:39.670815 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1246/2461] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:54:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:54:43.394610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f5a3b-8f2f-405a-a09c-c70c8f14c859 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:43.395167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f5a3b-8f2f-405a-a09c-c70c8f14c859 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:43.395167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f5a3b-8f2f-405a-a09c-c70c8f14c859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:43.416489 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-8f9f5a3b-8f2f-405a-a09c-c70c8f14c859 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:54:43.418854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-8f9f5a3b-8f2f-405a-a09c-c70c8f14c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:43.426840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1216/2462] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Sep 7 16:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:54:43.442483 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc9e94-6b6f-4c14-af23-4d2095e1dbf4 service nova] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:54:43.454298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc9e94-6b6f-4c14-af23-4d2095e1dbf4 service nova] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:54:43.460250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976c07b-eef5-43ea-a6a5-c31d0a807a2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:54:43.460865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976c07b-eef5-43ea-a6a5-c31d0a807a2f service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:43.461140 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976c07b-eef5-43ea-a6a5-c31d0a807a2f service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:43.461407 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976c07b-eef5-43ea-a6a5-c31d0a807a2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:43.471073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976c07b-eef5-43ea-a6a5-c31d0a807a2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:54:43.472676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976c07b-eef5-43ea-a6a5-c31d0a807a2f service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:54:43.483853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1247/2463] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:54:46.636838 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b80112-3732-4689-afa1-f405c8a97b6c None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:46.638831 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b80112-3732-4689-afa1-f405c8a97b6c None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:46.638831 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b80112-3732-4689-afa1-f405c8a97b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:46.658221 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-63b80112-3732-4689-afa1-f405c8a97b6c None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:54:46.659449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-63b80112-3732-4689-afa1-f405c8a97b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:46.667967 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1217/2464] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Sep 7 16:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:54:46.690403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976c07b-eef5-43ea-a6a5-c31d0a807a2f service nova] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:54:46.692111 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2976c07b-eef5-43ea-a6a5-c31d0a807a2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:46.718518 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976c07b-eef5-43ea-a6a5-c31d0a807a2f service nova] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:54:46.728163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6658df3-a071-418a-8acf-7889de681a1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:54:46.729212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6658df3-a071-418a-8acf-7889de681a1e service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:46.730647 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6658df3-a071-418a-8acf-7889de681a1e service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:46.731148 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6658df3-a071-418a-8acf-7889de681a1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:46.747638 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6658df3-a071-418a-8acf-7889de681a1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:54:46.750465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6658df3-a071-418a-8acf-7889de681a1e service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:54:46.768795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1248/2465] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:54:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:54:49.875708 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d952c-755c-481d-aee7-b250b7040b26 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:49.876335 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d952c-755c-481d-aee7-b250b7040b26 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:49.876335 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d952c-755c-481d-aee7-b250b7040b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:49.901000 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-fc2d952c-755c-481d-aee7-b250b7040b26 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:54:49.902381 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-fc2d952c-755c-481d-aee7-b250b7040b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:54:49.911572 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1218/2466] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Sep 7 16:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:54:49.929564 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6658df3-a071-418a-8acf-7889de681a1e service nova] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:54:49.941791 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6658df3-a071-418a-8acf-7889de681a1e service nova] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:54:49.947355 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b51a3a-04cf-46ad-b4f6-7e66f5f73024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:54:49.947978 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b51a3a-04cf-46ad-b4f6-7e66f5f73024 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:54:49.948320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b51a3a-04cf-46ad-b4f6-7e66f5f73024 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:54:49.948606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b51a3a-04cf-46ad-b4f6-7e66f5f73024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:54:49.957082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b51a3a-04cf-46ad-b4f6-7e66f5f73024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:54:49.958651 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b51a3a-04cf-46ad-b4f6-7e66f5f73024 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:54:49.969744 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1249/2467] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:54:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:54:59.891990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=76 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:54:59.964561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=22 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:55:10.476584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf24f8-055a-4880-8b57-85112a725756 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:10.477125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf24f8-055a-4880-8b57-85112a725756 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:10.477125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf24f8-055a-4880-8b57-85112a725756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:10.499199 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-e1cf24f8-055a-4880-8b57-85112a725756 None None] MFA Rules not processed for user `be6d79591cf14650a82b2b45fa8fd4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:55:10.500454 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-e1cf24f8-055a-4880-8b57-85112a725756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:10.564403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1219/2468] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:55:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:55:11.106284 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def692a-2a42-4923-96ab-f7a17db37af5 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:11.106854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def692a-2a42-4923-96ab-f7a17db37af5 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:11.106854 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def692a-2a42-4923-96ab-f7a17db37af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:11.132370 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-4def692a-2a42-4923-96ab-f7a17db37af5 None None] MFA Rules not processed for user `47d11a6f8606484a963407a88fb92b03`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:55:11.133706 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-4def692a-2a42-4923-96ab-f7a17db37af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:11.194219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1250/2469] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:55:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:55:14.657941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf24f8-055a-4880-8b57-85112a725756 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:14.660066 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-e1cf24f8-055a-4880-8b57-85112a725756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:14.723421 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf24f8-055a-4880-8b57-85112a725756 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:14.727021 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fc9ce-e15b-4453-b81b-65afbd9f6a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:14.727669 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fc9ce-e15b-4453-b81b-65afbd9f6a00 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:14.727949 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fc9ce-e15b-4453-b81b-65afbd9f6a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:14.728221 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fc9ce-e15b-4453-b81b-65afbd9f6a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:14.729984 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-6c8fc9ce-e15b-4453-b81b-65afbd9f6a00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:14.747029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fc9ce-e15b-4453-b81b-65afbd9f6a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:14.748517 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fc9ce-e15b-4453-b81b-65afbd9f6a00 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:14.762042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1220/2470] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:55:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:55:17.765609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def692a-2a42-4923-96ab-f7a17db37af5 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:17.775677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def692a-2a42-4923-96ab-f7a17db37af5 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:17.779938 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204393f7-b418-47e4-af27-645ccc8e82fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:17.780665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204393f7-b418-47e4-af27-645ccc8e82fe service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:17.782412 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204393f7-b418-47e4-af27-645ccc8e82fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:17.782412 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204393f7-b418-47e4-af27-645ccc8e82fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:17.784781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-204393f7-b418-47e4-af27-645ccc8e82fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:17.800437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204393f7-b418-47e4-af27-645ccc8e82fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:17.802027 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204393f7-b418-47e4-af27-645ccc8e82fe service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:17.814895 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1251/2471] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:55:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:55:24.755261 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=51 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:55:27.808955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=31 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:55:35.852367 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891431f8-ff42-44b4-9c7a-b5baf0750494 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:35.852959 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891431f8-ff42-44b4-9c7a-b5baf0750494 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:35.853293 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891431f8-ff42-44b4-9c7a-b5baf0750494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:35.875954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-891431f8-ff42-44b4-9c7a-b5baf0750494 None None] MFA Rules not processed for user `7a3f8b78523e4c3790b049fc783c96fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:55:35.877288 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-891431f8-ff42-44b4-9c7a-b5baf0750494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:35.933062 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1221/2472] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:55:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:55:37.522021 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058263ad-f89a-4349-9f3f-0ea54a8e74bb None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:37.522561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058263ad-f89a-4349-9f3f-0ea54a8e74bb None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:37.522561 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058263ad-f89a-4349-9f3f-0ea54a8e74bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:37.543053 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-058263ad-f89a-4349-9f3f-0ea54a8e74bb None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:55:37.544311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-058263ad-f89a-4349-9f3f-0ea54a8e74bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:37.552448 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1252/2473] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Sep 7 16:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:55:37.570465 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891431f8-ff42-44b4-9c7a-b5baf0750494 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:37.585192 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891431f8-ff42-44b4-9c7a-b5baf0750494 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:37.590625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc1b48-9f43-44fe-95a3-fb6ed060a014 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:37.591229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc1b48-9f43-44fe-95a3-fb6ed060a014 service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:37.600887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc1b48-9f43-44fe-95a3-fb6ed060a014 service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:37.600887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc1b48-9f43-44fe-95a3-fb6ed060a014 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:37.600887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc1b48-9f43-44fe-95a3-fb6ed060a014 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:37.601886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc1b48-9f43-44fe-95a3-fb6ed060a014 service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:37.611522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1222/2474] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:55:38.018323 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b041a-54e9-4bcf-8f80-2424f523f73e None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:38.018602 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b041a-54e9-4bcf-8f80-2424f523f73e None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:38.018875 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b041a-54e9-4bcf-8f80-2424f523f73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:38.038651 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-732b041a-54e9-4bcf-8f80-2424f523f73e None None] MFA Rules not processed for user `87ba67fc171b4258b6fda72094ed11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:55:38.039885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-732b041a-54e9-4bcf-8f80-2424f523f73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:38.096014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1253/2475] 10.222.0.25 () {58 vars in 967 bytes} [Wed Sep 7 16:55:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:55:38.254712 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc1b48-9f43-44fe-95a3-fb6ed060a014 service nova] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:38.256152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c9cc1b48-9f43-44fe-95a3-fb6ed060a014 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:38.327610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc1b48-9f43-44fe-95a3-fb6ed060a014 service nova] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:38.332864 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4b059-c773-4b86-8c20-d3046a06cab9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56cd868e866d436aa1d601f7791e812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:38.333500 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4b059-c773-4b86-8c20-d3046a06cab9 service swift] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:38.333779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4b059-c773-4b86-8c20-d3046a06cab9 service swift] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:38.334050 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4b059-c773-4b86-8c20-d3046a06cab9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:38.343152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4b059-c773-4b86-8c20-d3046a06cab9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:38.344771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4b059-c773-4b86-8c20-d3046a06cab9 service swift] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:38.352910 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1223/2476] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Sep 7 16:55:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:55:39.743982 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b041a-54e9-4bcf-8f80-2424f523f73e None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:39.757535 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b041a-54e9-4bcf-8f80-2424f523f73e None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:39.763119 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e8991-9020-4438-b7a5-50315e109042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:39.763767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e8991-9020-4438-b7a5-50315e109042 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:39.763767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e8991-9020-4438-b7a5-50315e109042 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:39.764524 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e8991-9020-4438-b7a5-50315e109042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:39.766430 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a38e8991-9020-4438-b7a5-50315e109042 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:39.829943 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e8991-9020-4438-b7a5-50315e109042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:39.831580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e8991-9020-4438-b7a5-50315e109042 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:39.841396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1254/2477] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:55:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:55:43.462806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188065ac-702b-455c-a85c-9e4b21ea9d38 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:43.463354 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188065ac-702b-455c-a85c-9e4b21ea9d38 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:43.463354 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188065ac-702b-455c-a85c-9e4b21ea9d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:43.486180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-188065ac-702b-455c-a85c-9e4b21ea9d38 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:55:43.488378 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-188065ac-702b-455c-a85c-9e4b21ea9d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:43.497776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1224/2478] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Sep 7 16:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:55:43.521956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e8991-9020-4438-b7a5-50315e109042 service nova] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:43.534340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e8991-9020-4438-b7a5-50315e109042 service nova] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:43.540564 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175aa64d-12ea-4ae5-90d9-055e649499be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:43.541676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175aa64d-12ea-4ae5-90d9-055e649499be service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:43.542123 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175aa64d-12ea-4ae5-90d9-055e649499be service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:43.547898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175aa64d-12ea-4ae5-90d9-055e649499be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:43.552512 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175aa64d-12ea-4ae5-90d9-055e649499be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:43.554103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175aa64d-12ea-4ae5-90d9-055e649499be service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:43.565115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1255/2479] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:55:43.650881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188065ac-702b-455c-a85c-9e4b21ea9d38 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:43.669056 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188065ac-702b-455c-a85c-9e4b21ea9d38 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:43.676972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1d254-7152-4274-8ed4-26e0a74692eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:43.677885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1d254-7152-4274-8ed4-26e0a74692eb service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:43.678353 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1d254-7152-4274-8ed4-26e0a74692eb service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:43.678808 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1d254-7152-4274-8ed4-26e0a74692eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:43.680814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-6bb1d254-7152-4274-8ed4-26e0a74692eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:43.699572 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1d254-7152-4274-8ed4-26e0a74692eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:43.701913 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1d254-7152-4274-8ed4-26e0a74692eb service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:43.714975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1225/2480] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:55:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:55:44.036422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175aa64d-12ea-4ae5-90d9-055e649499be service nova] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:44.038150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-175aa64d-12ea-4ae5-90d9-055e649499be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:44.113377 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175aa64d-12ea-4ae5-90d9-055e649499be service nova] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:44.118341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c1583-bb0a-45e9-b078-ddceaa23a06c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256e8478e5fb4c01acde0d597bae0b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:44.118976 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c1583-bb0a-45e9-b078-ddceaa23a06c service placement] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:44.119274 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c1583-bb0a-45e9-b078-ddceaa23a06c service placement] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:44.119552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c1583-bb0a-45e9-b078-ddceaa23a06c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:44.121314 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-125c1583-bb0a-45e9-b078-ddceaa23a06c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:44.135802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c1583-bb0a-45e9-b078-ddceaa23a06c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:44.136165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c1583-bb0a-45e9-b078-ddceaa23a06c service placement] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:44.150604 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1256/2481] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:55:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:55:47.824178 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1d254-7152-4274-8ed4-26e0a74692eb service nova] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:47.837911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1d254-7152-4274-8ed4-26e0a74692eb service nova] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:47.844117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640bb09-cc7a-47e0-a891-bb6b579abc57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256e8478e5fb4c01acde0d597bae0b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:47.844912 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640bb09-cc7a-47e0-a891-bb6b579abc57 service placement] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:47.845376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640bb09-cc7a-47e0-a891-bb6b579abc57 service placement] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:47.845838 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640bb09-cc7a-47e0-a891-bb6b579abc57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:47.848136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4640bb09-cc7a-47e0-a891-bb6b579abc57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:47.860916 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640bb09-cc7a-47e0-a891-bb6b579abc57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:47.862791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640bb09-cc7a-47e0-a891-bb6b579abc57 service placement] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:47.875034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1226/2482] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:55:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:55:48.060852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c1583-bb0a-45e9-b078-ddceaa23a06c service placement] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:48.062910 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-125c1583-bb0a-45e9-b078-ddceaa23a06c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:48.076882 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c1583-bb0a-45e9-b078-ddceaa23a06c service placement] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:48.082005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f890c86-26ef-4fb1-96d1-d4f47741459d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:48.082665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f890c86-26ef-4fb1-96d1-d4f47741459d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:48.087400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f890c86-26ef-4fb1-96d1-d4f47741459d admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:48.087400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f890c86-26ef-4fb1-96d1-d4f47741459d admin admin] PATH_INFO: `/v3/users/71ae88d86f5c443480038a166a5c50b2` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:48.087400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f890c86-26ef-4fb1-96d1-d4f47741459d admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ae88d86f5c443480038a166a5c50b2)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:48.087400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f890c86-26ef-4fb1-96d1-d4f47741459d admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:48.092608 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:55:48.357361 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7f890c86-26ef-4fb1-96d1-d4f47741459d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ae88d86f5c443480038a166a5c50b2'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:48.435308 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7f890c86-26ef-4fb1-96d1-d4f47741459d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ae88d86f5c443480038a166a5c50b2'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:48.435999 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7f890c86-26ef-4fb1-96d1-d4f47741459d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ae88d86f5c443480038a166a5c50b2'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:48.436641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7f890c86-26ef-4fb1-96d1-d4f47741459d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ae88d86f5c443480038a166a5c50b2'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:48.444872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7f890c86-26ef-4fb1-96d1-d4f47741459d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ae88d86f5c443480038a166a5c50b2'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:48.464100 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1257/2483] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:55:48 2022] DELETE /identity/v3/users/71ae88d86f5c443480038a166a5c50b2 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:55:48.802766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640bb09-cc7a-47e0-a891-bb6b579abc57 service placement] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:48.817767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640bb09-cc7a-47e0-a891-bb6b579abc57 service placement] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:48.871831 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:55:48.881836 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead0e03-d1fe-4206-a242-8210756f2248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:48.882373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead0e03-d1fe-4206-a242-8210756f2248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:48.882648 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead0e03-d1fe-4206-a242-8210756f2248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:48.882925 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead0e03-d1fe-4206-a242-8210756f2248 admin admin] PATH_INFO: `/v3/projects/c33bb5c34b1349bebf0d174488bec2d6` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:48.884084 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead0e03-d1fe-4206-a242-8210756f2248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c33bb5c34b1349bebf0d174488bec2d6)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:48.886040 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead0e03-d1fe-4206-a242-8210756f2248 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:49.067859 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0ead0e03-d1fe-4206-a242-8210756f2248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c33bb5c34b1349bebf0d174488bec2d6', 'request_id': 'req-0ead0e03-d1fe-4206-a242-8210756f2248'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:49.161204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0ead0e03-d1fe-4206-a242-8210756f2248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c33bb5c34b1349bebf0d174488bec2d6', 'request_id': 'req-0ead0e03-d1fe-4206-a242-8210756f2248'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:49.170130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0ead0e03-d1fe-4206-a242-8210756f2248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c33bb5c34b1349bebf0d174488bec2d6', 'request_id': 'req-0ead0e03-d1fe-4206-a242-8210756f2248'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:49.186544 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0ead0e03-d1fe-4206-a242-8210756f2248 admin admin] The token cache is being invalidate because project c33bb5c34b1349bebf0d174488bec2d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:55:49.187136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0ead0e03-d1fe-4206-a242-8210756f2248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:49.188126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0ead0e03-d1fe-4206-a242-8210756f2248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:49.194439 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f890c86-26ef-4fb1-96d1-d4f47741459d admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:49.197565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7f890c86-26ef-4fb1-96d1-d4f47741459d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:49.200736 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1227/2484] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:55:48 2022] DELETE /identity/v3/projects/c33bb5c34b1349bebf0d174488bec2d6 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:55:49.224985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f890c86-26ef-4fb1-96d1-d4f47741459d admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:49.321458 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78dfb6-7117-48a8-b9d1-e59e73a7f086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:49.322101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78dfb6-7117-48a8-b9d1-e59e73a7f086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:49.327465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78dfb6-7117-48a8-b9d1-e59e73a7f086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:49.327465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78dfb6-7117-48a8-b9d1-e59e73a7f086 admin admin] PATH_INFO: `/v3/users/89fabc9685ba44eda83e3470fdd3a2c2` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:49.327465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78dfb6-7117-48a8-b9d1-e59e73a7f086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89fabc9685ba44eda83e3470fdd3a2c2)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:49.327465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78dfb6-7117-48a8-b9d1-e59e73a7f086 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:49.408782 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7957928-ad17-4851-8aae-690ca5f1426a None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:49.409340 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7957928-ad17-4851-8aae-690ca5f1426a None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:49.410048 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7957928-ad17-4851-8aae-690ca5f1426a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:49.442348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-a7957928-ad17-4851-8aae-690ca5f1426a None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:55:49.445285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a7957928-ad17-4851-8aae-690ca5f1426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:49.453347 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1228/2485] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Sep 7 16:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:55:49.471850 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7957928-ad17-4851-8aae-690ca5f1426a None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:49.473429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a7957928-ad17-4851-8aae-690ca5f1426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:49.535677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ab78dfb6-7117-48a8-b9d1-e59e73a7f086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89fabc9685ba44eda83e3470fdd3a2c2'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:49.573809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7957928-ad17-4851-8aae-690ca5f1426a None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:49.580154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ff474-0ceb-4b06-a9aa-e53eef57bd6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:49.580821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ff474-0ceb-4b06-a9aa-e53eef57bd6c service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:49.581102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ff474-0ceb-4b06-a9aa-e53eef57bd6c service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:49.581376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ff474-0ceb-4b06-a9aa-e53eef57bd6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:49.590853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ff474-0ceb-4b06-a9aa-e53eef57bd6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:49.594320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ff474-0ceb-4b06-a9aa-e53eef57bd6c service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:49.605335 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1229/2486] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:55:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:55:49.661438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ab78dfb6-7117-48a8-b9d1-e59e73a7f086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89fabc9685ba44eda83e3470fdd3a2c2'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:49.662725 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ab78dfb6-7117-48a8-b9d1-e59e73a7f086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89fabc9685ba44eda83e3470fdd3a2c2'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:49.663357 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ab78dfb6-7117-48a8-b9d1-e59e73a7f086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89fabc9685ba44eda83e3470fdd3a2c2'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:49.680444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ab78dfb6-7117-48a8-b9d1-e59e73a7f086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89fabc9685ba44eda83e3470fdd3a2c2'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:49.699489 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1258/2487] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:55:49 2022] DELETE /identity/v3/users/89fabc9685ba44eda83e3470fdd3a2c2 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:55:49.981860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ff474-0ceb-4b06-a9aa-e53eef57bd6c service nova] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:49.981860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3c7ff474-0ceb-4b06-a9aa-e53eef57bd6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:49.993807 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ff474-0ceb-4b06-a9aa-e53eef57bd6c service nova] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:50.052386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:55:50.058446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ff88f-ef2d-423f-ac95-ccc55aadfdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:50.059080 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ff88f-ef2d-423f-ac95-ccc55aadfdab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:50.059364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ff88f-ef2d-423f-ac95-ccc55aadfdab admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:50.059664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ff88f-ef2d-423f-ac95-ccc55aadfdab admin admin] PATH_INFO: `/v3/projects/2bef6e07d5a44783bfd8b1144b3fa6eb` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:50.061064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ff88f-ef2d-423f-ac95-ccc55aadfdab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bef6e07d5a44783bfd8b1144b3fa6eb)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:50.063348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ff88f-ef2d-423f-ac95-ccc55aadfdab admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:50.191466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-261ff88f-ef2d-423f-ac95-ccc55aadfdab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bef6e07d5a44783bfd8b1144b3fa6eb', 'request_id': 'req-261ff88f-ef2d-423f-ac95-ccc55aadfdab'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:50.349224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-261ff88f-ef2d-423f-ac95-ccc55aadfdab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bef6e07d5a44783bfd8b1144b3fa6eb', 'request_id': 'req-261ff88f-ef2d-423f-ac95-ccc55aadfdab'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:50.356144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-261ff88f-ef2d-423f-ac95-ccc55aadfdab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bef6e07d5a44783bfd8b1144b3fa6eb', 'request_id': 'req-261ff88f-ef2d-423f-ac95-ccc55aadfdab'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:50.367234 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-261ff88f-ef2d-423f-ac95-ccc55aadfdab admin admin] The token cache is being invalidate because project 2bef6e07d5a44783bfd8b1144b3fa6eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:55:50.367541 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-261ff88f-ef2d-423f-ac95-ccc55aadfdab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:50.368170 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-261ff88f-ef2d-423f-ac95-ccc55aadfdab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:50.369640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1230/2488] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:55:49 2022] DELETE /identity/v3/projects/2bef6e07d5a44783bfd8b1144b3fa6eb => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:55:52.811753 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78dfb6-7117-48a8-b9d1-e59e73a7f086 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:52.813440 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ab78dfb6-7117-48a8-b9d1-e59e73a7f086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:52.821457 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:55:52.874226 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78dfb6-7117-48a8-b9d1-e59e73a7f086 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:52.925094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534103a1-ec56-4f8e-800a-41acd3bf87ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:52.925709 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534103a1-ec56-4f8e-800a-41acd3bf87ae service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:52.925990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534103a1-ec56-4f8e-800a-41acd3bf87ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:52.926264 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534103a1-ec56-4f8e-800a-41acd3bf87ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:52.928042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-534103a1-ec56-4f8e-800a-41acd3bf87ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:52.993431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534103a1-ec56-4f8e-800a-41acd3bf87ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:52.994918 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534103a1-ec56-4f8e-800a-41acd3bf87ae service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:53.005007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1259/2489] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:55:53.705260 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b94d1-ab7c-480e-b8db-41fb05d5c211 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:53.706204 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b94d1-ab7c-480e-b8db-41fb05d5c211 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:53.706713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b94d1-ab7c-480e-b8db-41fb05d5c211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:53.737188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-139b94d1-ab7c-480e-b8db-41fb05d5c211 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:55:53.738625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-139b94d1-ab7c-480e-b8db-41fb05d5c211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:53.747508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1231/2490] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Sep 7 16:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:55:53.762385 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534103a1-ec56-4f8e-800a-41acd3bf87ae service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:53.765679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-534103a1-ec56-4f8e-800a-41acd3bf87ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:53.853245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534103a1-ec56-4f8e-800a-41acd3bf87ae service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:53.860274 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e5c66-12c0-4f49-abbe-cc2f96eb4e61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:53.860917 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e5c66-12c0-4f49-abbe-cc2f96eb4e61 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:53.861199 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e5c66-12c0-4f49-abbe-cc2f96eb4e61 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:53.861474 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e5c66-12c0-4f49-abbe-cc2f96eb4e61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:53.868214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:55:53.870473 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e5c66-12c0-4f49-abbe-cc2f96eb4e61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:53.872102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e5c66-12c0-4f49-abbe-cc2f96eb4e61 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:53.882253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1260/2491] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:55:55.598054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b94d1-ab7c-480e-b8db-41fb05d5c211 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:55.599502 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-139b94d1-ab7c-480e-b8db-41fb05d5c211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:55.612369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b94d1-ab7c-480e-b8db-41fb05d5c211 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:55.616115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510b791-f483-478a-86fa-07e6eefb660a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:55.616843 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510b791-f483-478a-86fa-07e6eefb660a service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:55.617123 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510b791-f483-478a-86fa-07e6eefb660a service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:55.617396 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510b791-f483-478a-86fa-07e6eefb660a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:55.619391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b510b791-f483-478a-86fa-07e6eefb660a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:55.630641 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510b791-f483-478a-86fa-07e6eefb660a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:55.632115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510b791-f483-478a-86fa-07e6eefb660a service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:55.642477 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1232/2492] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:55:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:55:56.927863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e5c66-12c0-4f49-abbe-cc2f96eb4e61 service nova] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:56.929366 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2d0e5c66-12c0-4f49-abbe-cc2f96eb4e61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:56.944983 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e5c66-12c0-4f49-abbe-cc2f96eb4e61 service nova] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:56.949741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac5aa1-c467-45ba-ab4c-310acef00ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:56.950373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac5aa1-c467-45ba-ab4c-310acef00ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:56.950654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac5aa1-c467-45ba-ab4c-310acef00ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:56.951508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac5aa1-c467-45ba-ab4c-310acef00ac6 admin admin] PATH_INFO: `/v3/users/7dc367b3f3e04ec48665feef4094715a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:56.952811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac5aa1-c467-45ba-ab4c-310acef00ac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc367b3f3e04ec48665feef4094715a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:56.954602 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac5aa1-c467-45ba-ab4c-310acef00ac6 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:57.000527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474fe01-e5ef-41d1-b1ff-46a76cbfb8f4 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:57.002718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474fe01-e5ef-41d1-b1ff-46a76cbfb8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:57.002718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474fe01-e5ef-41d1-b1ff-46a76cbfb8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:57.021092 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-c474fe01-e5ef-41d1-b1ff-46a76cbfb8f4 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:55:57.022276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c474fe01-e5ef-41d1-b1ff-46a76cbfb8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:57.031681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1233/2493] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Sep 7 16:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:55:57.056169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474fe01-e5ef-41d1-b1ff-46a76cbfb8f4 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:57.070058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474fe01-e5ef-41d1-b1ff-46a76cbfb8f4 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:57.076365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce0ca3-b196-40dc-8bae-dbc43cb3bac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:57.077352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0ca3-b196-40dc-8bae-dbc43cb3bac1 service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:57.077643 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0ca3-b196-40dc-8bae-dbc43cb3bac1 service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:57.078036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0ca3-b196-40dc-8bae-dbc43cb3bac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:57.087052 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce0ca3-b196-40dc-8bae-dbc43cb3bac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:57.094455 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce0ca3-b196-40dc-8bae-dbc43cb3bac1 service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:57.099831 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1234/2494] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:55:57.160494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4cac5aa1-c467-45ba-ab4c-310acef00ac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc367b3f3e04ec48665feef4094715a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:57.240352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4cac5aa1-c467-45ba-ab4c-310acef00ac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc367b3f3e04ec48665feef4094715a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:57.240964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4cac5aa1-c467-45ba-ab4c-310acef00ac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc367b3f3e04ec48665feef4094715a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:57.241577 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4cac5aa1-c467-45ba-ab4c-310acef00ac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc367b3f3e04ec48665feef4094715a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:57.250042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4cac5aa1-c467-45ba-ab4c-310acef00ac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc367b3f3e04ec48665feef4094715a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:57.269188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1261/2495] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:55:56 2022] DELETE /identity/v3/users/7dc367b3f3e04ec48665feef4094715a => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:55:57.550950 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce0ca3-b196-40dc-8bae-dbc43cb3bac1 service nova] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:57.563876 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce0ca3-b196-40dc-8bae-dbc43cb3bac1 service nova] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:57.641803 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982339f-1486-44db-84a8-1af117d8dee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:57.642464 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982339f-1486-44db-84a8-1af117d8dee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:57.642745 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982339f-1486-44db-84a8-1af117d8dee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:57.643019 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982339f-1486-44db-84a8-1af117d8dee1 admin admin] PATH_INFO: `/v3/projects/90a9e61e6928442f896de037b3bfa011` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:57.644193 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982339f-1486-44db-84a8-1af117d8dee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a9e61e6928442f896de037b3bfa011)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:57.646251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982339f-1486-44db-84a8-1af117d8dee1 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:57.790395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d982339f-1486-44db-84a8-1af117d8dee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a9e61e6928442f896de037b3bfa011', 'request_id': 'req-d982339f-1486-44db-84a8-1af117d8dee1'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:57.792433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:55:57.892309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d982339f-1486-44db-84a8-1af117d8dee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a9e61e6928442f896de037b3bfa011', 'request_id': 'req-d982339f-1486-44db-84a8-1af117d8dee1'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:57.899679 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d982339f-1486-44db-84a8-1af117d8dee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a9e61e6928442f896de037b3bfa011', 'request_id': 'req-d982339f-1486-44db-84a8-1af117d8dee1'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:57.911228 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d982339f-1486-44db-84a8-1af117d8dee1 admin admin] The token cache is being invalidate because project 90a9e61e6928442f896de037b3bfa011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:55:57.911611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d982339f-1486-44db-84a8-1af117d8dee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:57.912283 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d982339f-1486-44db-84a8-1af117d8dee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:55:57.913808 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1235/2496] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:55:57 2022] DELETE /identity/v3/projects/90a9e61e6928442f896de037b3bfa011 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:55:57.919339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29da9f-36c1-4eab-b1ef-28647f7351fa None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:57.920295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29da9f-36c1-4eab-b1ef-28647f7351fa None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:57.921189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29da9f-36c1-4eab-b1ef-28647f7351fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:57.942166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-ae29da9f-36c1-4eab-b1ef-28647f7351fa None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:55:57.943550 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ae29da9f-36c1-4eab-b1ef-28647f7351fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:58.019844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1262/2497] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:55:58.027260 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b82dad-3741-451b-9db3-ccfe0a3bbed9 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:58.027821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b82dad-3741-451b-9db3-ccfe0a3bbed9 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:58.027929 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b82dad-3741-451b-9db3-ccfe0a3bbed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:58.049957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-55b82dad-3741-451b-9db3-ccfe0a3bbed9 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:55:58.051083 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-55b82dad-3741-451b-9db3-ccfe0a3bbed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:58.059681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1236/2498] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:55:58.064277 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29da9f-36c1-4eab-b1ef-28647f7351fa None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:58.074662 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29da9f-36c1-4eab-b1ef-28647f7351fa None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:58.079754 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c0b4a-e754-4236-8722-bbfca2c6c3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:58.080358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0b4a-e754-4236-8722-bbfca2c6c3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:58.080636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0b4a-e754-4236-8722-bbfca2c6c3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:58.080911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0b4a-e754-4236-8722-bbfca2c6c3c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:58.081547 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c0b4a-e754-4236-8722-bbfca2c6c3c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:55:58.081849 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c0b4a-e754-4236-8722-bbfca2c6c3c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:58.083438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c0b4a-e754-4236-8722-bbfca2c6c3c3 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:58.096632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1263/2499] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:55:58.100996 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b82dad-3741-451b-9db3-ccfe0a3bbed9 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:58.111189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b82dad-3741-451b-9db3-ccfe0a3bbed9 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:58.115951 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaeb4d-b059-453a-9ab6-80a45d773ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:58.116550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaeb4d-b059-453a-9ab6-80a45d773ebb admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:58.116829 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaeb4d-b059-453a-9ab6-80a45d773ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:58.117098 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaeb4d-b059-453a-9ab6-80a45d773ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:58.117881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecaeb4d-b059-453a-9ab6-80a45d773ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:58.119804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecaeb4d-b059-453a-9ab6-80a45d773ebb admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:58.213280 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1237/2500] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:55:58 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:55:58.218398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c0b4a-e754-4236-8722-bbfca2c6c3c3 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:58.228735 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c0b4a-e754-4236-8722-bbfca2c6c3c3 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:58.284809 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:55:58.291994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20304b00-6037-4335-8177-fe91a4dcc4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:58.292595 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20304b00-6037-4335-8177-fe91a4dcc4ea admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:58.292879 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20304b00-6037-4335-8177-fe91a4dcc4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:58.293153 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20304b00-6037-4335-8177-fe91a4dcc4ea admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:58.293779 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20304b00-6037-4335-8177-fe91a4dcc4ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:58.296430 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20304b00-6037-4335-8177-fe91a4dcc4ea admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:58.387502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1264/2501] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:55:58 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:55:58.392560 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaeb4d-b059-453a-9ab6-80a45d773ebb admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:58.403112 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaeb4d-b059-453a-9ab6-80a45d773ebb admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:58.409075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08b7a5-9f7e-4b22-9c8d-6db72f317bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:58.409684 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08b7a5-9f7e-4b22-9c8d-6db72f317bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:58.409962 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08b7a5-9f7e-4b22-9c8d-6db72f317bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:58.410270 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08b7a5-9f7e-4b22-9c8d-6db72f317bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:58.410900 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08b7a5-9f7e-4b22-9c8d-6db72f317bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:58.412555 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08b7a5-9f7e-4b22-9c8d-6db72f317bc7 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:58.423965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1238/2502] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:55:58.428129 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20304b00-6037-4335-8177-fe91a4dcc4ea admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:58.438407 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20304b00-6037-4335-8177-fe91a4dcc4ea admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:58.443094 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caaca4-7f8c-44ff-a369-1e10411dbc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:58.443735 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caaca4-7f8c-44ff-a369-1e10411dbc63 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:58.444015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caaca4-7f8c-44ff-a369-1e10411dbc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:58.444287 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caaca4-7f8c-44ff-a369-1e10411dbc63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:58.444918 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9caaca4-7f8c-44ff-a369-1e10411dbc63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:58.446507 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9caaca4-7f8c-44ff-a369-1e10411dbc63 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:58.457688 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1265/2503] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:55:58.462066 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08b7a5-9f7e-4b22-9c8d-6db72f317bc7 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:58.472776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08b7a5-9f7e-4b22-9c8d-6db72f317bc7 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:58.478012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600243c-9d74-4226-b41d-0241acf009bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:58.478678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600243c-9d74-4226-b41d-0241acf009bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:58.485999 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600243c-9d74-4226-b41d-0241acf009bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:58.485999 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600243c-9d74-4226-b41d-0241acf009bd admin admin] PATH_INFO: `/v3/projects/bbe1aed3b47241cab459752c0320ef55/users/2a6796a4bca94d448ae6c52fd28e2c35/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:58.495466 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600243c-9d74-4226-b41d-0241acf009bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe1aed3b47241cab459752c0320ef55, user_id=2a6796a4bca94d448ae6c52fd28e2c35, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:58.498338 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600243c-9d74-4226-b41d-0241acf009bd admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:58.552813 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1239/2504] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:55:58 2022] PUT /identity/v3/projects/bbe1aed3b47241cab459752c0320ef55/users/2a6796a4bca94d448ae6c52fd28e2c35/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:55:58.562065 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c4b21-a526-42c2-b49c-5dc3c2aa7986 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:58.562353 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c4b21-a526-42c2-b49c-5dc3c2aa7986 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:58.562689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c4b21-a526-42c2-b49c-5dc3c2aa7986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:58.582686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-eb8c4b21-a526-42c2-b49c-5dc3c2aa7986 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:55:58.583920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-eb8c4b21-a526-42c2-b49c-5dc3c2aa7986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:58.653271 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1266/2505] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:55:58.669948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600243c-9d74-4226-b41d-0241acf009bd admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:55:58.669948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0600243c-9d74-4226-b41d-0241acf009bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:55:58.742813 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600243c-9d74-4226-b41d-0241acf009bd admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:55:58.746734 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e56815-f151-427a-b9ea-3890c9dd563d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:55:58.750030 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e56815-f151-427a-b9ea-3890c9dd563d service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:55:58.750030 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e56815-f151-427a-b9ea-3890c9dd563d service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:55:58.750030 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e56815-f151-427a-b9ea-3890c9dd563d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:55:58.759673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e56815-f151-427a-b9ea-3890c9dd563d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:55:58.761159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e56815-f151-427a-b9ea-3890c9dd563d service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:55:58.772640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1240/2506] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:56:04.644162 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c11f62-1654-48e0-9d3e-ab0695b771aa None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:04.644656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c11f62-1654-48e0-9d3e-ab0695b771aa None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:04.644757 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c11f62-1654-48e0-9d3e-ab0695b771aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:04.691719 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-02c11f62-1654-48e0-9d3e-ab0695b771aa None None] MFA Rules not processed for user `2a6796a4bca94d448ae6c52fd28e2c35`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:56:04.692928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-02c11f62-1654-48e0-9d3e-ab0695b771aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:04.803609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1267/2507] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:56:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:56:04.821226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e56815-f151-427a-b9ea-3890c9dd563d service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:04.822675 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-61e56815-f151-427a-b9ea-3890c9dd563d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:04.903261 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e56815-f151-427a-b9ea-3890c9dd563d service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:04.909605 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb0d6c-cb50-4c40-b6f9-72f8d26f1f71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:04.910227 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb0d6c-cb50-4c40-b6f9-72f8d26f1f71 service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:04.910503 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb0d6c-cb50-4c40-b6f9-72f8d26f1f71 service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:04.910776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb0d6c-cb50-4c40-b6f9-72f8d26f1f71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:04.920517 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb0d6c-cb50-4c40-b6f9-72f8d26f1f71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:04.922133 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb0d6c-cb50-4c40-b6f9-72f8d26f1f71 service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:04.932602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1241/2508] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:56:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:56:07.406039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cc112-0c4a-455b-88a5-ce4607c06a07 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:07.406583 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cc112-0c4a-455b-88a5-ce4607c06a07 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:07.406807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cc112-0c4a-455b-88a5-ce4607c06a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:07.424884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb0d6c-cb50-4c40-b6f9-72f8d26f1f71 service nova] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:07.426990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-94fb0d6c-cb50-4c40-b6f9-72f8d26f1f71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:07.434241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-941cc112-0c4a-455b-88a5-ce4607c06a07 None None] MFA Rules not processed for user `2a6796a4bca94d448ae6c52fd28e2c35`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:56:07.436287 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-941cc112-0c4a-455b-88a5-ce4607c06a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:07.438909 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:07.443635 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1268/2509] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:56:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:56:07.444574 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb0d6c-cb50-4c40-b6f9-72f8d26f1f71 service nova] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:07.452668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39c6a3-b387-4213-8db1-a6fac0faa512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:07.453293 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39c6a3-b387-4213-8db1-a6fac0faa512 service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:07.453886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39c6a3-b387-4213-8db1-a6fac0faa512 service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:07.453886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39c6a3-b387-4213-8db1-a6fac0faa512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:07.455745 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-cb39c6a3-b387-4213-8db1-a6fac0faa512 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:07.469139 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39c6a3-b387-4213-8db1-a6fac0faa512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:07.470792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39c6a3-b387-4213-8db1-a6fac0faa512 service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:07.483576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1242/2510] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:56:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:56:07.816683 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cc112-0c4a-455b-88a5-ce4607c06a07 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:07.818097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-941cc112-0c4a-455b-88a5-ce4607c06a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:07.830749 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cc112-0c4a-455b-88a5-ce4607c06a07 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:07.834403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d724a-79c8-4d34-adad-915b14a9c8bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:07.844206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d724a-79c8-4d34-adad-915b14a9c8bf service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:07.844206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d724a-79c8-4d34-adad-915b14a9c8bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:07.844206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d724a-79c8-4d34-adad-915b14a9c8bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:07.844206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-400d724a-79c8-4d34-adad-915b14a9c8bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:07.847798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d724a-79c8-4d34-adad-915b14a9c8bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:07.849206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d724a-79c8-4d34-adad-915b14a9c8bf service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:07.857941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1269/2511] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:56:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:56:08.348214 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39c6a3-b387-4213-8db1-a6fac0faa512 service nova] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:08.352566 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-cb39c6a3-b387-4213-8db1-a6fac0faa512 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:08.449705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39c6a3-b387-4213-8db1-a6fac0faa512 service nova] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:08.455506 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e5c28-3cc5-4633-8ac3-e9444ff94bca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256e8478e5fb4c01acde0d597bae0b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:08.456133 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e5c28-3cc5-4633-8ac3-e9444ff94bca service placement] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:08.456417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e5c28-3cc5-4633-8ac3-e9444ff94bca service placement] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:08.456688 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e5c28-3cc5-4633-8ac3-e9444ff94bca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:08.458449 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1c6e5c28-3cc5-4633-8ac3-e9444ff94bca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:08.474459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e5c28-3cc5-4633-8ac3-e9444ff94bca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:08.476399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e5c28-3cc5-4633-8ac3-e9444ff94bca service placement] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:08.490371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1243/2512] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:56:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:56:11.474548 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d724a-79c8-4d34-adad-915b14a9c8bf service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:11.493305 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d724a-79c8-4d34-adad-915b14a9c8bf service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:11.500009 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549b779-53f1-47a1-b6a0-31996626c23a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:11.500964 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549b779-53f1-47a1-b6a0-31996626c23a service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:11.501245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549b779-53f1-47a1-b6a0-31996626c23a service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:11.501638 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549b779-53f1-47a1-b6a0-31996626c23a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:11.503409 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-0549b779-53f1-47a1-b6a0-31996626c23a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:11.561457 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:11.587277 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549b779-53f1-47a1-b6a0-31996626c23a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:11.594451 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549b779-53f1-47a1-b6a0-31996626c23a service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:11.615714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1270/2513] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:56:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:56:18.845713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e5c28-3cc5-4633-8ac3-e9444ff94bca service placement] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:18.862111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e5c28-3cc5-4633-8ac3-e9444ff94bca service placement] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:18.867722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a6d3a-da65-4c4d-8b60-48a86c3fb718 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:18.868326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a6d3a-da65-4c4d-8b60-48a86c3fb718 service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:18.868607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a6d3a-da65-4c4d-8b60-48a86c3fb718 service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:18.868880 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a6d3a-da65-4c4d-8b60-48a86c3fb718 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:18.870898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-728a6d3a-da65-4c4d-8b60-48a86c3fb718 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:18.885147 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a6d3a-da65-4c4d-8b60-48a86c3fb718 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:18.886845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a6d3a-da65-4c4d-8b60-48a86c3fb718 service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:18.899088 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1244/2514] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:56:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:56:21.740660 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=8 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:28.894349 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=43 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:31.321495 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549b779-53f1-47a1-b6a0-31996626c23a service nova] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:31.323604 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-0549b779-53f1-47a1-b6a0-31996626c23a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:31.344284 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549b779-53f1-47a1-b6a0-31996626c23a service nova] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:31.350252 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a59dfb-673a-4fae-9d44-304d1c00025e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:31.351238 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a59dfb-673a-4fae-9d44-304d1c00025e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:31.351238 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a59dfb-673a-4fae-9d44-304d1c00025e admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:31.351502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a59dfb-673a-4fae-9d44-304d1c00025e admin admin] PATH_INFO: `/v3/users/47d11a6f8606484a963407a88fb92b03` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:31.352684 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a59dfb-673a-4fae-9d44-304d1c00025e admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d11a6f8606484a963407a88fb92b03)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:31.354629 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a59dfb-673a-4fae-9d44-304d1c00025e admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:31.581935 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-33a59dfb-673a-4fae-9d44-304d1c00025e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d11a6f8606484a963407a88fb92b03'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:31.662644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-33a59dfb-673a-4fae-9d44-304d1c00025e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d11a6f8606484a963407a88fb92b03'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:31.663287 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-33a59dfb-673a-4fae-9d44-304d1c00025e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d11a6f8606484a963407a88fb92b03'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:31.663932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-33a59dfb-673a-4fae-9d44-304d1c00025e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d11a6f8606484a963407a88fb92b03'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:31.672395 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-33a59dfb-673a-4fae-9d44-304d1c00025e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d11a6f8606484a963407a88fb92b03'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:31.692006 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1271/2515] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:56:31 2022] DELETE /identity/v3/users/47d11a6f8606484a963407a88fb92b03 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:56:31.957648 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a6d3a-da65-4c4d-8b60-48a86c3fb718 service nova] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:31.970623 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a6d3a-da65-4c4d-8b60-48a86c3fb718 service nova] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:32.067637 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6d322-2cae-49cd-90b1-63d625f4025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:32.068312 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6d322-2cae-49cd-90b1-63d625f4025f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:32.068595 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6d322-2cae-49cd-90b1-63d625f4025f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:32.069052 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6d322-2cae-49cd-90b1-63d625f4025f admin admin] PATH_INFO: `/v3/projects/aa402cafeb1e4f5a9e13497cfc4f2032` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:32.078129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6d322-2cae-49cd-90b1-63d625f4025f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa402cafeb1e4f5a9e13497cfc4f2032)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:32.078129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6d322-2cae-49cd-90b1-63d625f4025f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:32.269795 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-5bb6d322-2cae-49cd-90b1-63d625f4025f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa402cafeb1e4f5a9e13497cfc4f2032', 'request_id': 'req-5bb6d322-2cae-49cd-90b1-63d625f4025f'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:32.372383 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-5bb6d322-2cae-49cd-90b1-63d625f4025f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa402cafeb1e4f5a9e13497cfc4f2032', 'request_id': 'req-5bb6d322-2cae-49cd-90b1-63d625f4025f'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:32.383717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-5bb6d322-2cae-49cd-90b1-63d625f4025f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa402cafeb1e4f5a9e13497cfc4f2032', 'request_id': 'req-5bb6d322-2cae-49cd-90b1-63d625f4025f'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:32.396735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-5bb6d322-2cae-49cd-90b1-63d625f4025f admin admin] The token cache is being invalidate because project aa402cafeb1e4f5a9e13497cfc4f2032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:56:32.397023 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-5bb6d322-2cae-49cd-90b1-63d625f4025f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:32.397673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-5bb6d322-2cae-49cd-90b1-63d625f4025f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:32.399551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1245/2516] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:56:31 2022] DELETE /identity/v3/projects/aa402cafeb1e4f5a9e13497cfc4f2032 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:56:39.067556 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a59dfb-673a-4fae-9d44-304d1c00025e admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:39.069252 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-33a59dfb-673a-4fae-9d44-304d1c00025e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:39.162587 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a59dfb-673a-4fae-9d44-304d1c00025e admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:39.227336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebc935-b552-4947-9ba6-3e1cfc58d8ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:39.227336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebc935-b552-4947-9ba6-3e1cfc58d8ce service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:39.227336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebc935-b552-4947-9ba6-3e1cfc58d8ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:39.227336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebc935-b552-4947-9ba6-3e1cfc58d8ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:39.227722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-47ebc935-b552-4947-9ba6-3e1cfc58d8ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:39.240821 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:39.343132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebc935-b552-4947-9ba6-3e1cfc58d8ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:39.344672 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebc935-b552-4947-9ba6-3e1cfc58d8ce service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:39.366632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1272/2517] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:56:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:56:42.393246 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:43.677593 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6d322-2cae-49cd-90b1-63d625f4025f admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:43.679323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-5bb6d322-2cae-49cd-90b1-63d625f4025f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:43.754450 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6d322-2cae-49cd-90b1-63d625f4025f admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:43.759346 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf631c28-ee94-4e3f-a4d4-80136aa44b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:43.760022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf631c28-ee94-4e3f-a4d4-80136aa44b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:43.760304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf631c28-ee94-4e3f-a4d4-80136aa44b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:43.760577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf631c28-ee94-4e3f-a4d4-80136aa44b1c admin admin] PATH_INFO: `/v3/users/be6d79591cf14650a82b2b45fa8fd4aa` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:43.761724 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf631c28-ee94-4e3f-a4d4-80136aa44b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6d79591cf14650a82b2b45fa8fd4aa)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:43.765099 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf631c28-ee94-4e3f-a4d4-80136aa44b1c admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:43.918914 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cf631c28-ee94-4e3f-a4d4-80136aa44b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6d79591cf14650a82b2b45fa8fd4aa'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:43.921450 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cf631c28-ee94-4e3f-a4d4-80136aa44b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6d79591cf14650a82b2b45fa8fd4aa'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:43.928581 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cf631c28-ee94-4e3f-a4d4-80136aa44b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6d79591cf14650a82b2b45fa8fd4aa'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:43.941191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cf631c28-ee94-4e3f-a4d4-80136aa44b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6d79591cf14650a82b2b45fa8fd4aa'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:43.951286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cf631c28-ee94-4e3f-a4d4-80136aa44b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6d79591cf14650a82b2b45fa8fd4aa'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:44.025839 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1246/2518] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:56:43 2022] DELETE /identity/v3/users/be6d79591cf14650a82b2b45fa8fd4aa => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:56:44.347673 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebc935-b552-4947-9ba6-3e1cfc58d8ce service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:44.358816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebc935-b552-4947-9ba6-3e1cfc58d8ce service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:44.426315 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4d7d7-99ea-4f59-a353-e1d4666e3f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:44.426959 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4d7d7-99ea-4f59-a353-e1d4666e3f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:44.427235 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4d7d7-99ea-4f59-a353-e1d4666e3f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:44.427606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4d7d7-99ea-4f59-a353-e1d4666e3f19 admin admin] PATH_INFO: `/v3/projects/176bef4a9374446f8965a2d079830741` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:44.428754 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4d7d7-99ea-4f59-a353-e1d4666e3f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=176bef4a9374446f8965a2d079830741)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:44.430701 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4d7d7-99ea-4f59-a353-e1d4666e3f19 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:44.545483 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f9b4d7d7-99ea-4f59-a353-e1d4666e3f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176bef4a9374446f8965a2d079830741', 'request_id': 'req-f9b4d7d7-99ea-4f59-a353-e1d4666e3f19'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:44.551923 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f9b4d7d7-99ea-4f59-a353-e1d4666e3f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176bef4a9374446f8965a2d079830741', 'request_id': 'req-f9b4d7d7-99ea-4f59-a353-e1d4666e3f19'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:44.628517 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f9b4d7d7-99ea-4f59-a353-e1d4666e3f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176bef4a9374446f8965a2d079830741', 'request_id': 'req-f9b4d7d7-99ea-4f59-a353-e1d4666e3f19'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:44.630898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:44.640200 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f9b4d7d7-99ea-4f59-a353-e1d4666e3f19 admin admin] The token cache is being invalidate because project 176bef4a9374446f8965a2d079830741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:56:44.648755 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f9b4d7d7-99ea-4f59-a353-e1d4666e3f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:44.648755 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-f9b4d7d7-99ea-4f59-a353-e1d4666e3f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:44.648755 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1273/2519] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:56:44 2022] DELETE /identity/v3/projects/176bef4a9374446f8965a2d079830741 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:56:44.649065 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd39e06-91f8-4eb3-9b4a-fb9d9a9feb26 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:44.649065 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd39e06-91f8-4eb3-9b4a-fb9d9a9feb26 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:44.649065 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd39e06-91f8-4eb3-9b4a-fb9d9a9feb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:44.708733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-3bd39e06-91f8-4eb3-9b4a-fb9d9a9feb26 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:56:44.709952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3bd39e06-91f8-4eb3-9b4a-fb9d9a9feb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:44.755033 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:44.770224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1247/2520] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:56:44.778281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d4c1f-211e-4c06-8c49-6c7be7ec21da None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:44.779251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d4c1f-211e-4c06-8c49-6c7be7ec21da None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:44.779516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d4c1f-211e-4c06-8c49-6c7be7ec21da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:44.800097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-af6d4c1f-211e-4c06-8c49-6c7be7ec21da None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:56:44.801216 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-af6d4c1f-211e-4c06-8c49-6c7be7ec21da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:44.809199 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1274/2521] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:56:44.813681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd39e06-91f8-4eb3-9b4a-fb9d9a9feb26 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:44.823461 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd39e06-91f8-4eb3-9b4a-fb9d9a9feb26 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:44.828720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b188a2-e380-4067-a485-f19a34b9cf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:44.830804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b188a2-e380-4067-a485-f19a34b9cf7f admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:44.830804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b188a2-e380-4067-a485-f19a34b9cf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:44.830804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b188a2-e380-4067-a485-f19a34b9cf7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:44.830804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b188a2-e380-4067-a485-f19a34b9cf7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:56:44.830804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b188a2-e380-4067-a485-f19a34b9cf7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:44.832362 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b188a2-e380-4067-a485-f19a34b9cf7f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:44.844798 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1248/2522] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:56:44.849339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d4c1f-211e-4c06-8c49-6c7be7ec21da None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:44.858828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d4c1f-211e-4c06-8c49-6c7be7ec21da None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:44.863675 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84385f-183d-43e0-b40f-e2e7faabc0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:44.864277 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84385f-183d-43e0-b40f-e2e7faabc0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:44.864553 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84385f-183d-43e0-b40f-e2e7faabc0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:44.864826 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84385f-183d-43e0-b40f-e2e7faabc0c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:44.865463 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84385f-183d-43e0-b40f-e2e7faabc0c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:44.867362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84385f-183d-43e0-b40f-e2e7faabc0c2 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:44.987394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1275/2523] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:56:44 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:56:44.991835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b188a2-e380-4067-a485-f19a34b9cf7f admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:45.002527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b188a2-e380-4067-a485-f19a34b9cf7f admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:45.061969 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492564b-438c-4bac-8fb9-9a617e8c4f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:45.062520 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492564b-438c-4bac-8fb9-9a617e8c4f21 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:45.062851 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492564b-438c-4bac-8fb9-9a617e8c4f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:45.063158 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492564b-438c-4bac-8fb9-9a617e8c4f21 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:45.063827 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492564b-438c-4bac-8fb9-9a617e8c4f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:45.065755 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492564b-438c-4bac-8fb9-9a617e8c4f21 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:45.171935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1249/2524] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:56:44 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:56:45.176040 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84385f-183d-43e0-b40f-e2e7faabc0c2 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:45.187272 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84385f-183d-43e0-b40f-e2e7faabc0c2 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:45.192125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab1ba0-762d-4e9c-81e8-125900cda567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:45.192716 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab1ba0-762d-4e9c-81e8-125900cda567 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:45.192994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab1ba0-762d-4e9c-81e8-125900cda567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:45.193264 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab1ba0-762d-4e9c-81e8-125900cda567 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:45.193896 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab1ba0-762d-4e9c-81e8-125900cda567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:45.195538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab1ba0-762d-4e9c-81e8-125900cda567 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:45.206188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1276/2525] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:56:45.210267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492564b-438c-4bac-8fb9-9a617e8c4f21 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:45.221089 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492564b-438c-4bac-8fb9-9a617e8c4f21 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:45.225818 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ab692-864e-4c9a-b570-03d95602f67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:45.226424 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ab692-864e-4c9a-b570-03d95602f67b admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:45.226675 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ab692-864e-4c9a-b570-03d95602f67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:45.226948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ab692-864e-4c9a-b570-03d95602f67b admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:45.227624 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ab692-864e-4c9a-b570-03d95602f67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:45.229219 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ab692-864e-4c9a-b570-03d95602f67b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:45.239908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1250/2526] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:56:45.244272 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab1ba0-762d-4e9c-81e8-125900cda567 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:45.254828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab1ba0-762d-4e9c-81e8-125900cda567 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:45.259583 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2772774-e518-4c70-8d91-710a6dee3ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:45.260857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2772774-e518-4c70-8d91-710a6dee3ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:45.260857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2772774-e518-4c70-8d91-710a6dee3ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:45.260857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2772774-e518-4c70-8d91-710a6dee3ed8 admin admin] PATH_INFO: `/v3/projects/9004a6e9af45467f9e01695fccfbde1e/users/f7230e49adf94ab091076c98da51f9c9/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:45.277404 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2772774-e518-4c70-8d91-710a6dee3ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9004a6e9af45467f9e01695fccfbde1e, user_id=f7230e49adf94ab091076c98da51f9c9, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:45.280079 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2772774-e518-4c70-8d91-710a6dee3ed8 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:45.348401 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1277/2527] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:56:45 2022] PUT /identity/v3/projects/9004a6e9af45467f9e01695fccfbde1e/users/f7230e49adf94ab091076c98da51f9c9/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:56:45.359943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8252d-6c93-4486-a992-48c58d568cea None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:45.360310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8252d-6c93-4486-a992-48c58d568cea None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:45.360584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8252d-6c93-4486-a992-48c58d568cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:45.391294 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-b8e8252d-6c93-4486-a992-48c58d568cea None None] MFA Rules not processed for user `f7230e49adf94ab091076c98da51f9c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:56:45.392957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b8e8252d-6c93-4486-a992-48c58d568cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:45.463066 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1251/2528] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:56:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:56:45.475090 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2772774-e518-4c70-8d91-710a6dee3ed8 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:45.476836 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a2772774-e518-4c70-8d91-710a6dee3ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:45.554092 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2772774-e518-4c70-8d91-710a6dee3ed8 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:45.560236 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8eb41-9aeb-465a-ba0f-40aefef55bcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:45.561149 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8eb41-9aeb-465a-ba0f-40aefef55bcc service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:45.561434 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8eb41-9aeb-465a-ba0f-40aefef55bcc service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:45.561707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8eb41-9aeb-465a-ba0f-40aefef55bcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:45.570285 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8eb41-9aeb-465a-ba0f-40aefef55bcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:45.571935 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8eb41-9aeb-465a-ba0f-40aefef55bcc service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:45.582188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1278/2529] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:56:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:56:51.883404 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8252d-6c93-4486-a992-48c58d568cea None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:51.932619 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:51.950373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8252d-6c93-4486-a992-48c58d568cea None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:51.955648 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865ff05-3b0f-419a-b063-7a5f321c2394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:51.956288 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865ff05-3b0f-419a-b063-7a5f321c2394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:51.956569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865ff05-3b0f-419a-b063-7a5f321c2394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:51.956843 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865ff05-3b0f-419a-b063-7a5f321c2394 admin admin] PATH_INFO: `/v3/users/f7230e49adf94ab091076c98da51f9c9` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:51.957971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865ff05-3b0f-419a-b063-7a5f321c2394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7230e49adf94ab091076c98da51f9c9)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:51.959955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865ff05-3b0f-419a-b063-7a5f321c2394 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:52.136124 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a865ff05-3b0f-419a-b063-7a5f321c2394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7230e49adf94ab091076c98da51f9c9'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:52.136775 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a865ff05-3b0f-419a-b063-7a5f321c2394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7230e49adf94ab091076c98da51f9c9'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:52.144033 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a865ff05-3b0f-419a-b063-7a5f321c2394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7230e49adf94ab091076c98da51f9c9'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:52.156273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a865ff05-3b0f-419a-b063-7a5f321c2394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7230e49adf94ab091076c98da51f9c9'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:52.157524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-a865ff05-3b0f-419a-b063-7a5f321c2394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7230e49adf94ab091076c98da51f9c9'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:52.231228 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1252/2530] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:56:51 2022] DELETE /identity/v3/users/f7230e49adf94ab091076c98da51f9c9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:56:52.236630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7f868-d9c4-445b-b6c9-3f823a8ea4fd None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:52.237138 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7f868-d9c4-445b-b6c9-3f823a8ea4fd None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:52.237257 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7f868-d9c4-445b-b6c9-3f823a8ea4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:52.258026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8fb7f868-d9c4-445b-b6c9-3f823a8ea4fd None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:56:52.259362 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8fb7f868-d9c4-445b-b6c9-3f823a8ea4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:52.322952 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1279/2531] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:56:52.333523 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865ff05-3b0f-419a-b063-7a5f321c2394 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:52.335534 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a865ff05-3b0f-419a-b063-7a5f321c2394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:52.439333 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865ff05-3b0f-419a-b063-7a5f321c2394 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:52.445579 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20947d18-56b5-418f-bbc3-d8ecff195254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:52.445579 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947d18-56b5-418f-bbc3-d8ecff195254 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:52.445579 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947d18-56b5-418f-bbc3-d8ecff195254 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:52.445579 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947d18-56b5-418f-bbc3-d8ecff195254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:52.472025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20947d18-56b5-418f-bbc3-d8ecff195254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:52.472025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20947d18-56b5-418f-bbc3-d8ecff195254 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:52.474933 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1253/2532] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:56:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:56:52.939894 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7f868-d9c4-445b-b6c9-3f823a8ea4fd None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:52.941898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8fb7f868-d9c4-445b-b6c9-3f823a8ea4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:52.954454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:52.966746 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7f868-d9c4-445b-b6c9-3f823a8ea4fd None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:52.973031 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdc023-f3e3-4763-b38e-f897b60732b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:52.973637 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdc023-f3e3-4763-b38e-f897b60732b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:52.973942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdc023-f3e3-4763-b38e-f897b60732b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:52.974182 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdc023-f3e3-4763-b38e-f897b60732b8 admin admin] PATH_INFO: `/v3/projects/9004a6e9af45467f9e01695fccfbde1e` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:52.975356 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdc023-f3e3-4763-b38e-f897b60732b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9004a6e9af45467f9e01695fccfbde1e)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:52.977329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdc023-f3e3-4763-b38e-f897b60732b8 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:53.090242 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-2dcdc023-f3e3-4763-b38e-f897b60732b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9004a6e9af45467f9e01695fccfbde1e', 'request_id': 'req-2dcdc023-f3e3-4763-b38e-f897b60732b8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:53.096928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-2dcdc023-f3e3-4763-b38e-f897b60732b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9004a6e9af45467f9e01695fccfbde1e', 'request_id': 'req-2dcdc023-f3e3-4763-b38e-f897b60732b8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:53.202966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-2dcdc023-f3e3-4763-b38e-f897b60732b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9004a6e9af45467f9e01695fccfbde1e', 'request_id': 'req-2dcdc023-f3e3-4763-b38e-f897b60732b8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:53.214153 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-2dcdc023-f3e3-4763-b38e-f897b60732b8 admin admin] The token cache is being invalidate because project 9004a6e9af45467f9e01695fccfbde1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:56:53.215517 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-2dcdc023-f3e3-4763-b38e-f897b60732b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:53.215517 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-2dcdc023-f3e3-4763-b38e-f897b60732b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:53.216586 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1280/2533] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:56:52 2022] DELETE /identity/v3/projects/9004a6e9af45467f9e01695fccfbde1e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:56:53.221774 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20feb8-5de5-420e-aef7-a5fb1a486476 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:53.222296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20feb8-5de5-420e-aef7-a5fb1a486476 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:53.222296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20feb8-5de5-420e-aef7-a5fb1a486476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:53.242267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-0b20feb8-5de5-420e-aef7-a5fb1a486476 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:56:53.243512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0b20feb8-5de5-420e-aef7-a5fb1a486476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:53.286527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:53.305157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1254/2534] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:56:53.314473 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157c829-6f4c-4b1d-a234-c19aaa28f1c1 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:53.314943 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157c829-6f4c-4b1d-a234-c19aaa28f1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:53.315170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157c829-6f4c-4b1d-a234-c19aaa28f1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:53.336240 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-1157c829-6f4c-4b1d-a234-c19aaa28f1c1 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:56:53.337369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1157c829-6f4c-4b1d-a234-c19aaa28f1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:53.345457 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1281/2535] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:56:53.349888 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20feb8-5de5-420e-aef7-a5fb1a486476 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:53.360588 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20feb8-5de5-420e-aef7-a5fb1a486476 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:53.366035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd2dc9-e689-4858-ac9b-95e55ec8283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:53.366634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2dc9-e689-4858-ac9b-95e55ec8283b admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:53.366913 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2dc9-e689-4858-ac9b-95e55ec8283b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:53.367186 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2dc9-e689-4858-ac9b-95e55ec8283b admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:53.367880 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd2dc9-e689-4858-ac9b-95e55ec8283b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:56:53.368459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd2dc9-e689-4858-ac9b-95e55ec8283b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:53.370119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd2dc9-e689-4858-ac9b-95e55ec8283b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:53.382471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1255/2536] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:56:53.386783 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157c829-6f4c-4b1d-a234-c19aaa28f1c1 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:53.396675 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157c829-6f4c-4b1d-a234-c19aaa28f1c1 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:53.401385 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71251ef-8d00-40ad-849b-206babe28f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:53.401980 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71251ef-8d00-40ad-849b-206babe28f70 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:53.402258 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71251ef-8d00-40ad-849b-206babe28f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:53.402529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71251ef-8d00-40ad-849b-206babe28f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:53.403167 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71251ef-8d00-40ad-849b-206babe28f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:53.405139 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71251ef-8d00-40ad-849b-206babe28f70 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:53.584848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1282/2537] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:56:53 2022] POST /identity/v3/projects => generated 405 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:56:53.589066 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd2dc9-e689-4858-ac9b-95e55ec8283b admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:53.599247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd2dc9-e689-4858-ac9b-95e55ec8283b admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:53.654835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b40fd-62fc-4288-ba6f-63ee03f88b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:53.655665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b40fd-62fc-4288-ba6f-63ee03f88b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:53.655941 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b40fd-62fc-4288-ba6f-63ee03f88b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:53.656210 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b40fd-62fc-4288-ba6f-63ee03f88b25 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:53.656852 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b40fd-62fc-4288-ba6f-63ee03f88b25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:53.658770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b40fd-62fc-4288-ba6f-63ee03f88b25 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:53.763673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1256/2538] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:56:53 2022] POST /identity/v3/users => generated 303 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:56:53.768230 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71251ef-8d00-40ad-849b-206babe28f70 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:53.779074 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71251ef-8d00-40ad-849b-206babe28f70 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:53.785043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8e9e9-b2ca-4029-b369-4b7426d7d9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:53.788341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8e9e9-b2ca-4029-b369-4b7426d7d9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:53.788341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8e9e9-b2ca-4029-b369-4b7426d7d9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:53.788341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8e9e9-b2ca-4029-b369-4b7426d7d9d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:53.788341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8e9e9-b2ca-4029-b369-4b7426d7d9d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:53.788775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8e9e9-b2ca-4029-b369-4b7426d7d9d8 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:53.800421 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1283/2539] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:56:53.804501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b40fd-62fc-4288-ba6f-63ee03f88b25 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:53.814944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b40fd-62fc-4288-ba6f-63ee03f88b25 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:53.819589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5acd52-aa57-4e9b-9ec8-632385ae4acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:53.820217 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5acd52-aa57-4e9b-9ec8-632385ae4acc admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:53.820510 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5acd52-aa57-4e9b-9ec8-632385ae4acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:53.820779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5acd52-aa57-4e9b-9ec8-632385ae4acc admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:53.821409 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5acd52-aa57-4e9b-9ec8-632385ae4acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:53.822996 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5acd52-aa57-4e9b-9ec8-632385ae4acc admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:53.833705 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1257/2540] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:56:53.838214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8e9e9-b2ca-4029-b369-4b7426d7d9d8 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:53.849185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8e9e9-b2ca-4029-b369-4b7426d7d9d8 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:53.853782 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1ab5d-8356-4879-8f36-759ef3a94fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:53.854427 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1ab5d-8356-4879-8f36-759ef3a94fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:53.854707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1ab5d-8356-4879-8f36-759ef3a94fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:53.854981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1ab5d-8356-4879-8f36-759ef3a94fc6 admin admin] PATH_INFO: `/v3/projects/6be3f45f2cb14e799e8b3ebd8b48b00b/users/b857eb823bd64ccfb32ab6616a9645b9/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:53.870919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1ab5d-8356-4879-8f36-759ef3a94fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be3f45f2cb14e799e8b3ebd8b48b00b, user_id=b857eb823bd64ccfb32ab6616a9645b9, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:53.874803 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1ab5d-8356-4879-8f36-759ef3a94fc6 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:53.952296 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1284/2541] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:56:53 2022] PUT /identity/v3/projects/6be3f45f2cb14e799e8b3ebd8b48b00b/users/b857eb823bd64ccfb32ab6616a9645b9/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:56:53.963728 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0717b-ff6d-4a5a-9f19-515f4495d5ad None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:53.964173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0717b-ff6d-4a5a-9f19-515f4495d5ad None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:53.964512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0717b-ff6d-4a5a-9f19-515f4495d5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:53.980853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1ab5d-8356-4879-8f36-759ef3a94fc6 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:53.986184 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a6d1ab5d-8356-4879-8f36-759ef3a94fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:53.997869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-94b0717b-ff6d-4a5a-9f19-515f4495d5ad None None] MFA Rules not processed for user `b857eb823bd64ccfb32ab6616a9645b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:56:53.999244 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-94b0717b-ff6d-4a5a-9f19-515f4495d5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:54.047352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1ab5d-8356-4879-8f36-759ef3a94fc6 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:54.051774 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d10743-1971-42ff-ad2f-d8b07290cf83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:54.052381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d10743-1971-42ff-ad2f-d8b07290cf83 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:54.052656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d10743-1971-42ff-ad2f-d8b07290cf83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:54.052926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d10743-1971-42ff-ad2f-d8b07290cf83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:54.055011 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-18d10743-1971-42ff-ad2f-d8b07290cf83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:54.074041 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1258/2542] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:56:53 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:56:54.079623 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0717b-ff6d-4a5a-9f19-515f4495d5ad None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:54.106403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:54.130614 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d10743-1971-42ff-ad2f-d8b07290cf83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:54.132180 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d10743-1971-42ff-ad2f-d8b07290cf83 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:54.138011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:54.144007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1285/2543] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:56:54.165257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0717b-ff6d-4a5a-9f19-515f4495d5ad None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:54.170463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a4d69-147c-49fc-a703-5257cb6a19b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:54.171312 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a4d69-147c-49fc-a703-5257cb6a19b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:54.171633 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a4d69-147c-49fc-a703-5257cb6a19b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:54.171908 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a4d69-147c-49fc-a703-5257cb6a19b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:54.172551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a4d69-147c-49fc-a703-5257cb6a19b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:54.174473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a4d69-147c-49fc-a703-5257cb6a19b2 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:54.293198 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1259/2544] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:56:54 2022] POST /identity/v3/projects => generated 405 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:56:54.297500 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d10743-1971-42ff-ad2f-d8b07290cf83 service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:54.307702 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d10743-1971-42ff-ad2f-d8b07290cf83 service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:54.370715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fd3cd-9516-4cd7-b496-3a575c6a5426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:54.371403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fd3cd-9516-4cd7-b496-3a575c6a5426 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:54.371548 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fd3cd-9516-4cd7-b496-3a575c6a5426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:54.371848 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fd3cd-9516-4cd7-b496-3a575c6a5426 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:54.372493 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fd3cd-9516-4cd7-b496-3a575c6a5426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:54.374531 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fd3cd-9516-4cd7-b496-3a575c6a5426 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:54.468869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1286/2545] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:56:54 2022] POST /identity/v3/users => generated 309 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:56:54.470224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a4d69-147c-49fc-a703-5257cb6a19b2 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:54.481246 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a4d69-147c-49fc-a703-5257cb6a19b2 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:54.487062 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e186d0-aaa8-4a1c-bb97-496c0f9269bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:54.487736 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e186d0-aaa8-4a1c-bb97-496c0f9269bb admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:54.488152 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e186d0-aaa8-4a1c-bb97-496c0f9269bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:54.488338 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e186d0-aaa8-4a1c-bb97-496c0f9269bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:54.488978 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e186d0-aaa8-4a1c-bb97-496c0f9269bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:54.490582 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e186d0-aaa8-4a1c-bb97-496c0f9269bb admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:54.501883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1260/2546] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:56:54.506342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fd3cd-9516-4cd7-b496-3a575c6a5426 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:54.517403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fd3cd-9516-4cd7-b496-3a575c6a5426 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:54.522076 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada1d45-d182-4092-aad7-161bb57ec1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:54.522756 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada1d45-d182-4092-aad7-161bb57ec1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:54.523068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada1d45-d182-4092-aad7-161bb57ec1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:54.523366 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada1d45-d182-4092-aad7-161bb57ec1f5 admin admin] PATH_INFO: `/v3/projects/f9ef65c6e6f748fbb96445661a593ff3/users/58504af5dca44efdbd906837072ff1db/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:54.540919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada1d45-d182-4092-aad7-161bb57ec1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ef65c6e6f748fbb96445661a593ff3, user_id=58504af5dca44efdbd906837072ff1db, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:54.543595 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada1d45-d182-4092-aad7-161bb57ec1f5 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:54.626857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1287/2547] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:56:54 2022] PUT /identity/v3/projects/f9ef65c6e6f748fbb96445661a593ff3/users/58504af5dca44efdbd906837072ff1db/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:56:54.628537 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e186d0-aaa8-4a1c-bb97-496c0f9269bb admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:54.640136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e186d0-aaa8-4a1c-bb97-496c0f9269bb admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:54.717483 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba84c1-1f13-4b8b-a7e3-78bcac0aabdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:54.718184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba84c1-1f13-4b8b-a7e3-78bcac0aabdd admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:54.718452 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba84c1-1f13-4b8b-a7e3-78bcac0aabdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:54.718719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba84c1-1f13-4b8b-a7e3-78bcac0aabdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:54.719373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba84c1-1f13-4b8b-a7e3-78bcac0aabdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:54.721062 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba84c1-1f13-4b8b-a7e3-78bcac0aabdd admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:54.737829 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1261/2548] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:56:54.739913 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada1d45-d182-4092-aad7-161bb57ec1f5 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:54.751341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada1d45-d182-4092-aad7-161bb57ec1f5 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:54.757457 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fe123-9fb6-4953-ae31-227137ce4d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:54.757898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fe123-9fb6-4953-ae31-227137ce4d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:54.758261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fe123-9fb6-4953-ae31-227137ce4d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:54.758621 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fe123-9fb6-4953-ae31-227137ce4d48 admin admin] PATH_INFO: `/v3/projects/f9ef65c6e6f748fbb96445661a593ff3/users/58504af5dca44efdbd906837072ff1db/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:54.760645 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fe123-9fb6-4953-ae31-227137ce4d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ef65c6e6f748fbb96445661a593ff3, user_id=58504af5dca44efdbd906837072ff1db, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:54.763373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fe123-9fb6-4953-ae31-227137ce4d48 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:54.776164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1288/2549] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:56:54 2022] PUT /identity/v3/projects/f9ef65c6e6f748fbb96445661a593ff3/users/58504af5dca44efdbd906837072ff1db/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:56:54.788319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d76ed-842a-4546-a82f-a39722e71a48 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:54.788623 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d76ed-842a-4546-a82f-a39722e71a48 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:54.788874 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d76ed-842a-4546-a82f-a39722e71a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:54.823536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-ef8d76ed-842a-4546-a82f-a39722e71a48 None None] MFA Rules not processed for user `58504af5dca44efdbd906837072ff1db`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:56:54.824797 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ef8d76ed-842a-4546-a82f-a39722e71a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:54.923488 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1262/2550] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:56:54 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:56:54.934672 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fe123-9fb6-4953-ae31-227137ce4d48 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:54.937262 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-641fe123-9fb6-4953-ae31-227137ce4d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:55.154989 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fe123-9fb6-4953-ae31-227137ce4d48 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:55.158766 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f2a40-c1fb-48d6-b078-9d24a30332d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:55.159538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f2a40-c1fb-48d6-b078-9d24a30332d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:55.159857 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f2a40-c1fb-48d6-b078-9d24a30332d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:55.160192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f2a40-c1fb-48d6-b078-9d24a30332d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:55.171520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f2a40-c1fb-48d6-b078-9d24a30332d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:55.173052 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f2a40-c1fb-48d6-b078-9d24a30332d0 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:55.184164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1289/2551] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:56:54 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:56:55.349206 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d76ed-842a-4546-a82f-a39722e71a48 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:55.400333 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:55.425713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d76ed-842a-4546-a82f-a39722e71a48 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:55.430461 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a509ed1-021f-4810-b7bc-b0bd6f9c95ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:55.431012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509ed1-021f-4810-b7bc-b0bd6f9c95ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:55.431284 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509ed1-021f-4810-b7bc-b0bd6f9c95ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:55.431604 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509ed1-021f-4810-b7bc-b0bd6f9c95ff admin admin] PATH_INFO: `/v3/users/b857eb823bd64ccfb32ab6616a9645b9` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:55.432821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a509ed1-021f-4810-b7bc-b0bd6f9c95ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b857eb823bd64ccfb32ab6616a9645b9)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:55.434858 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a509ed1-021f-4810-b7bc-b0bd6f9c95ff admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:55.630519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0a509ed1-021f-4810-b7bc-b0bd6f9c95ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b857eb823bd64ccfb32ab6616a9645b9'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:55.631220 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0a509ed1-021f-4810-b7bc-b0bd6f9c95ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b857eb823bd64ccfb32ab6616a9645b9'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:55.639587 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0a509ed1-021f-4810-b7bc-b0bd6f9c95ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b857eb823bd64ccfb32ab6616a9645b9'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:55.658598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0a509ed1-021f-4810-b7bc-b0bd6f9c95ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b857eb823bd64ccfb32ab6616a9645b9'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:55.659196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0a509ed1-021f-4810-b7bc-b0bd6f9c95ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b857eb823bd64ccfb32ab6616a9645b9'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:55.743589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1263/2552] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:56:55 2022] DELETE /identity/v3/users/b857eb823bd64ccfb32ab6616a9645b9 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:56:55.748095 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf8214-785c-498d-ab57-15f8dc28520a None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:55.749767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf8214-785c-498d-ab57-15f8dc28520a None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:55.750216 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf8214-785c-498d-ab57-15f8dc28520a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:55.771961 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-53cf8214-785c-498d-ab57-15f8dc28520a None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:56:55.773189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-53cf8214-785c-498d-ab57-15f8dc28520a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:55.777869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:55.855462 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1290/2553] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:56:55.872670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a509ed1-021f-4810-b7bc-b0bd6f9c95ff admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:55.875854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0a509ed1-021f-4810-b7bc-b0bd6f9c95ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:55.983769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a509ed1-021f-4810-b7bc-b0bd6f9c95ff admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:55.987408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0178f4-6c27-4797-9be2-2bfdc46933f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:55.988083 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0178f4-6c27-4797-9be2-2bfdc46933f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:55.988348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0178f4-6c27-4797-9be2-2bfdc46933f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:55.988618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0178f4-6c27-4797-9be2-2bfdc46933f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:55.998653 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0178f4-6c27-4797-9be2-2bfdc46933f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:56.000934 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0178f4-6c27-4797-9be2-2bfdc46933f5 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:56.012202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1264/2554] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:56:56.951020 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf8214-785c-498d-ab57-15f8dc28520a None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:56.955308 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-53cf8214-785c-498d-ab57-15f8dc28520a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:56.983748 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf8214-785c-498d-ab57-15f8dc28520a None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:56.989400 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcfc0c-2233-46c2-8e57-473f78398185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:56.990130 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcfc0c-2233-46c2-8e57-473f78398185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:56.990408 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcfc0c-2233-46c2-8e57-473f78398185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:56.990734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcfc0c-2233-46c2-8e57-473f78398185 admin admin] PATH_INFO: `/v3/projects/6be3f45f2cb14e799e8b3ebd8b48b00b` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:56.992324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcfc0c-2233-46c2-8e57-473f78398185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be3f45f2cb14e799e8b3ebd8b48b00b)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:56.994702 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcfc0c-2233-46c2-8e57-473f78398185 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:57.156180 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-28dcfc0c-2233-46c2-8e57-473f78398185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be3f45f2cb14e799e8b3ebd8b48b00b', 'request_id': 'req-28dcfc0c-2233-46c2-8e57-473f78398185'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:57.162595 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-28dcfc0c-2233-46c2-8e57-473f78398185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be3f45f2cb14e799e8b3ebd8b48b00b', 'request_id': 'req-28dcfc0c-2233-46c2-8e57-473f78398185'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:57.257640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-28dcfc0c-2233-46c2-8e57-473f78398185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be3f45f2cb14e799e8b3ebd8b48b00b', 'request_id': 'req-28dcfc0c-2233-46c2-8e57-473f78398185'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:57.273211 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-28dcfc0c-2233-46c2-8e57-473f78398185 admin admin] The token cache is being invalidate because project 6be3f45f2cb14e799e8b3ebd8b48b00b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:56:57.273503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-28dcfc0c-2233-46c2-8e57-473f78398185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:57.284495 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-28dcfc0c-2233-46c2-8e57-473f78398185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:57.284495 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1291/2555] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:56:56 2022] DELETE /identity/v3/projects/6be3f45f2cb14e799e8b3ebd8b48b00b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:56:57.284815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0178f4-6c27-4797-9be2-2bfdc46933f5 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:57.298330 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0178f4-6c27-4797-9be2-2bfdc46933f5 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:57.384704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f514d-5a2c-4762-9a5d-5ea9a58870d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:57.385703 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f514d-5a2c-4762-9a5d-5ea9a58870d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:57.386209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f514d-5a2c-4762-9a5d-5ea9a58870d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:57.386704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f514d-5a2c-4762-9a5d-5ea9a58870d0 admin admin] PATH_INFO: `/v3/users/58504af5dca44efdbd906837072ff1db` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:57.388801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f514d-5a2c-4762-9a5d-5ea9a58870d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58504af5dca44efdbd906837072ff1db)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:57.393469 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f514d-5a2c-4762-9a5d-5ea9a58870d0 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:57.396413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:57.748695 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c95f514d-5a2c-4762-9a5d-5ea9a58870d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58504af5dca44efdbd906837072ff1db'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:57.749818 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c95f514d-5a2c-4762-9a5d-5ea9a58870d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58504af5dca44efdbd906837072ff1db'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:57.762380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c95f514d-5a2c-4762-9a5d-5ea9a58870d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58504af5dca44efdbd906837072ff1db'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:57.781751 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c95f514d-5a2c-4762-9a5d-5ea9a58870d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58504af5dca44efdbd906837072ff1db'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:57.782505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c95f514d-5a2c-4762-9a5d-5ea9a58870d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58504af5dca44efdbd906837072ff1db'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:57.884326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1265/2556] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:56:57 2022] DELETE /identity/v3/users/58504af5dca44efdbd906837072ff1db => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:56:58.828427 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcfc0c-2233-46c2-8e57-473f78398185 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:58.832686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-28dcfc0c-2233-46c2-8e57-473f78398185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:58.837167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f514d-5a2c-4762-9a5d-5ea9a58870d0 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:58.839225 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c95f514d-5a2c-4762-9a5d-5ea9a58870d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:58.847678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcfc0c-2233-46c2-8e57-473f78398185 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:58.919189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de54056-b960-4293-8c36-a6a4e762663c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:58.919875 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de54056-b960-4293-8c36-a6a4e762663c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:58.920690 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de54056-b960-4293-8c36-a6a4e762663c admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:58.921919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de54056-b960-4293-8c36-a6a4e762663c admin admin] PATH_INFO: `/v3/projects/f9ef65c6e6f748fbb96445661a593ff3` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:58.923087 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f514d-5a2c-4762-9a5d-5ea9a58870d0 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:58.923289 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de54056-b960-4293-8c36-a6a4e762663c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ef65c6e6f748fbb96445661a593ff3)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:58.925164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de54056-b960-4293-8c36-a6a4e762663c admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:58.929751 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66f474-e21e-49c8-a320-6819c508623d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:58.930548 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66f474-e21e-49c8-a320-6819c508623d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:58.930906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66f474-e21e-49c8-a320-6819c508623d admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:58.931327 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66f474-e21e-49c8-a320-6819c508623d admin admin] PATH_INFO: `/v3/users/7a3f8b78523e4c3790b049fc783c96fd` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:58.933048 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66f474-e21e-49c8-a320-6819c508623d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a3f8b78523e4c3790b049fc783c96fd)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:58.936623 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66f474-e21e-49c8-a320-6819c508623d admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:59.104704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:59.117403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9de54056-b960-4293-8c36-a6a4e762663c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ef65c6e6f748fbb96445661a593ff3', 'request_id': 'req-9de54056-b960-4293-8c36-a6a4e762663c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:59.123936 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9de54056-b960-4293-8c36-a6a4e762663c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ef65c6e6f748fbb96445661a593ff3', 'request_id': 'req-9de54056-b960-4293-8c36-a6a4e762663c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:59.293818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9de54056-b960-4293-8c36-a6a4e762663c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ef65c6e6f748fbb96445661a593ff3', 'request_id': 'req-9de54056-b960-4293-8c36-a6a4e762663c'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:59.306422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9de54056-b960-4293-8c36-a6a4e762663c admin admin] The token cache is being invalidate because project f9ef65c6e6f748fbb96445661a593ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:56:59.306723 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9de54056-b960-4293-8c36-a6a4e762663c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:59.307687 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9de54056-b960-4293-8c36-a6a4e762663c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:59.310137 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1292/2557] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:56:58 2022] DELETE /identity/v3/projects/f9ef65c6e6f748fbb96445661a593ff3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:56:59.313996 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-6b66f474-e21e-49c8-a320-6819c508623d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a3f8b78523e4c3790b049fc783c96fd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:59.314776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-6b66f474-e21e-49c8-a320-6819c508623d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a3f8b78523e4c3790b049fc783c96fd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:59.315694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cea88-9a51-4626-aeef-0e83014a39df None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:59.316101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cea88-9a51-4626-aeef-0e83014a39df None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:59.316405 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cea88-9a51-4626-aeef-0e83014a39df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:59.325476 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-6b66f474-e21e-49c8-a320-6819c508623d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a3f8b78523e4c3790b049fc783c96fd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:59.340228 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-842cea88-9a51-4626-aeef-0e83014a39df None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:56:59.341558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-842cea88-9a51-4626-aeef-0e83014a39df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:59.343286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-6b66f474-e21e-49c8-a320-6819c508623d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a3f8b78523e4c3790b049fc783c96fd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:59.344599 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-6b66f474-e21e-49c8-a320-6819c508623d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a3f8b78523e4c3790b049fc783c96fd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:56:59.417758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1293/2558] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:56:59.425792 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2d33-18d9-4543-8039-08102ba5f438 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:59.426071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2d33-18d9-4543-8039-08102ba5f438 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:59.426344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2d33-18d9-4543-8039-08102ba5f438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:59.448372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-07ac2d33-18d9-4543-8039-08102ba5f438 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:56:59.449618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-07ac2d33-18d9-4543-8039-08102ba5f438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:59.458461 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1294/2559] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:56:59.463593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac2d33-18d9-4543-8039-08102ba5f438 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:59.475148 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac2d33-18d9-4543-8039-08102ba5f438 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:59.480423 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20720d04-c6c2-48b1-908d-6db596e593cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:59.481061 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20720d04-c6c2-48b1-908d-6db596e593cb admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:59.481339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20720d04-c6c2-48b1-908d-6db596e593cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:59.481612 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20720d04-c6c2-48b1-908d-6db596e593cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:59.482316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20720d04-c6c2-48b1-908d-6db596e593cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:56:59.483129 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20720d04-c6c2-48b1-908d-6db596e593cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:59.485082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20720d04-c6c2-48b1-908d-6db596e593cb admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:59.498933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1295/2560] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:56:59.507036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:59.507208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20720d04-c6c2-48b1-908d-6db596e593cb admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:59.507330 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1266/2561] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:56:58 2022] DELETE /identity/v3/users/7a3f8b78523e4c3790b049fc783c96fd => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:56:59.516059 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20720d04-c6c2-48b1-908d-6db596e593cb admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:59.592786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26045b63-0307-45ce-88b3-3930d69e38eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:59.592786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26045b63-0307-45ce-88b3-3930d69e38eb admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:59.592786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26045b63-0307-45ce-88b3-3930d69e38eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:59.593445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26045b63-0307-45ce-88b3-3930d69e38eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:59.594080 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26045b63-0307-45ce-88b3-3930d69e38eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:59.596549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26045b63-0307-45ce-88b3-3930d69e38eb admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:59.780846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1296/2562] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:56:59 2022] POST /identity/v3/projects => generated 385 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:56:59.785159 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66f474-e21e-49c8-a320-6819c508623d admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:59.801627 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66f474-e21e-49c8-a320-6819c508623d admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:59.830179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26045b63-0307-45ce-88b3-3930d69e38eb admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:56:59.833068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-26045b63-0307-45ce-88b3-3930d69e38eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:56:59.869095 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:56:59.888978 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce489b-e26a-4041-b65c-168ec6bb13fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:59.890369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce489b-e26a-4041-b65c-168ec6bb13fe admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:59.890945 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce489b-e26a-4041-b65c-168ec6bb13fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:59.891264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce489b-e26a-4041-b65c-168ec6bb13fe admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:59.894994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce489b-e26a-4041-b65c-168ec6bb13fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:59.894994 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce489b-e26a-4041-b65c-168ec6bb13fe admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:56:59.914829 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26045b63-0307-45ce-88b3-3930d69e38eb admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:56:59.920267 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ff4a8-7e0c-4e14-b74d-21b35d04ed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:56:59.921186 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ff4a8-7e0c-4e14-b74d-21b35d04ed9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:56:59.921493 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ff4a8-7e0c-4e14-b74d-21b35d04ed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:56:59.927898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ff4a8-7e0c-4e14-b74d-21b35d04ed9e admin admin] PATH_INFO: `/v3/projects/6270368ee4da4aa28e496afa3660f306` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:56:59.927898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ff4a8-7e0c-4e14-b74d-21b35d04ed9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6270368ee4da4aa28e496afa3660f306)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:56:59.927898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ff4a8-7e0c-4e14-b74d-21b35d04ed9e admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:00.021197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1267/2563] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:56:59 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:00.025415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce489b-e26a-4041-b65c-168ec6bb13fe admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:00.035742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce489b-e26a-4041-b65c-168ec6bb13fe admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:00.040804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c9187-3ef3-431a-922c-31721f861376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:00.042866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c9187-3ef3-431a-922c-31721f861376 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.042866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c9187-3ef3-431a-922c-31721f861376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.042866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c9187-3ef3-431a-922c-31721f861376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:00.042866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c9187-3ef3-431a-922c-31721f861376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:00.044403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c9187-3ef3-431a-922c-31721f861376 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:00.058455 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1268/2564] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:00.058708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d78ff4a8-7e0c-4e14-b74d-21b35d04ed9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6270368ee4da4aa28e496afa3660f306', 'request_id': 'req-d78ff4a8-7e0c-4e14-b74d-21b35d04ed9e'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:00.059983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c9187-3ef3-431a-922c-31721f861376 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:00.064078 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d78ff4a8-7e0c-4e14-b74d-21b35d04ed9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6270368ee4da4aa28e496afa3660f306', 'request_id': 'req-d78ff4a8-7e0c-4e14-b74d-21b35d04ed9e'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:00.071388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c9187-3ef3-431a-922c-31721f861376 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:00.140121 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be2d4c-895d-4e1c-a8b7-3adc4d71e7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:00.140785 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be2d4c-895d-4e1c-a8b7-3adc4d71e7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.141063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be2d4c-895d-4e1c-a8b7-3adc4d71e7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.141339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be2d4c-895d-4e1c-a8b7-3adc4d71e7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:00.141968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be2d4c-895d-4e1c-a8b7-3adc4d71e7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:00.143603 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be2d4c-895d-4e1c-a8b7-3adc4d71e7c1 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:00.154330 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1269/2565] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:00.160389 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d78ff4a8-7e0c-4e14-b74d-21b35d04ed9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6270368ee4da4aa28e496afa3660f306', 'request_id': 'req-d78ff4a8-7e0c-4e14-b74d-21b35d04ed9e'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:00.160928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be2d4c-895d-4e1c-a8b7-3adc4d71e7c1 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:00.173835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be2d4c-895d-4e1c-a8b7-3adc4d71e7c1 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:00.174665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d78ff4a8-7e0c-4e14-b74d-21b35d04ed9e admin admin] The token cache is being invalidate because project 6270368ee4da4aa28e496afa3660f306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:57:00.174958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d78ff4a8-7e0c-4e14-b74d-21b35d04ed9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:00.176074 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d78ff4a8-7e0c-4e14-b74d-21b35d04ed9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:00.188056 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1297/2566] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:56:59 2022] DELETE /identity/v3/projects/6270368ee4da4aa28e496afa3660f306 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:00.188212 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6405b7-b839-4787-8128-636e258c2c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:00.188212 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6405b7-b839-4787-8128-636e258c2c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.188212 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6405b7-b839-4787-8128-636e258c2c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.188212 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6405b7-b839-4787-8128-636e258c2c85 admin admin] PATH_INFO: `/v3/projects/e3542276eac24ef5a07bfd51075f9d35/users/1597c67d89c64fc880817ef7be3085ac/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:00.189440 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1550847-a67d-4653-b5d5-74bbe32ee3f0 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.189753 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1550847-a67d-4653-b5d5-74bbe32ee3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.190026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1550847-a67d-4653-b5d5-74bbe32ee3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:00.199804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6405b7-b839-4787-8128-636e258c2c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3542276eac24ef5a07bfd51075f9d35, user_id=1597c67d89c64fc880817ef7be3085ac, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:00.203869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6405b7-b839-4787-8128-636e258c2c85 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:00.212206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-d1550847-a67d-4653-b5d5-74bbe32ee3f0 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:00.213437 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-d1550847-a67d-4653-b5d5-74bbe32ee3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:00.222270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1298/2567] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:00.231380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308f77f-935e-4724-aeae-d6b80da7d2a5 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.231380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308f77f-935e-4724-aeae-d6b80da7d2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.231612 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308f77f-935e-4724-aeae-d6b80da7d2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:00.266551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-2308f77f-935e-4724-aeae-d6b80da7d2a5 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:00.267807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2308f77f-935e-4724-aeae-d6b80da7d2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:00.276338 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1299/2568] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:00.280908 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308f77f-935e-4724-aeae-d6b80da7d2a5 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:00.291589 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308f77f-935e-4724-aeae-d6b80da7d2a5 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:00.303213 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1270/2569] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:00 2022] PUT /identity/v3/projects/e3542276eac24ef5a07bfd51075f9d35/users/1597c67d89c64fc880817ef7be3085ac/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:00.315584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12012f3c-b0e1-40f8-9f4d-5371da21be43 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.315998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12012f3c-b0e1-40f8-9f4d-5371da21be43 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.316444 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12012f3c-b0e1-40f8-9f4d-5371da21be43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:00.350078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-12012f3c-b0e1-40f8-9f4d-5371da21be43 None None] MFA Rules not processed for user `1597c67d89c64fc880817ef7be3085ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:00.352046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-12012f3c-b0e1-40f8-9f4d-5371da21be43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:00.368776 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215e4ee-90c9-4444-a355-1cc6c51aa848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:00.369505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215e4ee-90c9-4444-a355-1cc6c51aa848 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.369785 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215e4ee-90c9-4444-a355-1cc6c51aa848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.370158 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215e4ee-90c9-4444-a355-1cc6c51aa848 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:00.370781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215e4ee-90c9-4444-a355-1cc6c51aa848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:57:00.371085 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215e4ee-90c9-4444-a355-1cc6c51aa848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:00.372764 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215e4ee-90c9-4444-a355-1cc6c51aa848 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:00.390322 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1300/2570] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:57:00.396880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215e4ee-90c9-4444-a355-1cc6c51aa848 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:00.409184 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215e4ee-90c9-4444-a355-1cc6c51aa848 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:00.414446 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695673b2-8689-413e-94fd-9a847fd9f71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:00.415384 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695673b2-8689-413e-94fd-9a847fd9f71a admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.415687 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695673b2-8689-413e-94fd-9a847fd9f71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.415965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695673b2-8689-413e-94fd-9a847fd9f71a admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:00.416625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695673b2-8689-413e-94fd-9a847fd9f71a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:00.418556 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695673b2-8689-413e-94fd-9a847fd9f71a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:00.418781 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:00.457643 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1271/2571] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:00.462447 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12012f3c-b0e1-40f8-9f4d-5371da21be43 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:00.463943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-12012f3c-b0e1-40f8-9f4d-5371da21be43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:00.478075 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12012f3c-b0e1-40f8-9f4d-5371da21be43 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:00.482869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6236b5a-4b2a-4f7f-a0af-0b6a92b1ba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:00.483514 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6236b5a-4b2a-4f7f-a0af-0b6a92b1ba8d admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.483785 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6236b5a-4b2a-4f7f-a0af-0b6a92b1ba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.484059 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6236b5a-4b2a-4f7f-a0af-0b6a92b1ba8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:00.484700 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6236b5a-4b2a-4f7f-a0af-0b6a92b1ba8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:00.486617 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6236b5a-4b2a-4f7f-a0af-0b6a92b1ba8d admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:00.516840 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1301/2572] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:00 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:00.521124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695673b2-8689-413e-94fd-9a847fd9f71a admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:00.584418 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695673b2-8689-413e-94fd-9a847fd9f71a admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:00.586784 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1272/2573] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:00 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:00.590725 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6236b5a-4b2a-4f7f-a0af-0b6a92b1ba8d admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:00.646164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0a313-b584-4706-a110-c857b49f8b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:00.646691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0a313-b584-4706-a110-c857b49f8b6d admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.646971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0a313-b584-4706-a110-c857b49f8b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.647244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0a313-b584-4706-a110-c857b49f8b6d admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:00.648106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0a313-b584-4706-a110-c857b49f8b6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:00.650057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0a313-b584-4706-a110-c857b49f8b6d admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:00.653085 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6236b5a-4b2a-4f7f-a0af-0b6a92b1ba8d admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:00.663300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df9859-e93c-4f86-b3fd-2c6635362339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:00.663961 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df9859-e93c-4f86-b3fd-2c6635362339 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.664353 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df9859-e93c-4f86-b3fd-2c6635362339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.664883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df9859-e93c-4f86-b3fd-2c6635362339 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:00.665525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df9859-e93c-4f86-b3fd-2c6635362339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:00.667526 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df9859-e93c-4f86-b3fd-2c6635362339 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:00.791985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1302/2574] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:00 2022] POST /identity/v3/users => generated 288 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:00.797058 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0a313-b584-4706-a110-c857b49f8b6d admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:00.807770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0a313-b584-4706-a110-c857b49f8b6d admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:00.813402 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509aef7-37ca-4c96-abeb-0cccf818a485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:00.814022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509aef7-37ca-4c96-abeb-0cccf818a485 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.814302 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509aef7-37ca-4c96-abeb-0cccf818a485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.814651 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509aef7-37ca-4c96-abeb-0cccf818a485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:00.815376 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509aef7-37ca-4c96-abeb-0cccf818a485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:00.817140 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509aef7-37ca-4c96-abeb-0cccf818a485 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:00.824187 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1273/2575] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:00 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:00.829985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1303/2576] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:00.831249 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df9859-e93c-4f86-b3fd-2c6635362339 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:00.833644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509aef7-37ca-4c96-abeb-0cccf818a485 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:00.842300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df9859-e93c-4f86-b3fd-2c6635362339 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:00.844949 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509aef7-37ca-4c96-abeb-0cccf818a485 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:00.847185 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5986a-6135-4f6c-824e-af9a4d489747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:00.847831 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5986a-6135-4f6c-824e-af9a4d489747 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.848129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5986a-6135-4f6c-824e-af9a4d489747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.848629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5986a-6135-4f6c-824e-af9a4d489747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:00.849038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5986a-6135-4f6c-824e-af9a4d489747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:00.849955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4eb49-138c-4af4-8c1a-0cb35c9f9b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:00.850628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4eb49-138c-4af4-8c1a-0cb35c9f9b78 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.850745 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5986a-6135-4f6c-824e-af9a4d489747 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:00.850931 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4eb49-138c-4af4-8c1a-0cb35c9f9b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.851212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4eb49-138c-4af4-8c1a-0cb35c9f9b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:00.851870 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4eb49-138c-4af4-8c1a-0cb35c9f9b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:00.857475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4eb49-138c-4af4-8c1a-0cb35c9f9b78 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:00.862353 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1274/2577] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:00.867042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1304/2578] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:00.867188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5986a-6135-4f6c-824e-af9a4d489747 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:00.869072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4eb49-138c-4af4-8c1a-0cb35c9f9b78 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:00.878203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5986a-6135-4f6c-824e-af9a4d489747 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:00.880122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4eb49-138c-4af4-8c1a-0cb35c9f9b78 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:00.882949 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27b799-f2ab-4930-b3a4-f032802e6e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:00.883592 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27b799-f2ab-4930-b3a4-f032802e6e36 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.883899 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27b799-f2ab-4930-b3a4-f032802e6e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.897536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27b799-f2ab-4930-b3a4-f032802e6e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:00.897536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27b799-f2ab-4930-b3a4-f032802e6e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:00.898297 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ebea4-ba74-4fa5-85e6-31f58635821e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:00.898297 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ebea4-ba74-4fa5-85e6-31f58635821e admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.898297 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ebea4-ba74-4fa5-85e6-31f58635821e admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.898297 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ebea4-ba74-4fa5-85e6-31f58635821e admin admin] PATH_INFO: `/v3/projects/4d0e6e93efc74e50a2b269459acf2841/users/a652c9f8f95f40208540441af74b8570/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:00.898708 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27b799-f2ab-4930-b3a4-f032802e6e36 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:00.898708 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1275/2579] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:00.901335 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27b799-f2ab-4930-b3a4-f032802e6e36 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:00.901771 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ebea4-ba74-4fa5-85e6-31f58635821e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0e6e93efc74e50a2b269459acf2841, user_id=a652c9f8f95f40208540441af74b8570, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:00.904739 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ebea4-ba74-4fa5-85e6-31f58635821e admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:00.911528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27b799-f2ab-4930-b3a4-f032802e6e36 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:00.917045 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8100a2d-ebea-4ae5-853a-f6c4a189b8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:00.917748 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8100a2d-ebea-4ae5-853a-f6c4a189b8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.918357 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8100a2d-ebea-4ae5-853a-f6c4a189b8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.920672 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8100a2d-ebea-4ae5-853a-f6c4a189b8ec admin admin] PATH_INFO: `/v3/projects/070411a8bc044d68a4c4903947543200/users/a94a63832b9e4993b68a6f3664bc5dcd/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:00.933762 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8100a2d-ebea-4ae5-853a-f6c4a189b8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=070411a8bc044d68a4c4903947543200, user_id=a94a63832b9e4993b68a6f3664bc5dcd, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:00.937007 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8100a2d-ebea-4ae5-853a-f6c4a189b8ec admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:00.978874 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1305/2580] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:00 2022] PUT /identity/v3/projects/4d0e6e93efc74e50a2b269459acf2841/users/a652c9f8f95f40208540441af74b8570/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:00.989619 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b214a7-4099-4099-bdd8-e430eaf21aa2 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:00.989901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b214a7-4099-4099-bdd8-e430eaf21aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:00.990205 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b214a7-4099-4099-bdd8-e430eaf21aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:01.002966 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1276/2581] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:00 2022] PUT /identity/v3/projects/070411a8bc044d68a4c4903947543200/users/a94a63832b9e4993b68a6f3664bc5dcd/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:01.014773 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205cc4a-298d-44d4-a27c-d5ac169c7dab None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:01.014986 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205cc4a-298d-44d4-a27c-d5ac169c7dab None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:01.015218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205cc4a-298d-44d4-a27c-d5ac169c7dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:01.021851 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-24b214a7-4099-4099-bdd8-e430eaf21aa2 None None] MFA Rules not processed for user `a652c9f8f95f40208540441af74b8570`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:01.023291 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-24b214a7-4099-4099-bdd8-e430eaf21aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:01.044096 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-3205cc4a-298d-44d4-a27c-d5ac169c7dab None None] MFA Rules not processed for user `a94a63832b9e4993b68a6f3664bc5dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:01.045896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3205cc4a-298d-44d4-a27c-d5ac169c7dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:01.066201 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:01.093671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1306/2582] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:01.105303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b214a7-4099-4099-bdd8-e430eaf21aa2 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:01.106728 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-24b214a7-4099-4099-bdd8-e430eaf21aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:01.119307 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1277/2583] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:01.124531 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205cc4a-298d-44d4-a27c-d5ac169c7dab None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:01.185233 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b214a7-4099-4099-bdd8-e430eaf21aa2 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:01.191263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:01.192627 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97085231-ba96-4edc-80ed-8dfe4972f363 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:01.193283 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97085231-ba96-4edc-80ed-8dfe4972f363 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:01.193576 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97085231-ba96-4edc-80ed-8dfe4972f363 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:01.193846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97085231-ba96-4edc-80ed-8dfe4972f363 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:01.194187 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205cc4a-298d-44d4-a27c-d5ac169c7dab None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:01.202071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd8599-9417-44fb-902a-b07247f2dd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:01.202958 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd8599-9417-44fb-902a-b07247f2dd1c admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:01.203338 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd8599-9417-44fb-902a-b07247f2dd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:01.203449 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97085231-ba96-4edc-80ed-8dfe4972f363 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:01.203583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd8599-9417-44fb-902a-b07247f2dd1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:01.204324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd8599-9417-44fb-902a-b07247f2dd1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:01.205025 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97085231-ba96-4edc-80ed-8dfe4972f363 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:01.206224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd8599-9417-44fb-902a-b07247f2dd1c admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:01.214442 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1307/2584] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:01.313621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1278/2585] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:01 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:01.314888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97085231-ba96-4edc-80ed-8dfe4972f363 service nova] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:01.326998 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97085231-ba96-4edc-80ed-8dfe4972f363 service nova] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:01.391810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73facbc-1d26-4c2e-89b7-cdcbd36f2f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:01.391810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73facbc-1d26-4c2e-89b7-cdcbd36f2f07 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:01.391810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73facbc-1d26-4c2e-89b7-cdcbd36f2f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:01.391810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73facbc-1d26-4c2e-89b7-cdcbd36f2f07 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:01.392174 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73facbc-1d26-4c2e-89b7-cdcbd36f2f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:01.394092 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73facbc-1d26-4c2e-89b7-cdcbd36f2f07 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:01.437811 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd8599-9417-44fb-902a-b07247f2dd1c admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:01.448162 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd8599-9417-44fb-902a-b07247f2dd1c admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:01.452843 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f017ea0-5dbd-4181-b106-bfe29efa2755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:01.453492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f017ea0-5dbd-4181-b106-bfe29efa2755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:01.453762 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f017ea0-5dbd-4181-b106-bfe29efa2755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:01.454030 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f017ea0-5dbd-4181-b106-bfe29efa2755 admin admin] PATH_INFO: `/v3/users/a652c9f8f95f40208540441af74b8570` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:01.455184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f017ea0-5dbd-4181-b106-bfe29efa2755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a652c9f8f95f40208540441af74b8570)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:01.457122 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f017ea0-5dbd-4181-b106-bfe29efa2755 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:01.497619 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1308/2586] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:01 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:01.502554 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73facbc-1d26-4c2e-89b7-cdcbd36f2f07 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:01.512924 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73facbc-1d26-4c2e-89b7-cdcbd36f2f07 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:01.518444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae2fcc-24a2-4e26-9be1-85c8a3019c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:01.519063 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae2fcc-24a2-4e26-9be1-85c8a3019c33 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:01.519343 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae2fcc-24a2-4e26-9be1-85c8a3019c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:01.519651 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae2fcc-24a2-4e26-9be1-85c8a3019c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:01.520301 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae2fcc-24a2-4e26-9be1-85c8a3019c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:01.521961 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae2fcc-24a2-4e26-9be1-85c8a3019c33 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:01.533662 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1309/2587] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:01.538260 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae2fcc-24a2-4e26-9be1-85c8a3019c33 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:01.550577 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae2fcc-24a2-4e26-9be1-85c8a3019c33 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:01.555337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d43208-d7bd-4a3c-9391-46862dbbd3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:01.556063 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d43208-d7bd-4a3c-9391-46862dbbd3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:01.556343 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d43208-d7bd-4a3c-9391-46862dbbd3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:01.556640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d43208-d7bd-4a3c-9391-46862dbbd3f2 admin admin] PATH_INFO: `/v3/projects/2c0de8e467d141af9f1b500cbdf867b6/users/cb7cf6e6c4e141a2bd49a348c0af4093/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:01.573790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d43208-d7bd-4a3c-9391-46862dbbd3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0de8e467d141af9f1b500cbdf867b6, user_id=cb7cf6e6c4e141a2bd49a348c0af4093, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:01.576570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d43208-d7bd-4a3c-9391-46862dbbd3f2 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:01.681989 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2f017ea0-5dbd-4181-b106-bfe29efa2755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a652c9f8f95f40208540441af74b8570'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:01.682631 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2f017ea0-5dbd-4181-b106-bfe29efa2755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a652c9f8f95f40208540441af74b8570'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:01.689932 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2f017ea0-5dbd-4181-b106-bfe29efa2755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a652c9f8f95f40208540441af74b8570'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:01.695133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:01.702349 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1310/2588] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:01 2022] PUT /identity/v3/projects/2c0de8e467d141af9f1b500cbdf867b6/users/cb7cf6e6c4e141a2bd49a348c0af4093/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:01.706444 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2f017ea0-5dbd-4181-b106-bfe29efa2755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a652c9f8f95f40208540441af74b8570'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:01.706444 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-2f017ea0-5dbd-4181-b106-bfe29efa2755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a652c9f8f95f40208540441af74b8570'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:01.709051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d43208-d7bd-4a3c-9391-46862dbbd3f2 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:01.710776 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-12d43208-d7bd-4a3c-9391-46862dbbd3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:01.795107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d43208-d7bd-4a3c-9391-46862dbbd3f2 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:01.801540 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbd24f-ce04-47a0-9207-9e24a7e9f86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:01.802171 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbd24f-ce04-47a0-9207-9e24a7e9f86c admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:01.802449 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbd24f-ce04-47a0-9207-9e24a7e9f86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:01.802722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbd24f-ce04-47a0-9207-9e24a7e9f86c admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:01.803375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbd24f-ce04-47a0-9207-9e24a7e9f86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:01.805295 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbd24f-ce04-47a0-9207-9e24a7e9f86c admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:01.822469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1311/2589] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:01.824273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbd24f-ce04-47a0-9207-9e24a7e9f86c admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:01.826969 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1279/2590] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:57:01 2022] DELETE /identity/v3/users/a652c9f8f95f40208540441af74b8570 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:01.830670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a9050-2a9a-4945-a314-d0f04cdce379 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:01.830995 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a9050-2a9a-4945-a314-d0f04cdce379 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:01.831267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a9050-2a9a-4945-a314-d0f04cdce379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:01.836715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbd24f-ce04-47a0-9207-9e24a7e9f86c admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:01.852924 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-be2a9050-2a9a-4945-a314-d0f04cdce379 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:01.854145 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-be2a9050-2a9a-4945-a314-d0f04cdce379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:01.910794 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11180e-37fc-4a09-8eb4-b61a57026426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:01.911502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11180e-37fc-4a09-8eb4-b61a57026426 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:01.911784 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11180e-37fc-4a09-8eb4-b61a57026426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:01.912065 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11180e-37fc-4a09-8eb4-b61a57026426 admin admin] PATH_INFO: `/v3/projects/2c0de8e467d141af9f1b500cbdf867b6/users/cb7cf6e6c4e141a2bd49a348c0af4093/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:01.914106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11180e-37fc-4a09-8eb4-b61a57026426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0de8e467d141af9f1b500cbdf867b6, user_id=cb7cf6e6c4e141a2bd49a348c0af4093, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:01.916259 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:01.917053 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11180e-37fc-4a09-8eb4-b61a57026426 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:01.928816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1312/2591] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:01 2022] PUT /identity/v3/projects/2c0de8e467d141af9f1b500cbdf867b6/users/cb7cf6e6c4e141a2bd49a348c0af4093/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:01.938615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1280/2592] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:01.939618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4ce11-2b72-4490-9dd1-1d1b81f6332d None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:01.939724 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4ce11-2b72-4490-9dd1-1d1b81f6332d None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:01.939915 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4ce11-2b72-4490-9dd1-1d1b81f6332d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:01.946170 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a9050-2a9a-4945-a314-d0f04cdce379 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:01.947808 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-be2a9050-2a9a-4945-a314-d0f04cdce379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:01.959987 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:01.984005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-6ef4ce11-2b72-4490-9dd1-1d1b81f6332d None None] MFA Rules not processed for user `cb7cf6e6c4e141a2bd49a348c0af4093`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:01.985896 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-6ef4ce11-2b72-4490-9dd1-1d1b81f6332d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:02.012769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a9050-2a9a-4945-a314-d0f04cdce379 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:02.068640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46666c1c-22f5-41a5-977e-21a7421c6fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:02.069256 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46666c1c-22f5-41a5-977e-21a7421c6fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:02.069534 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46666c1c-22f5-41a5-977e-21a7421c6fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:02.069817 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46666c1c-22f5-41a5-977e-21a7421c6fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:02.094877 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1313/2593] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:02.112615 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4ce11-2b72-4490-9dd1-1d1b81f6332d None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:02.123939 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-6ef4ce11-2b72-4490-9dd1-1d1b81f6332d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:02.142027 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46666c1c-22f5-41a5-977e-21a7421c6fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:02.143634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46666c1c-22f5-41a5-977e-21a7421c6fd0 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:02.154845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1281/2594] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:02.182699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4ce11-2b72-4490-9dd1-1d1b81f6332d None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:02.187806 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4276d7a-d734-43f9-86b9-2f807c430420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:02.189017 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276d7a-d734-43f9-86b9-2f807c430420 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:02.189017 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276d7a-d734-43f9-86b9-2f807c430420 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:02.189248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4276d7a-d734-43f9-86b9-2f807c430420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:02.199530 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4276d7a-d734-43f9-86b9-2f807c430420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:02.201052 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4276d7a-d734-43f9-86b9-2f807c430420 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:02.214894 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1314/2595] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:02.371915 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:02.710789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46666c1c-22f5-41a5-977e-21a7421c6fd0 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:02.714279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-46666c1c-22f5-41a5-977e-21a7421c6fd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:02.738282 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46666c1c-22f5-41a5-977e-21a7421c6fd0 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:02.747229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f089eb-3083-4778-ab39-5b86a82a2f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:02.748834 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f089eb-3083-4778-ab39-5b86a82a2f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:02.749319 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f089eb-3083-4778-ab39-5b86a82a2f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:02.750395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f089eb-3083-4778-ab39-5b86a82a2f54 admin admin] PATH_INFO: `/v3/projects/4d0e6e93efc74e50a2b269459acf2841` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:02.751390 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f089eb-3083-4778-ab39-5b86a82a2f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d0e6e93efc74e50a2b269459acf2841)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:02.754382 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f089eb-3083-4778-ab39-5b86a82a2f54 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:02.862727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:02.864415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-37f089eb-3083-4778-ab39-5b86a82a2f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d0e6e93efc74e50a2b269459acf2841', 'request_id': 'req-37f089eb-3083-4778-ab39-5b86a82a2f54'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:02.985267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-37f089eb-3083-4778-ab39-5b86a82a2f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d0e6e93efc74e50a2b269459acf2841', 'request_id': 'req-37f089eb-3083-4778-ab39-5b86a82a2f54'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:02.994273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-37f089eb-3083-4778-ab39-5b86a82a2f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d0e6e93efc74e50a2b269459acf2841', 'request_id': 'req-37f089eb-3083-4778-ab39-5b86a82a2f54'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:03.006537 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-37f089eb-3083-4778-ab39-5b86a82a2f54 admin admin] The token cache is being invalidate because project 4d0e6e93efc74e50a2b269459acf2841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:57:03.006830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-37f089eb-3083-4778-ab39-5b86a82a2f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:03.007570 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-37f089eb-3083-4778-ab39-5b86a82a2f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:03.009064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1282/2596] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:57:02 2022] DELETE /identity/v3/projects/4d0e6e93efc74e50a2b269459acf2841 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:03.014986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32c93d-eff2-4063-8d7c-44fda1e063df None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:03.015557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32c93d-eff2-4063-8d7c-44fda1e063df None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:03.015557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32c93d-eff2-4063-8d7c-44fda1e063df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:03.046695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-be32c93d-eff2-4063-8d7c-44fda1e063df None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:03.047984 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-be32c93d-eff2-4063-8d7c-44fda1e063df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:03.118609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1315/2597] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:03.128338 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f875d1-f1e9-4940-8208-dc3a5f7f8ea3 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:03.128713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f875d1-f1e9-4940-8208-dc3a5f7f8ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:03.128992 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f875d1-f1e9-4940-8208-dc3a5f7f8ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:03.150563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-26f875d1-f1e9-4940-8208-dc3a5f7f8ea3 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:03.151822 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-26f875d1-f1e9-4940-8208-dc3a5f7f8ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:03.161477 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1283/2598] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:03.166523 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32c93d-eff2-4063-8d7c-44fda1e063df None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:03.179463 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32c93d-eff2-4063-8d7c-44fda1e063df None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:03.184937 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc6f04-7fb9-4709-9fd6-d9e901b4a7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:03.185591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc6f04-7fb9-4709-9fd6-d9e901b4a7bf admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:03.185922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc6f04-7fb9-4709-9fd6-d9e901b4a7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:03.186810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc6f04-7fb9-4709-9fd6-d9e901b4a7bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:03.186810 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc6f04-7fb9-4709-9fd6-d9e901b4a7bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:57:03.187065 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc6f04-7fb9-4709-9fd6-d9e901b4a7bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:03.188773 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc6f04-7fb9-4709-9fd6-d9e901b4a7bf admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:03.202228 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1316/2599] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:57:03.207608 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f875d1-f1e9-4940-8208-dc3a5f7f8ea3 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:03.221879 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f875d1-f1e9-4940-8208-dc3a5f7f8ea3 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:03.227183 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e079ce-529a-49c9-b004-14e6ba8d80d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:03.227845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e079ce-529a-49c9-b004-14e6ba8d80d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:03.228126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e079ce-529a-49c9-b004-14e6ba8d80d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:03.228860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e079ce-529a-49c9-b004-14e6ba8d80d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:03.229030 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e079ce-529a-49c9-b004-14e6ba8d80d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:03.230948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e079ce-529a-49c9-b004-14e6ba8d80d7 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:03.364141 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1284/2600] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:03 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:03.367790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc6f04-7fb9-4709-9fd6-d9e901b4a7bf admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:03.385588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc6f04-7fb9-4709-9fd6-d9e901b4a7bf admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:03.461328 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dfa2e-4db2-4bee-b4cf-3a398c529ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:03.461991 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dfa2e-4db2-4bee-b4cf-3a398c529ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:03.462278 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dfa2e-4db2-4bee-b4cf-3a398c529ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:03.462553 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dfa2e-4db2-4bee-b4cf-3a398c529ef4 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:03.463203 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dfa2e-4db2-4bee-b4cf-3a398c529ef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:03.465188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dfa2e-4db2-4bee-b4cf-3a398c529ef4 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:03.537297 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e079ce-529a-49c9-b004-14e6ba8d80d7 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:03.539791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-31e079ce-529a-49c9-b004-14e6ba8d80d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:03.612653 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e079ce-529a-49c9-b004-14e6ba8d80d7 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:03.614935 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1317/2601] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:03 2022] POST /identity/v3/users => generated 291 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:03.619389 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dfa2e-4db2-4bee-b4cf-3a398c529ef4 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:03.620183 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50204f-17ac-431f-a365-89e9f99da5e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:03.622617 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50204f-17ac-431f-a365-89e9f99da5e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:03.622617 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50204f-17ac-431f-a365-89e9f99da5e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:03.622617 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50204f-17ac-431f-a365-89e9f99da5e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:03.628614 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-9e50204f-17ac-431f-a365-89e9f99da5e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:03.634498 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dfa2e-4db2-4bee-b4cf-3a398c529ef4 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:03.641116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2eb2f-6ef1-4c5c-9744-e25fd53bab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:03.641873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2eb2f-6ef1-4c5c-9744-e25fd53bab13 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:03.642245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2eb2f-6ef1-4c5c-9744-e25fd53bab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:03.642618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2eb2f-6ef1-4c5c-9744-e25fd53bab13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:03.643563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2eb2f-6ef1-4c5c-9744-e25fd53bab13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:03.645987 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2eb2f-6ef1-4c5c-9744-e25fd53bab13 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:03.667658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1318/2602] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:03.672506 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2eb2f-6ef1-4c5c-9744-e25fd53bab13 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:03.686415 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2eb2f-6ef1-4c5c-9744-e25fd53bab13 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:03.691853 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac89846-d591-4feb-92c4-c1b3f6711c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:03.692574 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac89846-d591-4feb-92c4-c1b3f6711c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:03.692920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac89846-d591-4feb-92c4-c1b3f6711c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:03.693236 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac89846-d591-4feb-92c4-c1b3f6711c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:03.694416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac89846-d591-4feb-92c4-c1b3f6711c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:03.695704 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac89846-d591-4feb-92c4-c1b3f6711c04 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:03.710261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1319/2603] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:03.716279 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac89846-d591-4feb-92c4-c1b3f6711c04 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:03.729609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac89846-d591-4feb-92c4-c1b3f6711c04 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:03.735997 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326b4f7-d4ea-4361-b25f-3c587d4308a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:03.736684 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326b4f7-d4ea-4361-b25f-3c587d4308a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:03.736955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50204f-17ac-431f-a365-89e9f99da5e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:03.737089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326b4f7-d4ea-4361-b25f-3c587d4308a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:03.737273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326b4f7-d4ea-4361-b25f-3c587d4308a8 admin admin] PATH_INFO: `/v3/projects/cb02c70ad16b4b6ab50e56564bbed778/users/cd188fa48dbb4d0296a894143bf834c8/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:03.739772 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50204f-17ac-431f-a365-89e9f99da5e2 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:03.755930 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1285/2604] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:57:03.760189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326b4f7-d4ea-4361-b25f-3c587d4308a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb02c70ad16b4b6ab50e56564bbed778, user_id=cd188fa48dbb4d0296a894143bf834c8, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:03.768252 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326b4f7-d4ea-4361-b25f-3c587d4308a8 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:03.873302 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1320/2605] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:03 2022] PUT /identity/v3/projects/cb02c70ad16b4b6ab50e56564bbed778/users/cd188fa48dbb4d0296a894143bf834c8/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:03.892741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59795aca-1c0b-40ac-89a6-2adeb76c8b37 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:03.893116 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59795aca-1c0b-40ac-89a6-2adeb76c8b37 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:03.893540 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59795aca-1c0b-40ac-89a6-2adeb76c8b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:03.931529 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-59795aca-1c0b-40ac-89a6-2adeb76c8b37 None None] MFA Rules not processed for user `cd188fa48dbb4d0296a894143bf834c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:03.932909 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-59795aca-1c0b-40ac-89a6-2adeb76c8b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:04.005871 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:04.025132 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1286/2606] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:04.031701 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326b4f7-d4ea-4361-b25f-3c587d4308a8 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:04.069534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:04.112206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326b4f7-d4ea-4361-b25f-3c587d4308a8 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:04.117491 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb5397-dce6-4279-9b04-59646f02010f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:04.118167 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb5397-dce6-4279-9b04-59646f02010f admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:04.118443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb5397-dce6-4279-9b04-59646f02010f admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:04.118717 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb5397-dce6-4279-9b04-59646f02010f admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:04.119356 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb5397-dce6-4279-9b04-59646f02010f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:04.121471 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb5397-dce6-4279-9b04-59646f02010f admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:04.254235 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1321/2607] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:04 2022] POST /identity/v3/projects => generated 381 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:04.259549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59795aca-1c0b-40ac-89a6-2adeb76c8b37 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:04.272904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59795aca-1c0b-40ac-89a6-2adeb76c8b37 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:04.332759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1546d-31e4-48b8-9c21-082daff0079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:04.333367 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1546d-31e4-48b8-9c21-082daff0079b admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:04.333649 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1546d-31e4-48b8-9c21-082daff0079b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:04.333923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1546d-31e4-48b8-9c21-082daff0079b admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:04.334568 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1546d-31e4-48b8-9c21-082daff0079b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:04.336517 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1546d-31e4-48b8-9c21-082daff0079b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:04.454179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1287/2608] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:04 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:04.458339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb5397-dce6-4279-9b04-59646f02010f admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:04.469573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb5397-dce6-4279-9b04-59646f02010f admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:04.474326 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6cba2-c541-406f-aa92-a264f3d6ebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:04.474934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6cba2-c541-406f-aa92-a264f3d6ebab admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:04.475211 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6cba2-c541-406f-aa92-a264f3d6ebab admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:04.475514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6cba2-c541-406f-aa92-a264f3d6ebab admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:04.476161 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6cba2-c541-406f-aa92-a264f3d6ebab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:04.477763 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6cba2-c541-406f-aa92-a264f3d6ebab admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:04.489904 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1322/2609] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:04.499659 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1546d-31e4-48b8-9c21-082daff0079b admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:04.511096 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1546d-31e4-48b8-9c21-082daff0079b admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:04.517341 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413432c3-0515-4a0d-baab-1efc07053d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:04.518015 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413432c3-0515-4a0d-baab-1efc07053d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:04.518294 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413432c3-0515-4a0d-baab-1efc07053d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:04.518568 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413432c3-0515-4a0d-baab-1efc07053d5e admin admin] PATH_INFO: `/v3/projects/4f4170d4e02b421bbda658a192133477/users/6b01f850dd404f5ca37feb6be69e9cc0/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:04.536201 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413432c3-0515-4a0d-baab-1efc07053d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4170d4e02b421bbda658a192133477, user_id=6b01f850dd404f5ca37feb6be69e9cc0, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:04.541442 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413432c3-0515-4a0d-baab-1efc07053d5e admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:04.632188 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1288/2610] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:04 2022] PUT /identity/v3/projects/4f4170d4e02b421bbda658a192133477/users/6b01f850dd404f5ca37feb6be69e9cc0/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:04.636185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6cba2-c541-406f-aa92-a264f3d6ebab admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:04.646373 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6cba2-c541-406f-aa92-a264f3d6ebab admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:04.713404 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401290df-d6b9-49da-8671-1ce532dc75e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:04.714010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401290df-d6b9-49da-8671-1ce532dc75e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:04.714286 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401290df-d6b9-49da-8671-1ce532dc75e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:04.714587 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401290df-d6b9-49da-8671-1ce532dc75e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:04.715221 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401290df-d6b9-49da-8671-1ce532dc75e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:04.716886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401290df-d6b9-49da-8671-1ce532dc75e3 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:04.727220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1323/2611] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:04.731533 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413432c3-0515-4a0d-baab-1efc07053d5e admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:04.743397 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413432c3-0515-4a0d-baab-1efc07053d5e admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:04.747714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2dd0b-6ced-4a2a-8a33-5d4b966a7eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:04.749058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2dd0b-6ced-4a2a-8a33-5d4b966a7eef admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:04.749771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2dd0b-6ced-4a2a-8a33-5d4b966a7eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:04.750049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2dd0b-6ced-4a2a-8a33-5d4b966a7eef admin admin] PATH_INFO: `/v3/projects/4f4170d4e02b421bbda658a192133477/users/6b01f850dd404f5ca37feb6be69e9cc0/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:04.752270 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2dd0b-6ced-4a2a-8a33-5d4b966a7eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4170d4e02b421bbda658a192133477, user_id=6b01f850dd404f5ca37feb6be69e9cc0, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:04.755028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2dd0b-6ced-4a2a-8a33-5d4b966a7eef admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:04.766961 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1289/2612] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:04 2022] PUT /identity/v3/projects/4f4170d4e02b421bbda658a192133477/users/6b01f850dd404f5ca37feb6be69e9cc0/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:04.776863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5310dec-88a9-46b4-b533-2813db766b81 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:04.777151 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5310dec-88a9-46b4-b533-2813db766b81 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:04.777444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5310dec-88a9-46b4-b533-2813db766b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:04.808552 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-a5310dec-88a9-46b4-b533-2813db766b81 None None] MFA Rules not processed for user `6b01f850dd404f5ca37feb6be69e9cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:04.809864 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a5310dec-88a9-46b4-b533-2813db766b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:04.885480 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1324/2613] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:04.898876 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2dd0b-6ced-4a2a-8a33-5d4b966a7eef admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:04.968471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2dd0b-6ced-4a2a-8a33-5d4b966a7eef admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:04.972276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2129c-190d-4d8c-84db-dfe6a626dda6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:04.975031 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2129c-190d-4d8c-84db-dfe6a626dda6 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:04.975031 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2129c-190d-4d8c-84db-dfe6a626dda6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:04.975031 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2129c-190d-4d8c-84db-dfe6a626dda6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:04.983776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2129c-190d-4d8c-84db-dfe6a626dda6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:04.985212 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2129c-190d-4d8c-84db-dfe6a626dda6 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:04.995846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1290/2614] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:57:05.224282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5310dec-88a9-46b4-b533-2813db766b81 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:05.236286 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5310dec-88a9-46b4-b533-2813db766b81 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:05.239852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b40eaf-2d99-4ff3-b1e8-7052ae0a2602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:05.240503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b40eaf-2d99-4ff3-b1e8-7052ae0a2602 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:05.240826 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b40eaf-2d99-4ff3-b1e8-7052ae0a2602 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:05.241103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b40eaf-2d99-4ff3-b1e8-7052ae0a2602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:05.261843 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:05.303678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b40eaf-2d99-4ff3-b1e8-7052ae0a2602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:05.305110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b40eaf-2d99-4ff3-b1e8-7052ae0a2602 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:05.314581 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1325/2615] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:09.298807 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2129c-190d-4d8c-84db-dfe6a626dda6 service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:09.309548 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2129c-190d-4d8c-84db-dfe6a626dda6 service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:09.314971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53228ca4-43aa-4cf1-a742-04fd3ccdf95f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:09.315869 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53228ca4-43aa-4cf1-a742-04fd3ccdf95f service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:09.316197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53228ca4-43aa-4cf1-a742-04fd3ccdf95f service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:09.316625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53228ca4-43aa-4cf1-a742-04fd3ccdf95f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:09.318628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-53228ca4-43aa-4cf1-a742-04fd3ccdf95f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:09.379096 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:09.409024 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53228ca4-43aa-4cf1-a742-04fd3ccdf95f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:09.410489 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53228ca4-43aa-4cf1-a742-04fd3ccdf95f service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:09.421176 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1291/2616] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:14.245228 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b40eaf-2d99-4ff3-b1e8-7052ae0a2602 service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:14.246798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-88b40eaf-2d99-4ff3-b1e8-7052ae0a2602 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:14.325559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b40eaf-2d99-4ff3-b1e8-7052ae0a2602 service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:14.333360 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b70f3-12d5-4fe3-b382-1adabbd599f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:14.334443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b70f3-12d5-4fe3-b382-1adabbd599f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:14.335019 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b70f3-12d5-4fe3-b382-1adabbd599f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:14.335541 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b70f3-12d5-4fe3-b382-1adabbd599f7 admin admin] PATH_INFO: `/v3/users/1597c67d89c64fc880817ef7be3085ac` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:14.337719 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b70f3-12d5-4fe3-b382-1adabbd599f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1597c67d89c64fc880817ef7be3085ac)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:14.341717 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b70f3-12d5-4fe3-b382-1adabbd599f7 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:14.578776 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-036b70f3-12d5-4fe3-b382-1adabbd599f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1597c67d89c64fc880817ef7be3085ac'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:14.674043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-036b70f3-12d5-4fe3-b382-1adabbd599f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1597c67d89c64fc880817ef7be3085ac'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:14.674799 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-036b70f3-12d5-4fe3-b382-1adabbd599f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1597c67d89c64fc880817ef7be3085ac'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:14.675493 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-036b70f3-12d5-4fe3-b382-1adabbd599f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1597c67d89c64fc880817ef7be3085ac'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:14.683250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-036b70f3-12d5-4fe3-b382-1adabbd599f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1597c67d89c64fc880817ef7be3085ac'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:14.705949 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1326/2617] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:57:14 2022] DELETE /identity/v3/users/1597c67d89c64fc880817ef7be3085ac => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:14.710793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0ed65-63de-4a51-891a-7c083585cd30 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:14.711291 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0ed65-63de-4a51-891a-7c083585cd30 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:14.711391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0ed65-63de-4a51-891a-7c083585cd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:14.731731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-3fe0ed65-63de-4a51-891a-7c083585cd30 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:14.739071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3fe0ed65-63de-4a51-891a-7c083585cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:14.799230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1292/2618] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:14.809588 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b70f3-12d5-4fe3-b382-1adabbd599f7 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:14.811007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-036b70f3-12d5-4fe3-b382-1adabbd599f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:14.860825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:14.875915 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b70f3-12d5-4fe3-b382-1adabbd599f7 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:14.883101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1bfd4-7188-4e50-ae56-035546366143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:14.883766 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1bfd4-7188-4e50-ae56-035546366143 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:14.884047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1bfd4-7188-4e50-ae56-035546366143 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:14.884321 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1bfd4-7188-4e50-ae56-035546366143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:14.896146 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1bfd4-7188-4e50-ae56-035546366143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:14.897656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1bfd4-7188-4e50-ae56-035546366143 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:14.908722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1327/2619] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:15.399767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0ed65-63de-4a51-891a-7c083585cd30 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:15.401812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3fe0ed65-63de-4a51-891a-7c083585cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:15.415226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0ed65-63de-4a51-891a-7c083585cd30 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:15.423175 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:15.423948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:15.424245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:15.424540 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee admin admin] PATH_INFO: `/v3/projects/e3542276eac24ef5a07bfd51075f9d35` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:15.427157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3542276eac24ef5a07bfd51075f9d35)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:15.432481 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:15.592770 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3542276eac24ef5a07bfd51075f9d35', 'request_id': 'req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:15.629817 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1bfd4-7188-4e50-ae56-035546366143 service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:15.631376 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-91b1bfd4-7188-4e50-ae56-035546366143 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:15.650935 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1bfd4-7188-4e50-ae56-035546366143 service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:15.699817 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3542276eac24ef5a07bfd51075f9d35', 'request_id': 'req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:15.709396 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3542276eac24ef5a07bfd51075f9d35', 'request_id': 'req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:15.713842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644aa077-b367-41e0-afd2-d1e94e83db25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:15.715127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644aa077-b367-41e0-afd2-d1e94e83db25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:15.715822 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644aa077-b367-41e0-afd2-d1e94e83db25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:15.716496 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644aa077-b367-41e0-afd2-d1e94e83db25 admin admin] PATH_INFO: `/v3/users/cd188fa48dbb4d0296a894143bf834c8` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:15.718569 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644aa077-b367-41e0-afd2-d1e94e83db25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd188fa48dbb4d0296a894143bf834c8)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:15.722271 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644aa077-b367-41e0-afd2-d1e94e83db25 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:15.728198 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee admin admin] The token cache is being invalidate because project e3542276eac24ef5a07bfd51075f9d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:57:15.728722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:15.729833 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:15.732335 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1293/2620] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:57:15 2022] DELETE /identity/v3/projects/e3542276eac24ef5a07bfd51075f9d35 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:15.737495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:15.740267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:15.761430 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e7361-ef75-41bd-83ac-265d36c2a7ee admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:15.769038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d608d-8dd0-4290-9623-f095a7ebc05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:15.769703 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d608d-8dd0-4290-9623-f095a7ebc05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:15.769976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d608d-8dd0-4290-9623-f095a7ebc05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:15.770256 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d608d-8dd0-4290-9623-f095a7ebc05c admin admin] PATH_INFO: `/v3/users/a94a63832b9e4993b68a6f3664bc5dcd` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:15.771523 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d608d-8dd0-4290-9623-f095a7ebc05c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a94a63832b9e4993b68a6f3664bc5dcd)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:15.773478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d608d-8dd0-4290-9623-f095a7ebc05c admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:16.012652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-644aa077-b367-41e0-afd2-d1e94e83db25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd188fa48dbb4d0296a894143bf834c8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:16.022710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-306d608d-8dd0-4290-9623-f095a7ebc05c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a94a63832b9e4993b68a6f3664bc5dcd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:16.023390 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-306d608d-8dd0-4290-9623-f095a7ebc05c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a94a63832b9e4993b68a6f3664bc5dcd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:16.030909 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-306d608d-8dd0-4290-9623-f095a7ebc05c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a94a63832b9e4993b68a6f3664bc5dcd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:16.037432 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:16.045070 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-306d608d-8dd0-4290-9623-f095a7ebc05c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a94a63832b9e4993b68a6f3664bc5dcd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:16.046081 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-306d608d-8dd0-4290-9623-f095a7ebc05c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a94a63832b9e4993b68a6f3664bc5dcd'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:16.206242 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-644aa077-b367-41e0-afd2-d1e94e83db25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd188fa48dbb4d0296a894143bf834c8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:16.206966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-644aa077-b367-41e0-afd2-d1e94e83db25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd188fa48dbb4d0296a894143bf834c8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:16.207728 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-644aa077-b367-41e0-afd2-d1e94e83db25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd188fa48dbb4d0296a894143bf834c8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:16.215681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-644aa077-b367-41e0-afd2-d1e94e83db25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd188fa48dbb4d0296a894143bf834c8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:16.233672 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1328/2621] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:57:15 2022] DELETE /identity/v3/users/cd188fa48dbb4d0296a894143bf834c8 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:16.238683 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87014418-646b-410f-9c16-57afb65587eb None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:16.238967 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87014418-646b-410f-9c16-57afb65587eb None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:16.243542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87014418-646b-410f-9c16-57afb65587eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:16.259107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-87014418-646b-410f-9c16-57afb65587eb None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:16.260365 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-87014418-646b-410f-9c16-57afb65587eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:16.296701 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1294/2622] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:57:15 2022] DELETE /identity/v3/users/a94a63832b9e4993b68a6f3664bc5dcd => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:16.335565 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1329/2623] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:16.346257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d608d-8dd0-4290-9623-f095a7ebc05c admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:16.347753 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-306d608d-8dd0-4290-9623-f095a7ebc05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:16.405933 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d608d-8dd0-4290-9623-f095a7ebc05c admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:16.410702 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117261f-c207-4fb7-8a5d-6d39c22e1d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:16.411368 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117261f-c207-4fb7-8a5d-6d39c22e1d06 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:16.411680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117261f-c207-4fb7-8a5d-6d39c22e1d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:16.411953 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117261f-c207-4fb7-8a5d-6d39c22e1d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:16.476567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117261f-c207-4fb7-8a5d-6d39c22e1d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:16.478013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117261f-c207-4fb7-8a5d-6d39c22e1d06 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:16.488524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1295/2624] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:17.010130 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87014418-646b-410f-9c16-57afb65587eb None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:17.011582 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-87014418-646b-410f-9c16-57afb65587eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:17.019597 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:17.024696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87014418-646b-410f-9c16-57afb65587eb None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:17.029901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae32f6-96e8-4823-af7c-b1d8997c6c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:17.030557 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae32f6-96e8-4823-af7c-b1d8997c6c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:17.030835 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae32f6-96e8-4823-af7c-b1d8997c6c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:17.031103 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae32f6-96e8-4823-af7c-b1d8997c6c38 admin admin] PATH_INFO: `/v3/projects/070411a8bc044d68a4c4903947543200` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:17.034025 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae32f6-96e8-4823-af7c-b1d8997c6c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=070411a8bc044d68a4c4903947543200)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:17.036187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae32f6-96e8-4823-af7c-b1d8997c6c38 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:17.046308 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117261f-c207-4fb7-8a5d-6d39c22e1d06 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:17.050801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-e117261f-c207-4fb7-8a5d-6d39c22e1d06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:17.071622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117261f-c207-4fb7-8a5d-6d39c22e1d06 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:17.078812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be859f-3a33-482b-acc4-5349a01fb55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:17.079903 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be859f-3a33-482b-acc4-5349a01fb55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:17.080940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be859f-3a33-482b-acc4-5349a01fb55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:17.081425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be859f-3a33-482b-acc4-5349a01fb55b admin admin] PATH_INFO: `/v3/projects/cb02c70ad16b4b6ab50e56564bbed778` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:17.083359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be859f-3a33-482b-acc4-5349a01fb55b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb02c70ad16b4b6ab50e56564bbed778)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:17.085775 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be859f-3a33-482b-acc4-5349a01fb55b admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:17.214966 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-23ae32f6-96e8-4823-af7c-b1d8997c6c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070411a8bc044d68a4c4903947543200', 'request_id': 'req-23ae32f6-96e8-4823-af7c-b1d8997c6c38'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.222512 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-23ae32f6-96e8-4823-af7c-b1d8997c6c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070411a8bc044d68a4c4903947543200', 'request_id': 'req-23ae32f6-96e8-4823-af7c-b1d8997c6c38'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.223911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-70be859f-3a33-482b-acc4-5349a01fb55b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb02c70ad16b4b6ab50e56564bbed778', 'request_id': 'req-70be859f-3a33-482b-acc4-5349a01fb55b'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.332790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-23ae32f6-96e8-4823-af7c-b1d8997c6c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070411a8bc044d68a4c4903947543200', 'request_id': 'req-23ae32f6-96e8-4823-af7c-b1d8997c6c38'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.344570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-23ae32f6-96e8-4823-af7c-b1d8997c6c38 admin admin] The token cache is being invalidate because project 070411a8bc044d68a4c4903947543200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:57:17.345464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-23ae32f6-96e8-4823-af7c-b1d8997c6c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.346802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-23ae32f6-96e8-4823-af7c-b1d8997c6c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.348640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1330/2625] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:57:17 2022] DELETE /identity/v3/projects/070411a8bc044d68a4c4903947543200 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:17.352609 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae32f6-96e8-4823-af7c-b1d8997c6c38 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:17.354053 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-23ae32f6-96e8-4823-af7c-b1d8997c6c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:17.399143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-70be859f-3a33-482b-acc4-5349a01fb55b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb02c70ad16b4b6ab50e56564bbed778', 'request_id': 'req-70be859f-3a33-482b-acc4-5349a01fb55b'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.406074 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-70be859f-3a33-482b-acc4-5349a01fb55b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb02c70ad16b4b6ab50e56564bbed778', 'request_id': 'req-70be859f-3a33-482b-acc4-5349a01fb55b'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.418403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-70be859f-3a33-482b-acc4-5349a01fb55b admin admin] The token cache is being invalidate because project cb02c70ad16b4b6ab50e56564bbed778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:57:17.421010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-70be859f-3a33-482b-acc4-5349a01fb55b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.421010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-70be859f-3a33-482b-acc4-5349a01fb55b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.421010 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1296/2626] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:57:17 2022] DELETE /identity/v3/projects/cb02c70ad16b4b6ab50e56564bbed778 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:17.425105 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be859f-3a33-482b-acc4-5349a01fb55b admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:17.425524 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae32f6-96e8-4823-af7c-b1d8997c6c38 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:17.426729 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-70be859f-3a33-482b-acc4-5349a01fb55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:17.441799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:17.484873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bfe24-bbdd-44e5-a89d-aac6dd754b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:17.485700 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bfe24-bbdd-44e5-a89d-aac6dd754b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:17.485988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bfe24-bbdd-44e5-a89d-aac6dd754b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:17.486483 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bfe24-bbdd-44e5-a89d-aac6dd754b34 admin admin] PATH_INFO: `/v3/users/cb7cf6e6c4e141a2bd49a348c0af4093` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:17.487663 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bfe24-bbdd-44e5-a89d-aac6dd754b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb7cf6e6c4e141a2bd49a348c0af4093)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:17.489571 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bfe24-bbdd-44e5-a89d-aac6dd754b34 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:17.496722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be859f-3a33-482b-acc4-5349a01fb55b admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:17.501586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718334b5-d044-44ff-82e9-4b7ad2ec73d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:17.502233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718334b5-d044-44ff-82e9-4b7ad2ec73d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:17.502502 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718334b5-d044-44ff-82e9-4b7ad2ec73d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:17.502772 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718334b5-d044-44ff-82e9-4b7ad2ec73d8 admin admin] PATH_INFO: `/v3/users/6b01f850dd404f5ca37feb6be69e9cc0` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:17.503951 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718334b5-d044-44ff-82e9-4b7ad2ec73d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b01f850dd404f5ca37feb6be69e9cc0)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:17.505901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718334b5-d044-44ff-82e9-4b7ad2ec73d8 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:17.737750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:17.749018 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-816bfe24-bbdd-44e5-a89d-aac6dd754b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb7cf6e6c4e141a2bd49a348c0af4093'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.768269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-718334b5-d044-44ff-82e9-4b7ad2ec73d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b01f850dd404f5ca37feb6be69e9cc0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.769035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-718334b5-d044-44ff-82e9-4b7ad2ec73d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b01f850dd404f5ca37feb6be69e9cc0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.776689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-718334b5-d044-44ff-82e9-4b7ad2ec73d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b01f850dd404f5ca37feb6be69e9cc0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.789881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-718334b5-d044-44ff-82e9-4b7ad2ec73d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b01f850dd404f5ca37feb6be69e9cc0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.790617 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-718334b5-d044-44ff-82e9-4b7ad2ec73d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b01f850dd404f5ca37feb6be69e9cc0'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.875438 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-816bfe24-bbdd-44e5-a89d-aac6dd754b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb7cf6e6c4e141a2bd49a348c0af4093'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.876700 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-816bfe24-bbdd-44e5-a89d-aac6dd754b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb7cf6e6c4e141a2bd49a348c0af4093'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.877526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-816bfe24-bbdd-44e5-a89d-aac6dd754b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb7cf6e6c4e141a2bd49a348c0af4093'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.885804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-816bfe24-bbdd-44e5-a89d-aac6dd754b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb7cf6e6c4e141a2bd49a348c0af4093'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:17.911136 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1331/2627] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:57:17 2022] DELETE /identity/v3/users/cb7cf6e6c4e141a2bd49a348c0af4093 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:17.975320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1297/2628] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:57:17 2022] DELETE /identity/v3/users/6b01f850dd404f5ca37feb6be69e9cc0 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:18.442968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bfe24-bbdd-44e5-a89d-aac6dd754b34 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:18.444523 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-816bfe24-bbdd-44e5-a89d-aac6dd754b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:18.506408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718334b5-d044-44ff-82e9-4b7ad2ec73d8 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:18.507952 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-718334b5-d044-44ff-82e9-4b7ad2ec73d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:18.527412 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bfe24-bbdd-44e5-a89d-aac6dd754b34 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:18.589443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718334b5-d044-44ff-82e9-4b7ad2ec73d8 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:18.594419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69353e7-469a-40f6-aa23-48f84621b43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:18.595646 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69353e7-469a-40f6-aa23-48f84621b43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:18.595889 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69353e7-469a-40f6-aa23-48f84621b43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:18.596287 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69353e7-469a-40f6-aa23-48f84621b43e admin admin] PATH_INFO: `/v3/projects/4f4170d4e02b421bbda658a192133477` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:18.597438 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69353e7-469a-40f6-aa23-48f84621b43e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f4170d4e02b421bbda658a192133477)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:18.599359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69353e7-469a-40f6-aa23-48f84621b43e admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:18.601065 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5464d10-06b6-4db9-ae17-8ebdd30bafc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:18.601784 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5464d10-06b6-4db9-ae17-8ebdd30bafc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:18.602135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5464d10-06b6-4db9-ae17-8ebdd30bafc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:18.602451 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5464d10-06b6-4db9-ae17-8ebdd30bafc6 admin admin] PATH_INFO: `/v3/projects/2c0de8e467d141af9f1b500cbdf867b6` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:18.603803 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5464d10-06b6-4db9-ae17-8ebdd30bafc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0de8e467d141af9f1b500cbdf867b6)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:18.605696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5464d10-06b6-4db9-ae17-8ebdd30bafc6 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:18.783002 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:18.793282 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c69353e7-469a-40f6-aa23-48f84621b43e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f4170d4e02b421bbda658a192133477', 'request_id': 'req-c69353e7-469a-40f6-aa23-48f84621b43e'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:18.850107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d5464d10-06b6-4db9-ae17-8ebdd30bafc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0de8e467d141af9f1b500cbdf867b6', 'request_id': 'req-d5464d10-06b6-4db9-ae17-8ebdd30bafc6'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:18.858415 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d5464d10-06b6-4db9-ae17-8ebdd30bafc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0de8e467d141af9f1b500cbdf867b6', 'request_id': 'req-d5464d10-06b6-4db9-ae17-8ebdd30bafc6'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:18.916144 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c69353e7-469a-40f6-aa23-48f84621b43e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f4170d4e02b421bbda658a192133477', 'request_id': 'req-c69353e7-469a-40f6-aa23-48f84621b43e'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:18.926722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c69353e7-469a-40f6-aa23-48f84621b43e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f4170d4e02b421bbda658a192133477', 'request_id': 'req-c69353e7-469a-40f6-aa23-48f84621b43e'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:18.938253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c69353e7-469a-40f6-aa23-48f84621b43e admin admin] The token cache is being invalidate because project 4f4170d4e02b421bbda658a192133477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:57:18.942515 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c69353e7-469a-40f6-aa23-48f84621b43e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:18.942515 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c69353e7-469a-40f6-aa23-48f84621b43e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:18.942515 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1298/2629] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:57:18 2022] DELETE /identity/v3/projects/4f4170d4e02b421bbda658a192133477 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:18.947011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72156f-f378-46b8-b190-cc3734444d26 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:18.947296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72156f-f378-46b8-b190-cc3734444d26 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:18.947604 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72156f-f378-46b8-b190-cc3734444d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:18.973719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-ae72156f-f378-46b8-b190-cc3734444d26 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:18.976399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ae72156f-f378-46b8-b190-cc3734444d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:19.035495 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d5464d10-06b6-4db9-ae17-8ebdd30bafc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0de8e467d141af9f1b500cbdf867b6', 'request_id': 'req-d5464d10-06b6-4db9-ae17-8ebdd30bafc6'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:19.037909 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:19.048980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1299/2630] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:19.055183 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d5464d10-06b6-4db9-ae17-8ebdd30bafc6 admin admin] The token cache is being invalidate because project 2c0de8e467d141af9f1b500cbdf867b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:57:19.055506 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d5464d10-06b6-4db9-ae17-8ebdd30bafc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:19.056218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-d5464d10-06b6-4db9-ae17-8ebdd30bafc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:19.057760 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1332/2631] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:57:18 2022] DELETE /identity/v3/projects/2c0de8e467d141af9f1b500cbdf867b6 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:19.060266 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0e953-4ec2-4a13-a4fa-c01cf452c93e None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:19.060760 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0e953-4ec2-4a13-a4fa-c01cf452c93e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:19.061269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0e953-4ec2-4a13-a4fa-c01cf452c93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:19.063990 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e3f1e-610a-4369-a708-0f13d9cc482c None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:19.064282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e3f1e-610a-4369-a708-0f13d9cc482c None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:19.064567 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e3f1e-610a-4369-a708-0f13d9cc482c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:19.086872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-da2e3f1e-610a-4369-a708-0f13d9cc482c None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:19.088969 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-da2e3f1e-610a-4369-a708-0f13d9cc482c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:19.092735 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-3bd0e953-4ec2-4a13-a4fa-c01cf452c93e None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:19.094117 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3bd0e953-4ec2-4a13-a4fa-c01cf452c93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:19.101418 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1333/2632] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:19.103764 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1300/2633] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:19.111769 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e3f1e-610a-4369-a708-0f13d9cc482c None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:19.112194 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dfe17-c43a-4f01-ade5-8a02386f5ee6 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:19.112645 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dfe17-c43a-4f01-ade5-8a02386f5ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:19.113006 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dfe17-c43a-4f01-ade5-8a02386f5ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:19.122024 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e3f1e-610a-4369-a708-0f13d9cc482c None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:19.130861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d82d2a-cfce-4e6c-81b4-7ac17053bb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:19.132029 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d82d2a-cfce-4e6c-81b4-7ac17053bb90 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:19.132531 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d82d2a-cfce-4e6c-81b4-7ac17053bb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:19.133023 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d82d2a-cfce-4e6c-81b4-7ac17053bb90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:19.134415 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d82d2a-cfce-4e6c-81b4-7ac17053bb90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:57:19.134974 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d82d2a-cfce-4e6c-81b4-7ac17053bb90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:19.136342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-068dfe17-c43a-4f01-ade5-8a02386f5ee6 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:19.138059 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-068dfe17-c43a-4f01-ade5-8a02386f5ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:19.138234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d82d2a-cfce-4e6c-81b4-7ac17053bb90 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:19.148408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1301/2634] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:19.153788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068dfe17-c43a-4f01-ade5-8a02386f5ee6 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:19.156353 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1334/2635] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:57:19.161116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d82d2a-cfce-4e6c-81b4-7ac17053bb90 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:19.168632 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068dfe17-c43a-4f01-ade5-8a02386f5ee6 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:19.174372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d77ae-743f-43bd-a374-1c1b41092218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:19.175281 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d77ae-743f-43bd-a374-1c1b41092218 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:19.175421 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d77ae-743f-43bd-a374-1c1b41092218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:19.175897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d77ae-743f-43bd-a374-1c1b41092218 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:19.176617 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d77ae-743f-43bd-a374-1c1b41092218 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:57:19.179393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d77ae-743f-43bd-a374-1c1b41092218 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:19.179393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d77ae-743f-43bd-a374-1c1b41092218 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:19.179686 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d82d2a-cfce-4e6c-81b4-7ac17053bb90 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:19.189073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d8780-f31c-4213-98a4-1d230a291d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:19.190159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d8780-f31c-4213-98a4-1d230a291d80 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:19.190650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d8780-f31c-4213-98a4-1d230a291d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:19.191164 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d8780-f31c-4213-98a4-1d230a291d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:19.192357 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d8780-f31c-4213-98a4-1d230a291d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:19.196467 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1302/2636] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:57:19.196651 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d8780-f31c-4213-98a4-1d230a291d80 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:19.197527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d77ae-743f-43bd-a374-1c1b41092218 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:19.217211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d77ae-743f-43bd-a374-1c1b41092218 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:19.227762 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200d98d-00ad-4c46-b5ef-d2cad537a724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:19.228389 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200d98d-00ad-4c46-b5ef-d2cad537a724 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:19.228675 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200d98d-00ad-4c46-b5ef-d2cad537a724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:19.228949 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200d98d-00ad-4c46-b5ef-d2cad537a724 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:19.229590 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200d98d-00ad-4c46-b5ef-d2cad537a724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:19.231714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200d98d-00ad-4c46-b5ef-d2cad537a724 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:19.328688 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1335/2637] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:19 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:19.333804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d8780-f31c-4213-98a4-1d230a291d80 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:19.387111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1303/2638] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:19 2022] POST /identity/v3/projects => generated 399 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:19.394447 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200d98d-00ad-4c46-b5ef-d2cad537a724 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:19.437120 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d8780-f31c-4213-98a4-1d230a291d80 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:19.483929 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200d98d-00ad-4c46-b5ef-d2cad537a724 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:19.506245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7b526-ba6b-44cb-954a-5ddbaacb7e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:19.507149 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7b526-ba6b-44cb-954a-5ddbaacb7e22 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:19.507844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7b526-ba6b-44cb-954a-5ddbaacb7e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:19.507844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7b526-ba6b-44cb-954a-5ddbaacb7e22 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:19.508659 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7b526-ba6b-44cb-954a-5ddbaacb7e22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:19.510892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7b526-ba6b-44cb-954a-5ddbaacb7e22 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:19.527611 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c968e-668e-4a34-a565-56b8261bed72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:19.528245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c968e-668e-4a34-a565-56b8261bed72 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:19.528495 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c968e-668e-4a34-a565-56b8261bed72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:19.528770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c968e-668e-4a34-a565-56b8261bed72 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:19.529433 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c968e-668e-4a34-a565-56b8261bed72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:19.532014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c968e-668e-4a34-a565-56b8261bed72 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:19.596570 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1304/2639] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:19 2022] POST /identity/v3/users => generated 300 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:19.601670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7b526-ba6b-44cb-954a-5ddbaacb7e22 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:19.608288 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:19.612710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7b526-ba6b-44cb-954a-5ddbaacb7e22 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:19.618317 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435886f2-19cf-43b0-8ab5-08a392bdac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:19.619058 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435886f2-19cf-43b0-8ab5-08a392bdac5d admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:19.619414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435886f2-19cf-43b0-8ab5-08a392bdac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:19.619855 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435886f2-19cf-43b0-8ab5-08a392bdac5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:19.620645 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435886f2-19cf-43b0-8ab5-08a392bdac5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:19.622528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435886f2-19cf-43b0-8ab5-08a392bdac5d admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:19.634877 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1336/2640] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:19 2022] POST /identity/v3/users => generated 289 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:19.635583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1305/2641] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:19.639049 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c968e-668e-4a34-a565-56b8261bed72 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:19.640376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435886f2-19cf-43b0-8ab5-08a392bdac5d admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:19.649656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c968e-668e-4a34-a565-56b8261bed72 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:19.655380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec4ff7-fbf7-4976-9543-954de565bab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:19.656033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec4ff7-fbf7-4976-9543-954de565bab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:19.656313 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec4ff7-fbf7-4976-9543-954de565bab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:19.656590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec4ff7-fbf7-4976-9543-954de565bab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:19.656957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435886f2-19cf-43b0-8ab5-08a392bdac5d admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:19.657250 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec4ff7-fbf7-4976-9543-954de565bab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:19.659752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec4ff7-fbf7-4976-9543-954de565bab4 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:19.664274 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6625b31-963c-4656-85e9-5d898a099bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:19.664983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6625b31-963c-4656-85e9-5d898a099bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:19.666109 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6625b31-963c-4656-85e9-5d898a099bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:19.666109 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6625b31-963c-4656-85e9-5d898a099bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:19.666922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6625b31-963c-4656-85e9-5d898a099bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:19.669163 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6625b31-963c-4656-85e9-5d898a099bc5 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:19.671625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1337/2642] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:19.676545 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec4ff7-fbf7-4976-9543-954de565bab4 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:19.686668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1306/2643] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:19.687261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec4ff7-fbf7-4976-9543-954de565bab4 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:19.687595 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6625b31-963c-4656-85e9-5d898a099bc5 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:19.693195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f150b4-f133-4639-95b9-8a468f1fa6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:19.694022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f150b4-f133-4639-95b9-8a468f1fa6aa admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:19.694179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f150b4-f133-4639-95b9-8a468f1fa6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:19.694358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f150b4-f133-4639-95b9-8a468f1fa6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:19.695068 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f150b4-f133-4639-95b9-8a468f1fa6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:19.697001 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f150b4-f133-4639-95b9-8a468f1fa6aa admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:19.700091 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6625b31-963c-4656-85e9-5d898a099bc5 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:19.705551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e291de3-c876-4a97-be38-4fd1518237e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:19.706257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e291de3-c876-4a97-be38-4fd1518237e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:19.709494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e291de3-c876-4a97-be38-4fd1518237e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:19.709494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e291de3-c876-4a97-be38-4fd1518237e5 admin admin] PATH_INFO: `/v3/projects/c2b62bd1e25648ceb9b54ffaa8d18343/users/9547dbfc013248488c9b1241dc2b6b24/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:19.709752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1338/2644] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:19.713798 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f150b4-f133-4639-95b9-8a468f1fa6aa admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:19.723443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e291de3-c876-4a97-be38-4fd1518237e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b62bd1e25648ceb9b54ffaa8d18343, user_id=9547dbfc013248488c9b1241dc2b6b24, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:19.726408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e291de3-c876-4a97-be38-4fd1518237e5 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:19.734641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f150b4-f133-4639-95b9-8a468f1fa6aa admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:19.741031 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557c554-c303-4353-978e-833cb4ac855f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:19.741856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557c554-c303-4353-978e-833cb4ac855f admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:19.742379 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557c554-c303-4353-978e-833cb4ac855f admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:19.742751 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557c554-c303-4353-978e-833cb4ac855f admin admin] PATH_INFO: `/v3/projects/f041c7b8bf5442cda3ad8553642aa1dd/users/ce88d07183eb4b9ab01be1a11f71ad4e/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:19.761114 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557c554-c303-4353-978e-833cb4ac855f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f041c7b8bf5442cda3ad8553642aa1dd, user_id=ce88d07183eb4b9ab01be1a11f71ad4e, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:19.763832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557c554-c303-4353-978e-833cb4ac855f admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:19.807676 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1307/2645] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:19 2022] PUT /identity/v3/projects/c2b62bd1e25648ceb9b54ffaa8d18343/users/9547dbfc013248488c9b1241dc2b6b24/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:19.820973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697d556-c0d5-41dd-88cd-6c84f66b9657 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:19.821258 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697d556-c0d5-41dd-88cd-6c84f66b9657 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:19.821535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697d556-c0d5-41dd-88cd-6c84f66b9657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:19.825606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:19.832562 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1339/2646] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:19 2022] PUT /identity/v3/projects/f041c7b8bf5442cda3ad8553642aa1dd/users/ce88d07183eb4b9ab01be1a11f71ad4e/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:19.843415 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d296c8f-0918-4e51-8417-6c1cead09010 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:19.843934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d296c8f-0918-4e51-8417-6c1cead09010 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:19.844163 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d296c8f-0918-4e51-8417-6c1cead09010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:19.855706 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-1697d556-c0d5-41dd-88cd-6c84f66b9657 None None] MFA Rules not processed for user `9547dbfc013248488c9b1241dc2b6b24`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:19.856841 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1697d556-c0d5-41dd-88cd-6c84f66b9657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:19.879811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-6d296c8f-0918-4e51-8417-6c1cead09010 None None] MFA Rules not processed for user `ce88d07183eb4b9ab01be1a11f71ad4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:19.881150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-6d296c8f-0918-4e51-8417-6c1cead09010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:19.941447 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1308/2647] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:19.946425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697d556-c0d5-41dd-88cd-6c84f66b9657 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:19.972830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1340/2648] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:19.977643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d296c8f-0918-4e51-8417-6c1cead09010 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:20.027670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697d556-c0d5-41dd-88cd-6c84f66b9657 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:20.035897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b703eb-63cf-4032-924d-10859a318a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:20.036539 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b703eb-63cf-4032-924d-10859a318a40 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:20.036812 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b703eb-63cf-4032-924d-10859a318a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:20.037086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b703eb-63cf-4032-924d-10859a318a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:20.037878 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b703eb-63cf-4032-924d-10859a318a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:20.040163 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b703eb-63cf-4032-924d-10859a318a40 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:20.066916 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d296c8f-0918-4e51-8417-6c1cead09010 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:20.072624 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa1e0b-491b-4952-b48c-3101ce5b132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:20.073248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa1e0b-491b-4952-b48c-3101ce5b132c admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:20.073584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa1e0b-491b-4952-b48c-3101ce5b132c admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:20.073916 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa1e0b-491b-4952-b48c-3101ce5b132c admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:20.074607 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa1e0b-491b-4952-b48c-3101ce5b132c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:20.076735 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa1e0b-491b-4952-b48c-3101ce5b132c admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:20.229390 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1341/2649] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:19 2022] POST /identity/v3/projects => generated 379 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:20.236932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa1e0b-491b-4952-b48c-3101ce5b132c admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:20.237526 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1309/2650] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:19 2022] POST /identity/v3/projects => generated 401 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:20.239390 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b703eb-63cf-4032-924d-10859a318a40 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:20.286129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:20.317203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b703eb-63cf-4032-924d-10859a318a40 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:20.317490 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa1e0b-491b-4952-b48c-3101ce5b132c admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:20.322997 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff78f8-2b57-492a-b815-12b4d61c1ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:20.323600 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff78f8-2b57-492a-b815-12b4d61c1ffa admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:20.323891 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff78f8-2b57-492a-b815-12b4d61c1ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:20.324190 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff78f8-2b57-492a-b815-12b4d61c1ffa admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:20.324766 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff78f8-2b57-492a-b815-12b4d61c1ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:20.325613 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfacddf-66ac-46a2-b4b6-4cc67ec048db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:20.326560 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfacddf-66ac-46a2-b4b6-4cc67ec048db admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:20.326762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff78f8-2b57-492a-b815-12b4d61c1ffa admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:20.327034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfacddf-66ac-46a2-b4b6-4cc67ec048db admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:20.327452 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfacddf-66ac-46a2-b4b6-4cc67ec048db admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:20.328290 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfacddf-66ac-46a2-b4b6-4cc67ec048db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:20.332162 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfacddf-66ac-46a2-b4b6-4cc67ec048db admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:20.447281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1342/2651] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:20 2022] POST /identity/v3/users => generated 296 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:20.451214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff78f8-2b57-492a-b815-12b4d61c1ffa admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:20.458075 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:20.463633 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff78f8-2b57-492a-b815-12b4d61c1ffa admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:20.468851 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bebf36-cbb1-4f4a-befe-fff951c50274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:20.469480 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bebf36-cbb1-4f4a-befe-fff951c50274 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:20.470662 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bebf36-cbb1-4f4a-befe-fff951c50274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:20.470662 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bebf36-cbb1-4f4a-befe-fff951c50274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:20.471828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bebf36-cbb1-4f4a-befe-fff951c50274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:20.473610 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bebf36-cbb1-4f4a-befe-fff951c50274 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:20.482419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1310/2652] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:20 2022] POST /identity/v3/users => generated 307 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:20.483860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfacddf-66ac-46a2-b4b6-4cc67ec048db admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:20.489678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1343/2653] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:20.495431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bebf36-cbb1-4f4a-befe-fff951c50274 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:20.503467 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfacddf-66ac-46a2-b4b6-4cc67ec048db admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:20.506008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bebf36-cbb1-4f4a-befe-fff951c50274 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:20.510397 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715cfbe-d331-4674-9e9f-aa2fa214951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:20.511403 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715cfbe-d331-4674-9e9f-aa2fa214951d admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:20.511831 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715cfbe-d331-4674-9e9f-aa2fa214951d admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:20.512284 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715cfbe-d331-4674-9e9f-aa2fa214951d admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:20.513670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715cfbe-d331-4674-9e9f-aa2fa214951d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:20.515879 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715cfbe-d331-4674-9e9f-aa2fa214951d admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:20.520172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef215fd-d136-4ca0-9b7e-6de2c95f6d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:20.521347 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef215fd-d136-4ca0-9b7e-6de2c95f6d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:20.521814 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef215fd-d136-4ca0-9b7e-6de2c95f6d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:20.522279 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef215fd-d136-4ca0-9b7e-6de2c95f6d67 admin admin] PATH_INFO: `/v3/projects/49969ab28a3944e993ae2f03db45fdb7/users/8b44ecb50e8745de97c39da50ba27883/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:20.548249 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1311/2654] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:20.553612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715cfbe-d331-4674-9e9f-aa2fa214951d admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:20.562084 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef215fd-d136-4ca0-9b7e-6de2c95f6d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49969ab28a3944e993ae2f03db45fdb7, user_id=8b44ecb50e8745de97c39da50ba27883, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:20.570852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef215fd-d136-4ca0-9b7e-6de2c95f6d67 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:20.582525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715cfbe-d331-4674-9e9f-aa2fa214951d admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:20.589866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b32e7-f4fc-428b-bec2-01894af29733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:20.590801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b32e7-f4fc-428b-bec2-01894af29733 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:20.591598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b32e7-f4fc-428b-bec2-01894af29733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:20.592056 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b32e7-f4fc-428b-bec2-01894af29733 admin admin] PATH_INFO: `/v3/projects/ed2ac06d5a67490ea37368e04f591978/users/c132a06b75d64a35bac16b19416533ec/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:20.614128 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b32e7-f4fc-428b-bec2-01894af29733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2ac06d5a67490ea37368e04f591978, user_id=c132a06b75d64a35bac16b19416533ec, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:20.617097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b32e7-f4fc-428b-bec2-01894af29733 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:20.699339 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1344/2655] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:20 2022] PUT /identity/v3/projects/49969ab28a3944e993ae2f03db45fdb7/users/8b44ecb50e8745de97c39da50ba27883/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:20.703593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef215fd-d136-4ca0-9b7e-6de2c95f6d67 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:20.738672 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1312/2656] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:20 2022] PUT /identity/v3/projects/ed2ac06d5a67490ea37368e04f591978/users/c132a06b75d64a35bac16b19416533ec/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:20.746780 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b32e7-f4fc-428b-bec2-01894af29733 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:20.781133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef215fd-d136-4ca0-9b7e-6de2c95f6d67 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:20.828495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b32e7-f4fc-428b-bec2-01894af29733 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:20.835987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c2ca1-823f-4a01-b357-2ff0334081b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:20.837076 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c2ca1-823f-4a01-b357-2ff0334081b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:20.837555 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c2ca1-823f-4a01-b357-2ff0334081b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:20.838071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c2ca1-823f-4a01-b357-2ff0334081b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:20.839141 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c2ca1-823f-4a01-b357-2ff0334081b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:20.841136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c2ca1-823f-4a01-b357-2ff0334081b8 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:20.851148 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229576b1-79ef-425a-9d90-0341424d33b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:20.851908 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229576b1-79ef-425a-9d90-0341424d33b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:20.852682 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229576b1-79ef-425a-9d90-0341424d33b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:20.852682 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229576b1-79ef-425a-9d90-0341424d33b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:20.857813 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229576b1-79ef-425a-9d90-0341424d33b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:20.858038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1313/2657] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:20.858038 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1abe0-f775-4f21-a8ef-636bb9e24b02 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:20.858244 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229576b1-79ef-425a-9d90-0341424d33b7 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:20.858336 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1abe0-f775-4f21-a8ef-636bb9e24b02 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:20.858336 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1abe0-f775-4f21-a8ef-636bb9e24b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:20.868442 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1345/2658] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:20.869188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229576b1-79ef-425a-9d90-0341424d33b7 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:20.883112 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229576b1-79ef-425a-9d90-0341424d33b7 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:20.890054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6633cc5-89cf-431a-b369-653dd6b10c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:20.890807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6633cc5-89cf-431a-b369-653dd6b10c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:20.891237 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6633cc5-89cf-431a-b369-653dd6b10c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:20.892261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6633cc5-89cf-431a-b369-653dd6b10c5b admin admin] PATH_INFO: `/v3/projects/ed2ac06d5a67490ea37368e04f591978/users/c132a06b75d64a35bac16b19416533ec/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:20.895073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6633cc5-89cf-431a-b369-653dd6b10c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2ac06d5a67490ea37368e04f591978, user_id=c132a06b75d64a35bac16b19416533ec, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:20.895874 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-09a1abe0-f775-4f21-a8ef-636bb9e24b02 None None] MFA Rules not processed for user `87ba67fc171b4258b6fda72094ed11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:20.897130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-09a1abe0-f775-4f21-a8ef-636bb9e24b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:20.898311 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6633cc5-89cf-431a-b369-653dd6b10c5b admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:20.916622 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1346/2659] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:20 2022] PUT /identity/v3/projects/ed2ac06d5a67490ea37368e04f591978/users/c132a06b75d64a35bac16b19416533ec/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:20.916622 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6633cc5-89cf-431a-b369-653dd6b10c5b admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:20.976872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1314/2660] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Sep 7 16:57:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:20.982124 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea546f-2356-4f07-8103-5ccebcd1d7bd None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:20.982452 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea546f-2356-4f07-8103-5ccebcd1d7bd None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:20.982674 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea546f-2356-4f07-8103-5ccebcd1d7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:21.019736 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:21.024575 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6633cc5-89cf-431a-b369-653dd6b10c5b admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:21.037018 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55043e9-4777-47f9-b7ce-e2d748cbd18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:21.037712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55043e9-4777-47f9-b7ce-e2d748cbd18f admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:21.037996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55043e9-4777-47f9-b7ce-e2d748cbd18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:21.038276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55043e9-4777-47f9-b7ce-e2d748cbd18f admin admin] PATH_INFO: `/v3/projects/49969ab28a3944e993ae2f03db45fdb7/users/8b44ecb50e8745de97c39da50ba27883/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:21.041113 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55043e9-4777-47f9-b7ce-e2d748cbd18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=49969ab28a3944e993ae2f03db45fdb7, user_id=8b44ecb50e8745de97c39da50ba27883, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:21.044623 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55043e9-4777-47f9-b7ce-e2d748cbd18f admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:21.048410 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-02ea546f-2356-4f07-8103-5ccebcd1d7bd None None] MFA Rules not processed for user `c132a06b75d64a35bac16b19416533ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:21.050499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-02ea546f-2356-4f07-8103-5ccebcd1d7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:21.058460 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1347/2661] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:20 2022] PUT /identity/v3/projects/49969ab28a3944e993ae2f03db45fdb7/users/8b44ecb50e8745de97c39da50ba27883/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:21.068235 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:21.071591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8004a0-098a-4cd4-8029-2353518d3e3e None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:21.071898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8004a0-098a-4cd4-8029-2353518d3e3e None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:21.072147 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8004a0-098a-4cd4-8029-2353518d3e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:21.116670 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8e8004a0-098a-4cd4-8029-2353518d3e3e None None] MFA Rules not processed for user `8b44ecb50e8745de97c39da50ba27883`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:21.118475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8e8004a0-098a-4cd4-8029-2353518d3e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:21.162792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1315/2662] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:20 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:21.177509 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea546f-2356-4f07-8103-5ccebcd1d7bd None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:21.178996 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-02ea546f-2356-4f07-8103-5ccebcd1d7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:21.213962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1348/2663] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:21.231576 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8004a0-098a-4cd4-8029-2353518d3e3e None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:21.233236 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8e8004a0-098a-4cd4-8029-2353518d3e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:21.250342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea546f-2356-4f07-8103-5ccebcd1d7bd None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:21.256589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb86f5-0932-463f-b378-22cc7a1cdc79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:21.257550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb86f5-0932-463f-b378-22cc7a1cdc79 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:21.257838 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb86f5-0932-463f-b378-22cc7a1cdc79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:21.258118 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb86f5-0932-463f-b378-22cc7a1cdc79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:21.279088 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb86f5-0932-463f-b378-22cc7a1cdc79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:21.281933 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb86f5-0932-463f-b378-22cc7a1cdc79 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:21.302382 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1316/2664] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:21 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:57:21.303619 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb86f5-0932-463f-b378-22cc7a1cdc79 service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:21.305459 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-04fb86f5-0932-463f-b378-22cc7a1cdc79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:21.351255 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8004a0-098a-4cd4-8029-2353518d3e3e None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:21.355584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae55f10-5907-4bed-a1ad-9ca48071f725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:21.356445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae55f10-5907-4bed-a1ad-9ca48071f725 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:21.356844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae55f10-5907-4bed-a1ad-9ca48071f725 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:21.358515 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae55f10-5907-4bed-a1ad-9ca48071f725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:21.418046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb86f5-0932-463f-b378-22cc7a1cdc79 service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:21.428591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed6518-2a60-49f7-9454-6bc631c8a1f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56cd868e866d436aa1d601f7791e812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:21.429192 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed6518-2a60-49f7-9454-6bc631c8a1f8 service swift] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:21.429377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed6518-2a60-49f7-9454-6bc631c8a1f8 service swift] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:21.429655 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed6518-2a60-49f7-9454-6bc631c8a1f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:21.445902 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae55f10-5907-4bed-a1ad-9ca48071f725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:21.447342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae55f10-5907-4bed-a1ad-9ca48071f725 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:21.457261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1349/2665] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:57:21.485407 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:21.498315 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed6518-2a60-49f7-9454-6bc631c8a1f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:21.501734 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed6518-2a60-49f7-9454-6bc631c8a1f8 service swift] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:21.516614 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1317/2666] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Sep 7 16:57:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:57:21.534654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae55f10-5907-4bed-a1ad-9ca48071f725 service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:21.546177 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae55f10-5907-4bed-a1ad-9ca48071f725 service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:21.562532 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c6d4e-cc92-478d-a1c8-968f4cc56707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:21.563336 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c6d4e-cc92-478d-a1c8-968f4cc56707 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:21.568451 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c6d4e-cc92-478d-a1c8-968f4cc56707 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:21.568451 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c6d4e-cc92-478d-a1c8-968f4cc56707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:21.643789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:21.730376 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c6d4e-cc92-478d-a1c8-968f4cc56707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:21.731206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c6d4e-cc92-478d-a1c8-968f4cc56707 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:21.760471 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1350/2667] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:21 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:23.624878 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed6518-2a60-49f7-9454-6bc631c8a1f8 service swift] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:23.643248 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed6518-2a60-49f7-9454-6bc631c8a1f8 service swift] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:23.647903 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72167f5-501e-435c-8ba9-c420a02d9d23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:23.648893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72167f5-501e-435c-8ba9-c420a02d9d23 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:23.649454 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72167f5-501e-435c-8ba9-c420a02d9d23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:23.649986 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72167f5-501e-435c-8ba9-c420a02d9d23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:23.672166 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72167f5-501e-435c-8ba9-c420a02d9d23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:23.675334 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72167f5-501e-435c-8ba9-c420a02d9d23 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:23.686692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1318/2668] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:28.315948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c6d4e-cc92-478d-a1c8-968f4cc56707 service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:28.347963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72167f5-501e-435c-8ba9-c420a02d9d23 service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:28.387929 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c6d4e-cc92-478d-a1c8-968f4cc56707 service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:28.394461 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f49225-ed2a-4bcf-b771-921ff62c013c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:28.395403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f49225-ed2a-4bcf-b771-921ff62c013c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:28.395647 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f49225-ed2a-4bcf-b771-921ff62c013c admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:28.395927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f49225-ed2a-4bcf-b771-921ff62c013c admin admin] PATH_INFO: `/v3/users/9547dbfc013248488c9b1241dc2b6b24` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:28.397090 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f49225-ed2a-4bcf-b771-921ff62c013c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9547dbfc013248488c9b1241dc2b6b24)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:28.399376 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f49225-ed2a-4bcf-b771-921ff62c013c admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:28.424927 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72167f5-501e-435c-8ba9-c420a02d9d23 service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:28.430294 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867a94a-d311-4346-bc24-6689e90767de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:28.431276 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a94a-d311-4346-bc24-6689e90767de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:28.431798 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a94a-d311-4346-bc24-6689e90767de admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:28.432194 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a94a-d311-4346-bc24-6689e90767de admin admin] PATH_INFO: `/v3/users/ce88d07183eb4b9ab01be1a11f71ad4e` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:28.434032 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867a94a-d311-4346-bc24-6689e90767de admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce88d07183eb4b9ab01be1a11f71ad4e)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:28.438261 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867a94a-d311-4346-bc24-6689e90767de admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:28.671420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-86f49225-ed2a-4bcf-b771-921ff62c013c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9547dbfc013248488c9b1241dc2b6b24'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:28.688983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0867a94a-d311-4346-bc24-6689e90767de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce88d07183eb4b9ab01be1a11f71ad4e'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:28.690371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0867a94a-d311-4346-bc24-6689e90767de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce88d07183eb4b9ab01be1a11f71ad4e'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:28.698958 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0867a94a-d311-4346-bc24-6689e90767de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce88d07183eb4b9ab01be1a11f71ad4e'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:28.715136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0867a94a-d311-4346-bc24-6689e90767de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce88d07183eb4b9ab01be1a11f71ad4e'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:28.715919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-0867a94a-d311-4346-bc24-6689e90767de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce88d07183eb4b9ab01be1a11f71ad4e'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:28.887985 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-86f49225-ed2a-4bcf-b771-921ff62c013c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9547dbfc013248488c9b1241dc2b6b24'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:28.889132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-86f49225-ed2a-4bcf-b771-921ff62c013c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9547dbfc013248488c9b1241dc2b6b24'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:28.890023 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-86f49225-ed2a-4bcf-b771-921ff62c013c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9547dbfc013248488c9b1241dc2b6b24'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:28.899708 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-86f49225-ed2a-4bcf-b771-921ff62c013c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9547dbfc013248488c9b1241dc2b6b24'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:28.922105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1351/2669] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:57:28 2022] DELETE /identity/v3/users/9547dbfc013248488c9b1241dc2b6b24 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:28.927927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acd124-5c07-4c3d-94dc-ac87432fde42 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:28.928249 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acd124-5c07-4c3d-94dc-ac87432fde42 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:28.928475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acd124-5c07-4c3d-94dc-ac87432fde42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:28.955542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-34acd124-5c07-4c3d-94dc-ac87432fde42 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:28.956946 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-34acd124-5c07-4c3d-94dc-ac87432fde42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:28.974928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1319/2670] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:57:28 2022] DELETE /identity/v3/users/ce88d07183eb4b9ab01be1a11f71ad4e => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:28.979320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cce9d-1311-4c21-9f64-9ce8a09b91f7 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:28.979738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cce9d-1311-4c21-9f64-9ce8a09b91f7 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:28.980046 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cce9d-1311-4c21-9f64-9ce8a09b91f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:29.010192 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-305cce9d-1311-4c21-9f64-9ce8a09b91f7 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:29.012492 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-305cce9d-1311-4c21-9f64-9ce8a09b91f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:29.019676 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:29.039934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1352/2671] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:29.052038 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acd124-5c07-4c3d-94dc-ac87432fde42 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:29.054020 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-34acd124-5c07-4c3d-94dc-ac87432fde42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:29.093677 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:29.114584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1320/2672] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:29.129179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cce9d-1311-4c21-9f64-9ce8a09b91f7 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:29.138710 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acd124-5c07-4c3d-94dc-ac87432fde42 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:29.201767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cce9d-1311-4c21-9f64-9ce8a09b91f7 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:29.209730 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5376efd-2f37-47e2-8042-4f98176cc294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:29.210847 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5376efd-2f37-47e2-8042-4f98176cc294 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:29.211619 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5376efd-2f37-47e2-8042-4f98176cc294 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:29.216777 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5376efd-2f37-47e2-8042-4f98176cc294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:29.216932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bdf3c-cf57-4894-b04d-7366c4cee805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:29.216932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bdf3c-cf57-4894-b04d-7366c4cee805 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:29.216932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bdf3c-cf57-4894-b04d-7366c4cee805 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:29.216932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bdf3c-cf57-4894-b04d-7366c4cee805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:29.226740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5376efd-2f37-47e2-8042-4f98176cc294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:29.230839 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bdf3c-cf57-4894-b04d-7366c4cee805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:29.231165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5376efd-2f37-47e2-8042-4f98176cc294 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:29.231279 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bdf3c-cf57-4894-b04d-7366c4cee805 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:29.242882 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1353/2673] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:29.243790 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1321/2674] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:29.845253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bdf3c-cf57-4894-b04d-7366c4cee805 service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:29.845253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-fc4bdf3c-cf57-4894-b04d-7366c4cee805 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:29.873010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bdf3c-cf57-4894-b04d-7366c4cee805 service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:29.879300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3cb01-abbd-4027-8f62-b5523782bb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:29.880196 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3cb01-abbd-4027-8f62-b5523782bb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:29.880573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3cb01-abbd-4027-8f62-b5523782bb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:29.880946 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3cb01-abbd-4027-8f62-b5523782bb92 admin admin] PATH_INFO: `/v3/projects/c2b62bd1e25648ceb9b54ffaa8d18343` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:29.882783 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3cb01-abbd-4027-8f62-b5523782bb92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2b62bd1e25648ceb9b54ffaa8d18343)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:29.884852 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3cb01-abbd-4027-8f62-b5523782bb92 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:30.013377 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5376efd-2f37-47e2-8042-4f98176cc294 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:30.015079 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f5376efd-2f37-47e2-8042-4f98176cc294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:30.041769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5376efd-2f37-47e2-8042-4f98176cc294 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:30.053146 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:30.055123 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:30.056223 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:30.062268 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af admin admin] PATH_INFO: `/v3/projects/f041c7b8bf5442cda3ad8553642aa1dd` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:30.062268 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f041c7b8bf5442cda3ad8553642aa1dd)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:30.065068 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:30.081166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-58f3cb01-abbd-4027-8f62-b5523782bb92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2b62bd1e25648ceb9b54ffaa8d18343', 'request_id': 'req-58f3cb01-abbd-4027-8f62-b5523782bb92'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.089903 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-58f3cb01-abbd-4027-8f62-b5523782bb92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2b62bd1e25648ceb9b54ffaa8d18343', 'request_id': 'req-58f3cb01-abbd-4027-8f62-b5523782bb92'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.271551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-58f3cb01-abbd-4027-8f62-b5523782bb92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2b62bd1e25648ceb9b54ffaa8d18343', 'request_id': 'req-58f3cb01-abbd-4027-8f62-b5523782bb92'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.292944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f041c7b8bf5442cda3ad8553642aa1dd', 'request_id': 'req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.306512 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-58f3cb01-abbd-4027-8f62-b5523782bb92 admin admin] The token cache is being invalidate because project c2b62bd1e25648ceb9b54ffaa8d18343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:57:30.307431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-58f3cb01-abbd-4027-8f62-b5523782bb92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.308531 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-58f3cb01-abbd-4027-8f62-b5523782bb92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.314208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1354/2675] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:57:29 2022] DELETE /identity/v3/projects/c2b62bd1e25648ceb9b54ffaa8d18343 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:30.317548 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3cb01-abbd-4027-8f62-b5523782bb92 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:30.322010 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-58f3cb01-abbd-4027-8f62-b5523782bb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:30.361612 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:30.400677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3cb01-abbd-4027-8f62-b5523782bb92 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:30.400949 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f041c7b8bf5442cda3ad8553642aa1dd', 'request_id': 'req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.416086 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f041c7b8bf5442cda3ad8553642aa1dd', 'request_id': 'req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.436744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af admin admin] The token cache is being invalidate because project f041c7b8bf5442cda3ad8553642aa1dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:57:30.437287 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.439286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.441977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1322/2676] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:57:30 2022] DELETE /identity/v3/projects/f041c7b8bf5442cda3ad8553642aa1dd => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:30.446402 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:30.454934 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:30.515401 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f360a-a20a-4cb2-b6b5-f2fb1d526237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:30.516841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f360a-a20a-4cb2-b6b5-f2fb1d526237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:30.517304 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f360a-a20a-4cb2-b6b5-f2fb1d526237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:30.517752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f360a-a20a-4cb2-b6b5-f2fb1d526237 admin admin] PATH_INFO: `/v3/users/c132a06b75d64a35bac16b19416533ec` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:30.520570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f360a-a20a-4cb2-b6b5-f2fb1d526237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c132a06b75d64a35bac16b19416533ec)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:30.522759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f360a-a20a-4cb2-b6b5-f2fb1d526237 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:30.575407 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a73c55-82fd-479d-ad75-2a8b9ab5d1af admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:30.580743 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a081722-bef0-4298-b0a3-a1e9294b20f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:30.581395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a081722-bef0-4298-b0a3-a1e9294b20f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:30.581672 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a081722-bef0-4298-b0a3-a1e9294b20f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:30.581940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a081722-bef0-4298-b0a3-a1e9294b20f5 admin admin] PATH_INFO: `/v3/users/8b44ecb50e8745de97c39da50ba27883` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:30.583277 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a081722-bef0-4298-b0a3-a1e9294b20f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b44ecb50e8745de97c39da50ba27883)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:30.585244 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a081722-bef0-4298-b0a3-a1e9294b20f5 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:30.614329 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:30.741371 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ff4f360a-a20a-4cb2-b6b5-f2fb1d526237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c132a06b75d64a35bac16b19416533ec'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.784981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4a081722-bef0-4298-b0a3-a1e9294b20f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b44ecb50e8745de97c39da50ba27883'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.784981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4a081722-bef0-4298-b0a3-a1e9294b20f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b44ecb50e8745de97c39da50ba27883'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.793233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4a081722-bef0-4298-b0a3-a1e9294b20f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b44ecb50e8745de97c39da50ba27883'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.807310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4a081722-bef0-4298-b0a3-a1e9294b20f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b44ecb50e8745de97c39da50ba27883'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.808298 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-4a081722-bef0-4298-b0a3-a1e9294b20f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b44ecb50e8745de97c39da50ba27883'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.841238 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ff4f360a-a20a-4cb2-b6b5-f2fb1d526237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c132a06b75d64a35bac16b19416533ec'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.842498 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ff4f360a-a20a-4cb2-b6b5-f2fb1d526237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c132a06b75d64a35bac16b19416533ec'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.843120 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ff4f360a-a20a-4cb2-b6b5-f2fb1d526237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c132a06b75d64a35bac16b19416533ec'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.852902 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ff4f360a-a20a-4cb2-b6b5-f2fb1d526237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c132a06b75d64a35bac16b19416533ec'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:30.873232 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1355/2677] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:57:30 2022] DELETE /identity/v3/users/c132a06b75d64a35bac16b19416533ec => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:30.933224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1323/2678] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:57:30 2022] DELETE /identity/v3/users/8b44ecb50e8745de97c39da50ba27883 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:31.563714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f360a-a20a-4cb2-b6b5-f2fb1d526237 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:31.564388 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ff4f360a-a20a-4cb2-b6b5-f2fb1d526237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:31.599513 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a081722-bef0-4298-b0a3-a1e9294b20f5 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:31.602850 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4a081722-bef0-4298-b0a3-a1e9294b20f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:31.667269 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:31.676061 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f360a-a20a-4cb2-b6b5-f2fb1d526237 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:31.728411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a081722-bef0-4298-b0a3-a1e9294b20f5 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:31.733779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e29eb-8b31-4ee4-a1c3-c7271b0f23df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:31.815356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e29eb-8b31-4ee4-a1c3-c7271b0f23df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:31.815356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e29eb-8b31-4ee4-a1c3-c7271b0f23df admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:31.815356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e29eb-8b31-4ee4-a1c3-c7271b0f23df admin admin] PATH_INFO: `/v3/projects/49969ab28a3944e993ae2f03db45fdb7` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:31.815356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e29eb-8b31-4ee4-a1c3-c7271b0f23df admin admin] RBAC: Authorizing `identity:delete_project(project_id=49969ab28a3944e993ae2f03db45fdb7)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:31.815356 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e29eb-8b31-4ee4-a1c3-c7271b0f23df admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:31.815924 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7b222-bef3-4b45-b148-5e3269962fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:31.815924 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7b222-bef3-4b45-b148-5e3269962fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:31.815924 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7b222-bef3-4b45-b148-5e3269962fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:31.815924 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7b222-bef3-4b45-b148-5e3269962fca admin admin] PATH_INFO: `/v3/projects/ed2ac06d5a67490ea37368e04f591978` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:31.816321 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7b222-bef3-4b45-b148-5e3269962fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed2ac06d5a67490ea37368e04f591978)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:31.816321 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7b222-bef3-4b45-b148-5e3269962fca admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:32.050668 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-57e7b222-bef3-4b45-b148-5e3269962fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed2ac06d5a67490ea37368e04f591978', 'request_id': 'req-57e7b222-bef3-4b45-b148-5e3269962fca'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:32.051402 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ab7e29eb-8b31-4ee4-a1c3-c7271b0f23df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49969ab28a3944e993ae2f03db45fdb7', 'request_id': 'req-ab7e29eb-8b31-4ee4-a1c3-c7271b0f23df'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:32.057542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-57e7b222-bef3-4b45-b148-5e3269962fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed2ac06d5a67490ea37368e04f591978', 'request_id': 'req-57e7b222-bef3-4b45-b148-5e3269962fca'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:32.149842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ab7e29eb-8b31-4ee4-a1c3-c7271b0f23df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49969ab28a3944e993ae2f03db45fdb7', 'request_id': 'req-ab7e29eb-8b31-4ee4-a1c3-c7271b0f23df'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:32.159457 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ab7e29eb-8b31-4ee4-a1c3-c7271b0f23df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49969ab28a3944e993ae2f03db45fdb7', 'request_id': 'req-ab7e29eb-8b31-4ee4-a1c3-c7271b0f23df'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:32.180175 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ab7e29eb-8b31-4ee4-a1c3-c7271b0f23df admin admin] The token cache is being invalidate because project 49969ab28a3944e993ae2f03db45fdb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:57:32.180536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ab7e29eb-8b31-4ee4-a1c3-c7271b0f23df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:32.181154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-ab7e29eb-8b31-4ee4-a1c3-c7271b0f23df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:32.182807 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1324/2679] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:57:31 2022] DELETE /identity/v3/projects/49969ab28a3944e993ae2f03db45fdb7 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:32.188892 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe605624-a8d4-4f25-ba69-a9961f62208f None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:32.189170 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe605624-a8d4-4f25-ba69-a9961f62208f None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:32.189504 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe605624-a8d4-4f25-ba69-a9961f62208f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:32.218225 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-fe605624-a8d4-4f25-ba69-a9961f62208f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:32.219750 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-fe605624-a8d4-4f25-ba69-a9961f62208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:32.238416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-57e7b222-bef3-4b45-b148-5e3269962fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed2ac06d5a67490ea37368e04f591978', 'request_id': 'req-57e7b222-bef3-4b45-b148-5e3269962fca'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:32.253004 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-57e7b222-bef3-4b45-b148-5e3269962fca admin admin] The token cache is being invalidate because project ed2ac06d5a67490ea37368e04f591978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:57:32.253650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-57e7b222-bef3-4b45-b148-5e3269962fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:32.261959 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-57e7b222-bef3-4b45-b148-5e3269962fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:32.264463 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:32.268480 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1356/2680] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:57:31 2022] DELETE /identity/v3/projects/ed2ac06d5a67490ea37368e04f591978 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:32.276723 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cda32f-fc8f-4c78-bfe8-4ea4a495ea6f None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:32.277043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cda32f-fc8f-4c78-bfe8-4ea4a495ea6f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:32.277043 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cda32f-fc8f-4c78-bfe8-4ea4a495ea6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:32.326405 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1325/2681] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:32.328110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71ebbb-abe9-47a7-b358-603b3f19607b None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:32.328629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71ebbb-abe9-47a7-b358-603b3f19607b None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:32.328906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71ebbb-abe9-47a7-b358-603b3f19607b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:32.333555 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-a7cda32f-fc8f-4c78-bfe8-4ea4a495ea6f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:32.334982 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a7cda32f-fc8f-4c78-bfe8-4ea4a495ea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:32.373942 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1357/2682] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:32.374267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-ff71ebbb-abe9-47a7-b358-603b3f19607b None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:32.375873 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b6b1c-f64c-4ca9-a36e-de10798ee5b2 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:32.376334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b6b1c-f64c-4ca9-a36e-de10798ee5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:32.376869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b6b1c-f64c-4ca9-a36e-de10798ee5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:32.380297 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ff71ebbb-abe9-47a7-b358-603b3f19607b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:32.391050 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1326/2683] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:32.395990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71ebbb-abe9-47a7-b358-603b3f19607b None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:32.406577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71ebbb-abe9-47a7-b358-603b3f19607b None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:32.412969 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93021c-67d8-4129-9e9b-e5db4d7dbeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:32.415710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93021c-67d8-4129-9e9b-e5db4d7dbeba admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:32.415710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93021c-67d8-4129-9e9b-e5db4d7dbeba admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:32.415710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93021c-67d8-4129-9e9b-e5db4d7dbeba admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:32.415710 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93021c-67d8-4129-9e9b-e5db4d7dbeba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:57:32.416597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93021c-67d8-4129-9e9b-e5db4d7dbeba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:32.418320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93021c-67d8-4129-9e9b-e5db4d7dbeba admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:32.423656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-a17b6b1c-f64c-4ca9-a36e-de10798ee5b2 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:32.426447 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a17b6b1c-f64c-4ca9-a36e-de10798ee5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:32.440000 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1327/2684] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:57:32.443928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93021c-67d8-4129-9e9b-e5db4d7dbeba admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:32.453395 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1358/2685] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:32.459014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b6b1c-f64c-4ca9-a36e-de10798ee5b2 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:32.461794 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93021c-67d8-4129-9e9b-e5db4d7dbeba admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:32.470147 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f1d04-db9e-480f-a10e-799a7b76c727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:32.471940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f1d04-db9e-480f-a10e-799a7b76c727 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:32.472124 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b6b1c-f64c-4ca9-a36e-de10798ee5b2 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:32.477524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f1d04-db9e-480f-a10e-799a7b76c727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:32.477524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f1d04-db9e-480f-a10e-799a7b76c727 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:32.477524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f1d04-db9e-480f-a10e-799a7b76c727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:32.477524 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f1d04-db9e-480f-a10e-799a7b76c727 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:32.486126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2410a6-9f15-4d72-891f-b1faeaa0fba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:32.486914 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2410a6-9f15-4d72-891f-b1faeaa0fba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:32.487186 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2410a6-9f15-4d72-891f-b1faeaa0fba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:32.487454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2410a6-9f15-4d72-891f-b1faeaa0fba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:32.488145 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2410a6-9f15-4d72-891f-b1faeaa0fba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:57:32.488428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2410a6-9f15-4d72-891f-b1faeaa0fba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:32.490114 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2410a6-9f15-4d72-891f-b1faeaa0fba6 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:32.509735 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1359/2686] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:57:32.513902 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2410a6-9f15-4d72-891f-b1faeaa0fba6 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:32.528324 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2410a6-9f15-4d72-891f-b1faeaa0fba6 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:32.534211 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93d3c8-d6e5-485e-ae84-bcde2ed23aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:32.534828 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93d3c8-d6e5-485e-ae84-bcde2ed23aff admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:32.535105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93d3c8-d6e5-485e-ae84-bcde2ed23aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:32.535374 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93d3c8-d6e5-485e-ae84-bcde2ed23aff admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:32.536087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93d3c8-d6e5-485e-ae84-bcde2ed23aff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:32.538372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93d3c8-d6e5-485e-ae84-bcde2ed23aff admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:32.602981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1328/2687] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:32 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:32.609132 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f1d04-db9e-480f-a10e-799a7b76c727 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:32.682891 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1360/2688] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:32 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:32.685868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93d3c8-d6e5-485e-ae84-bcde2ed23aff admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:32.719606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f1d04-db9e-480f-a10e-799a7b76c727 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:32.754297 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:32.775628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93d3c8-d6e5-485e-ae84-bcde2ed23aff admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:32.785590 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f1cd5-e776-4811-90f1-9cb53c3730a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:32.788217 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f1cd5-e776-4811-90f1-9cb53c3730a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:32.791467 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f1cd5-e776-4811-90f1-9cb53c3730a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:32.791957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f1cd5-e776-4811-90f1-9cb53c3730a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:32.792706 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f1cd5-e776-4811-90f1-9cb53c3730a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:32.794752 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f1cd5-e776-4811-90f1-9cb53c3730a9 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:32.834009 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30578c96-3828-48ac-999c-36f10ac87455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:32.834009 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30578c96-3828-48ac-999c-36f10ac87455 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:32.834009 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30578c96-3828-48ac-999c-36f10ac87455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:32.834009 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30578c96-3828-48ac-999c-36f10ac87455 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:32.834568 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30578c96-3828-48ac-999c-36f10ac87455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:32.834568 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30578c96-3828-48ac-999c-36f10ac87455 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:32.982401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1329/2689] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:32 2022] POST /identity/v3/users => generated 293 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:32.986778 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30578c96-3828-48ac-999c-36f10ac87455 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:32.986969 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1361/2690] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:32 2022] POST /identity/v3/users => generated 291 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:32.992689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f1cd5-e776-4811-90f1-9cb53c3730a9 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:33.002559 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30578c96-3828-48ac-999c-36f10ac87455 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:33.003898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f1cd5-e776-4811-90f1-9cb53c3730a9 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:33.008632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279e1ea-f538-444c-9633-f601c78438ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:33.009077 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0caa-ff18-413b-bba3-8e62bb563f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:33.009240 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279e1ea-f538-444c-9633-f601c78438ef admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:33.009550 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279e1ea-f538-444c-9633-f601c78438ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:33.009670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0caa-ff18-413b-bba3-8e62bb563f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:33.009764 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279e1ea-f538-444c-9633-f601c78438ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:33.009950 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0caa-ff18-413b-bba3-8e62bb563f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:33.010222 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0caa-ff18-413b-bba3-8e62bb563f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:33.010413 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279e1ea-f538-444c-9633-f601c78438ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:33.010984 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0caa-ff18-413b-bba3-8e62bb563f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:33.012416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279e1ea-f538-444c-9633-f601c78438ef admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:33.017498 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0caa-ff18-413b-bba3-8e62bb563f99 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:33.029819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1362/2691] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:33.037479 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1330/2692] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:33.037694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279e1ea-f538-444c-9633-f601c78438ef admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:33.039170 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0caa-ff18-413b-bba3-8e62bb563f99 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:33.045271 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279e1ea-f538-444c-9633-f601c78438ef admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:33.050888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b7563-d890-45f3-9ada-9a253150bcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:33.051613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b7563-d890-45f3-9ada-9a253150bcc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:33.051819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b7563-d890-45f3-9ada-9a253150bcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:33.052404 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b7563-d890-45f3-9ada-9a253150bcc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:33.052983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0caa-ff18-413b-bba3-8e62bb563f99 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:33.053368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b7563-d890-45f3-9ada-9a253150bcc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:33.055109 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b7563-d890-45f3-9ada-9a253150bcc3 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:33.057792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cb769-ace2-4798-9fef-79870da3f6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:33.058411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cb769-ace2-4798-9fef-79870da3f6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:33.058696 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cb769-ace2-4798-9fef-79870da3f6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:33.058975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cb769-ace2-4798-9fef-79870da3f6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:33.059665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cb769-ace2-4798-9fef-79870da3f6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:33.061262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cb769-ace2-4798-9fef-79870da3f6b6 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:33.067975 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1363/2693] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:33.072116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b7563-d890-45f3-9ada-9a253150bcc3 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:33.075286 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1331/2694] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:33.077742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cb769-ace2-4798-9fef-79870da3f6b6 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:33.083658 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b7563-d890-45f3-9ada-9a253150bcc3 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:33.086263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:33.088950 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb2def-9682-4107-9f43-fe97345d603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:33.094026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb2def-9682-4107-9f43-fe97345d603f admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:33.094151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cb769-ace2-4798-9fef-79870da3f6b6 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:33.094293 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb2def-9682-4107-9f43-fe97345d603f admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:33.094293 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb2def-9682-4107-9f43-fe97345d603f admin admin] PATH_INFO: `/v3/projects/d9024cfb2f304c77950dc75f53325a12/users/0ee2668ca1c34b1e8708de4d0623ca09/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:33.095185 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d32025-f31c-4d8f-8547-50956199a6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:33.095907 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d32025-f31c-4d8f-8547-50956199a6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:33.096168 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d32025-f31c-4d8f-8547-50956199a6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:33.096572 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d32025-f31c-4d8f-8547-50956199a6d3 admin admin] PATH_INFO: `/v3/projects/62eb6775e4c744d3bf47b4e12f889b98/users/7b9763150f78416e9528dd07496a03a4/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:33.108957 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb2def-9682-4107-9f43-fe97345d603f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9024cfb2f304c77950dc75f53325a12, user_id=0ee2668ca1c34b1e8708de4d0623ca09, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:33.112212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb2def-9682-4107-9f43-fe97345d603f admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:33.112460 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d32025-f31c-4d8f-8547-50956199a6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62eb6775e4c744d3bf47b4e12f889b98, user_id=7b9763150f78416e9528dd07496a03a4, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:33.115634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d32025-f31c-4d8f-8547-50956199a6d3 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:33.222679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1364/2695] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:33 2022] PUT /identity/v3/projects/d9024cfb2f304c77950dc75f53325a12/users/0ee2668ca1c34b1e8708de4d0623ca09/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:33.233188 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791777fd-ab2b-45f1-910d-1dc95fb1b199 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:33.233582 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791777fd-ab2b-45f1-910d-1dc95fb1b199 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:33.233859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791777fd-ab2b-45f1-910d-1dc95fb1b199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:33.249987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1332/2696] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:33 2022] PUT /identity/v3/projects/62eb6775e4c744d3bf47b4e12f889b98/users/7b9763150f78416e9528dd07496a03a4/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:33.264074 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5b606-aecb-4251-b098-35801f3137b6 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:33.264486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5b606-aecb-4251-b098-35801f3137b6 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:33.264847 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5b606-aecb-4251-b098-35801f3137b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:33.267574 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-791777fd-ab2b-45f1-910d-1dc95fb1b199 None None] MFA Rules not processed for user `0ee2668ca1c34b1e8708de4d0623ca09`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:33.269080 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-791777fd-ab2b-45f1-910d-1dc95fb1b199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:33.299911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-69f5b606-aecb-4251-b098-35801f3137b6 None None] MFA Rules not processed for user `7b9763150f78416e9528dd07496a03a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:33.301216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-69f5b606-aecb-4251-b098-35801f3137b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:33.345620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1365/2697] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:33.350702 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791777fd-ab2b-45f1-910d-1dc95fb1b199 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:33.390501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1333/2698] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:33.397355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5b606-aecb-4251-b098-35801f3137b6 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:33.425275 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791777fd-ab2b-45f1-910d-1dc95fb1b199 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:33.431204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7d9fd-3e12-4388-b2c9-32e5141a7f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:33.431859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7d9fd-3e12-4388-b2c9-32e5141a7f8e admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:33.432133 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7d9fd-3e12-4388-b2c9-32e5141a7f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:33.432403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7d9fd-3e12-4388-b2c9-32e5141a7f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:33.433036 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7d9fd-3e12-4388-b2c9-32e5141a7f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:33.435088 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7d9fd-3e12-4388-b2c9-32e5141a7f8e admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:33.477371 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5b606-aecb-4251-b098-35801f3137b6 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:33.481917 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b09cef-f617-446f-a241-523f17b543a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:33.482525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b09cef-f617-446f-a241-523f17b543a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:33.482800 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b09cef-f617-446f-a241-523f17b543a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:33.483066 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b09cef-f617-446f-a241-523f17b543a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:33.483729 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b09cef-f617-446f-a241-523f17b543a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:33.486366 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b09cef-f617-446f-a241-523f17b543a5 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:33.559422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1366/2699] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:33 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:33.564445 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7d9fd-3e12-4388-b2c9-32e5141a7f8e admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:33.570682 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:33.615549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1334/2700] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:33 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:33.619750 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b09cef-f617-446f-a241-523f17b543a5 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:33.636206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7d9fd-3e12-4388-b2c9-32e5141a7f8e admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:33.697911 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:33.706713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b09cef-f617-446f-a241-523f17b543a5 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:33.707568 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ed463-c770-4392-b432-bdd18f3a8172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:33.709266 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ed463-c770-4392-b432-bdd18f3a8172 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:33.709734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ed463-c770-4392-b432-bdd18f3a8172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:33.710083 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ed463-c770-4392-b432-bdd18f3a8172 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:33.710940 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ed463-c770-4392-b432-bdd18f3a8172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:33.712959 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ed463-c770-4392-b432-bdd18f3a8172 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:33.718155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5d77c-a312-4999-98a4-8da9dd4da5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:33.718796 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5d77c-a312-4999-98a4-8da9dd4da5da admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:33.719194 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5d77c-a312-4999-98a4-8da9dd4da5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:33.719584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5d77c-a312-4999-98a4-8da9dd4da5da admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:33.720285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5d77c-a312-4999-98a4-8da9dd4da5da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:33.722451 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5d77c-a312-4999-98a4-8da9dd4da5da admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:33.813783 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1367/2701] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:33 2022] POST /identity/v3/users => generated 298 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:33.824697 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ed463-c770-4392-b432-bdd18f3a8172 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:33.835842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ed463-c770-4392-b432-bdd18f3a8172 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:33.840884 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71725ec0-6a93-4194-918d-0f3cacf8aecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:33.841540 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71725ec0-6a93-4194-918d-0f3cacf8aecf admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:33.841850 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71725ec0-6a93-4194-918d-0f3cacf8aecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:33.842135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71725ec0-6a93-4194-918d-0f3cacf8aecf admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:33.842741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71725ec0-6a93-4194-918d-0f3cacf8aecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:33.845935 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71725ec0-6a93-4194-918d-0f3cacf8aecf admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:33.856187 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1335/2702] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:33 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:33.863266 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1368/2703] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:33.863469 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5d77c-a312-4999-98a4-8da9dd4da5da admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:33.864938 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71725ec0-6a93-4194-918d-0f3cacf8aecf admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:33.876577 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71725ec0-6a93-4194-918d-0f3cacf8aecf admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:33.879083 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5d77c-a312-4999-98a4-8da9dd4da5da admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:33.881525 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eded57-9050-4a20-8978-5c33cf58aa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:33.882229 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eded57-9050-4a20-8978-5c33cf58aa4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:33.882510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eded57-9050-4a20-8978-5c33cf58aa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:33.882787 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eded57-9050-4a20-8978-5c33cf58aa4d admin admin] PATH_INFO: `/v3/projects/8e65ded1529f4935b4d0e28db20de1ec/users/f52f3cf449d440dbbec1bb7d5ba6d395/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:33.884772 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ffc0-aa23-4951-a24e-2ced1775e11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:33.885594 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ffc0-aa23-4951-a24e-2ced1775e11e admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:33.885947 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ffc0-aa23-4951-a24e-2ced1775e11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:33.886288 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ffc0-aa23-4951-a24e-2ced1775e11e admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:33.887013 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380ffc0-aa23-4951-a24e-2ced1775e11e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:33.888771 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380ffc0-aa23-4951-a24e-2ced1775e11e admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:33.900848 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1336/2704] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:33.903944 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eded57-9050-4a20-8978-5c33cf58aa4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e65ded1529f4935b4d0e28db20de1ec, user_id=f52f3cf449d440dbbec1bb7d5ba6d395, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:33.905419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ffc0-aa23-4951-a24e-2ced1775e11e admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:33.907611 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eded57-9050-4a20-8978-5c33cf58aa4d admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:33.918348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ffc0-aa23-4951-a24e-2ced1775e11e admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:33.924109 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663224c8-f30d-44f7-b15f-e8a446e06926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:33.924767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663224c8-f30d-44f7-b15f-e8a446e06926 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:33.925036 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663224c8-f30d-44f7-b15f-e8a446e06926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:33.925306 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663224c8-f30d-44f7-b15f-e8a446e06926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:33.925943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663224c8-f30d-44f7-b15f-e8a446e06926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:33.927573 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663224c8-f30d-44f7-b15f-e8a446e06926 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:33.940233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1337/2705] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:33.944473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663224c8-f30d-44f7-b15f-e8a446e06926 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:33.955646 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663224c8-f30d-44f7-b15f-e8a446e06926 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:33.960960 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9458176-c60f-4b2b-95c0-b05bef50d5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:33.961653 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9458176-c60f-4b2b-95c0-b05bef50d5e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:33.961934 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9458176-c60f-4b2b-95c0-b05bef50d5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:33.962209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9458176-c60f-4b2b-95c0-b05bef50d5e0 admin admin] PATH_INFO: `/v3/projects/bc983badbaa14e33bf5e88df0556a590/users/b6596c5ee97e473f91726aa6fc27ad04/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:33.980206 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9458176-c60f-4b2b-95c0-b05bef50d5e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc983badbaa14e33bf5e88df0556a590, user_id=b6596c5ee97e473f91726aa6fc27ad04, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:33.983501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9458176-c60f-4b2b-95c0-b05bef50d5e0 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:33.989580 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1369/2706] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:33 2022] PUT /identity/v3/projects/8e65ded1529f4935b4d0e28db20de1ec/users/f52f3cf449d440dbbec1bb7d5ba6d395/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:33.993687 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eded57-9050-4a20-8978-5c33cf58aa4d admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:34.059634 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eded57-9050-4a20-8978-5c33cf58aa4d admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:34.065161 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf22091-94c0-4e57-ac3e-6b5dfa9bc32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:34.065780 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf22091-94c0-4e57-ac3e-6b5dfa9bc32c admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:34.066095 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf22091-94c0-4e57-ac3e-6b5dfa9bc32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:34.066372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf22091-94c0-4e57-ac3e-6b5dfa9bc32c admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:34.067014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf22091-94c0-4e57-ac3e-6b5dfa9bc32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:34.068748 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf22091-94c0-4e57-ac3e-6b5dfa9bc32c admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:34.077644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1338/2707] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:33 2022] PUT /identity/v3/projects/bc983badbaa14e33bf5e88df0556a590/users/b6596c5ee97e473f91726aa6fc27ad04/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:34.080179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1370/2708] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:34.085279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9458176-c60f-4b2b-95c0-b05bef50d5e0 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:34.089263 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a9f1-9562-4ca7-a506-d96eb801f354 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:34.089636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a9f1-9562-4ca7-a506-d96eb801f354 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:34.089984 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a9f1-9562-4ca7-a506-d96eb801f354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:34.099731 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:34.126269 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-1710a9f1-9562-4ca7-a506-d96eb801f354 None None] MFA Rules not processed for user `b6596c5ee97e473f91726aa6fc27ad04`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:34.127858 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-1710a9f1-9562-4ca7-a506-d96eb801f354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:34.179738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9458176-c60f-4b2b-95c0-b05bef50d5e0 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:34.185530 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf7c4f-aefc-4691-8859-86b595cfcd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:34.186206 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf7c4f-aefc-4691-8859-86b595cfcd81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:34.186834 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf7c4f-aefc-4691-8859-86b595cfcd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:34.186834 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf7c4f-aefc-4691-8859-86b595cfcd81 admin admin] PATH_INFO: `/v3/projects/8e65ded1529f4935b4d0e28db20de1ec/users/f52f3cf449d440dbbec1bb7d5ba6d395/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:34.188762 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf7c4f-aefc-4691-8859-86b595cfcd81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e65ded1529f4935b4d0e28db20de1ec, user_id=f52f3cf449d440dbbec1bb7d5ba6d395, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:34.191826 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf7c4f-aefc-4691-8859-86b595cfcd81 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:34.206532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1339/2709] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:34 2022] PUT /identity/v3/projects/8e65ded1529f4935b4d0e28db20de1ec/users/f52f3cf449d440dbbec1bb7d5ba6d395/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:34.213762 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1371/2710] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:34.218456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710a9f1-9562-4ca7-a506-d96eb801f354 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:34.218930 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50869697-b28a-49e1-a601-18d389ddca14 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:34.219332 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50869697-b28a-49e1-a601-18d389ddca14 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:34.220251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50869697-b28a-49e1-a601-18d389ddca14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:34.233992 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710a9f1-9562-4ca7-a506-d96eb801f354 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:34.258370 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-50869697-b28a-49e1-a601-18d389ddca14 None None] MFA Rules not processed for user `f52f3cf449d440dbbec1bb7d5ba6d395`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:34.259671 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-50869697-b28a-49e1-a601-18d389ddca14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:34.298422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01857ba7-7734-447e-a9b8-f50b4f87102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:34.298941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01857ba7-7734-447e-a9b8-f50b4f87102b admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:34.299226 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01857ba7-7734-447e-a9b8-f50b4f87102b admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:34.299530 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01857ba7-7734-447e-a9b8-f50b4f87102b admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:34.300170 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01857ba7-7734-447e-a9b8-f50b4f87102b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:34.302243 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01857ba7-7734-447e-a9b8-f50b4f87102b admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:34.343397 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1340/2711] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:34.355250 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50869697-b28a-49e1-a601-18d389ddca14 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:34.356839 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-50869697-b28a-49e1-a601-18d389ddca14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:34.383369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:34.432956 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50869697-b28a-49e1-a601-18d389ddca14 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:34.436861 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615bdc4-45a6-4138-b224-863256a2735e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:34.437493 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615bdc4-45a6-4138-b224-863256a2735e service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:34.437776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615bdc4-45a6-4138-b224-863256a2735e service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:34.438174 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615bdc4-45a6-4138-b224-863256a2735e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:34.450976 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615bdc4-45a6-4138-b224-863256a2735e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:34.456015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1372/2712] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:34 2022] POST /identity/v3/projects => generated 383 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:34.456351 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615bdc4-45a6-4138-b224-863256a2735e service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:34.457176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01857ba7-7734-447e-a9b8-f50b4f87102b admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:34.467532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1341/2713] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:57:34.539219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01857ba7-7734-447e-a9b8-f50b4f87102b admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:34.552427 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb2a88-874c-40a9-8f53-4101f50773a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:34.553180 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb2a88-874c-40a9-8f53-4101f50773a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:34.553986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb2a88-874c-40a9-8f53-4101f50773a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:34.554260 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb2a88-874c-40a9-8f53-4101f50773a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:34.554954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb2a88-874c-40a9-8f53-4101f50773a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:34.556954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb2a88-874c-40a9-8f53-4101f50773a9 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:34.589910 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615bdc4-45a6-4138-b224-863256a2735e service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:34.599973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615bdc4-45a6-4138-b224-863256a2735e service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:34.652780 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4cf0f-67ec-4c5b-9f1f-b47d1448ac47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:34.653447 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4cf0f-67ec-4c5b-9f1f-b47d1448ac47 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:34.653557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4cf0f-67ec-4c5b-9f1f-b47d1448ac47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:34.655780 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4cf0f-67ec-4c5b-9f1f-b47d1448ac47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:34.676772 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1373/2714] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:34 2022] POST /identity/v3/users => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:34.681248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb2a88-874c-40a9-8f53-4101f50773a9 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:34.692159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb2a88-874c-40a9-8f53-4101f50773a9 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:34.697538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab66af0-0ef9-4a3a-b179-63ce9977d024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:34.698231 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66af0-0ef9-4a3a-b179-63ce9977d024 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:34.698503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66af0-0ef9-4a3a-b179-63ce9977d024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:34.698770 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66af0-0ef9-4a3a-b179-63ce9977d024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:34.699412 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab66af0-0ef9-4a3a-b179-63ce9977d024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:34.701116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab66af0-0ef9-4a3a-b179-63ce9977d024 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:34.702619 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:34.713746 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1374/2715] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:34.717861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab66af0-0ef9-4a3a-b179-63ce9977d024 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:34.728909 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab66af0-0ef9-4a3a-b179-63ce9977d024 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:34.729623 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4cf0f-67ec-4c5b-9f1f-b47d1448ac47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:34.731109 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4cf0f-67ec-4c5b-9f1f-b47d1448ac47 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:34.734005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1199ca6-25ac-4759-8787-4577d12d6f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:34.734673 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1199ca6-25ac-4759-8787-4577d12d6f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:34.735184 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1199ca6-25ac-4759-8787-4577d12d6f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:34.741189 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1199ca6-25ac-4759-8787-4577d12d6f75 admin admin] PATH_INFO: `/v3/projects/0d5860135a034b9bae3a381b580c97d9/users/c1cd86367168446390f2c45f666ada30/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:34.741842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1342/2716] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:57:34.751861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1199ca6-25ac-4759-8787-4577d12d6f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5860135a034b9bae3a381b580c97d9, user_id=c1cd86367168446390f2c45f666ada30, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:34.754480 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1199ca6-25ac-4759-8787-4577d12d6f75 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:34.881685 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1375/2717] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:34 2022] PUT /identity/v3/projects/0d5860135a034b9bae3a381b580c97d9/users/c1cd86367168446390f2c45f666ada30/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:34.886114 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4cf0f-67ec-4c5b-9f1f-b47d1448ac47 service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:34.906480 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4cf0f-67ec-4c5b-9f1f-b47d1448ac47 service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:34.978682 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b772f2-74f4-4b46-9ef0-7f4ad8df359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:34.979419 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b772f2-74f4-4b46-9ef0-7f4ad8df359f admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:34.979733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b772f2-74f4-4b46-9ef0-7f4ad8df359f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:34.980009 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b772f2-74f4-4b46-9ef0-7f4ad8df359f admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:34.980707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b772f2-74f4-4b46-9ef0-7f4ad8df359f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:34.982422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b772f2-74f4-4b46-9ef0-7f4ad8df359f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:34.995324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1343/2718] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:34.999687 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1199ca6-25ac-4759-8787-4577d12d6f75 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:35.012140 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1199ca6-25ac-4759-8787-4577d12d6f75 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:35.017986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9ce77-cbb4-46aa-ad54-5f74f207598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:35.018733 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9ce77-cbb4-46aa-ad54-5f74f207598a admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:35.019157 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9ce77-cbb4-46aa-ad54-5f74f207598a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:35.019672 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9ce77-cbb4-46aa-ad54-5f74f207598a admin admin] PATH_INFO: `/v3/projects/0d5860135a034b9bae3a381b580c97d9/users/c1cd86367168446390f2c45f666ada30/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:35.026940 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9ce77-cbb4-46aa-ad54-5f74f207598a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5860135a034b9bae3a381b580c97d9, user_id=c1cd86367168446390f2c45f666ada30, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:35.026940 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9ce77-cbb4-46aa-ad54-5f74f207598a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:35.039965 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1376/2719] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:34 2022] PUT /identity/v3/projects/0d5860135a034b9bae3a381b580c97d9/users/c1cd86367168446390f2c45f666ada30/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:35.050836 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce77fc-bb6b-4813-9297-89727814b9a6 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:35.051116 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce77fc-bb6b-4813-9297-89727814b9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:35.051396 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce77fc-bb6b-4813-9297-89727814b9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:35.074674 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:35.083099 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-20ce77fc-bb6b-4813-9297-89727814b9a6 None None] MFA Rules not processed for user `c1cd86367168446390f2c45f666ada30`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:35.084374 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-20ce77fc-bb6b-4813-9297-89727814b9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:35.157209 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1344/2720] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:35.168931 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9ce77-cbb4-46aa-ad54-5f74f207598a admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:35.170793 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-c8d9ce77-cbb4-46aa-ad54-5f74f207598a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:35.242484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9ce77-cbb4-46aa-ad54-5f74f207598a admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:35.246283 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93496e-7df1-4412-a440-f6637d3d51db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:35.246897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93496e-7df1-4412-a440-f6637d3d51db service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:35.247175 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93496e-7df1-4412-a440-f6637d3d51db service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:35.247446 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93496e-7df1-4412-a440-f6637d3d51db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:35.313785 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93496e-7df1-4412-a440-f6637d3d51db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:35.316934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93496e-7df1-4412-a440-f6637d3d51db service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:35.328209 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1377/2721] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:37.380067 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce77fc-bb6b-4813-9297-89727814b9a6 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:37.392133 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce77fc-bb6b-4813-9297-89727814b9a6 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:37.394974 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16583cd6-6723-44a9-80d9-78a656be62a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:37.395698 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16583cd6-6723-44a9-80d9-78a656be62a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:37.395971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16583cd6-6723-44a9-80d9-78a656be62a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:37.396238 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16583cd6-6723-44a9-80d9-78a656be62a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:37.475850 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16583cd6-6723-44a9-80d9-78a656be62a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:37.477525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16583cd6-6723-44a9-80d9-78a656be62a1 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:37.488304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1345/2722] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:38.204594 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93496e-7df1-4412-a440-f6637d3d51db service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:38.269110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93496e-7df1-4412-a440-f6637d3d51db service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:38.274433 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af61077-68ff-4b61-8b21-0e080699a09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:38.278786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af61077-68ff-4b61-8b21-0e080699a09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:38.278786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af61077-68ff-4b61-8b21-0e080699a09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:38.278786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af61077-68ff-4b61-8b21-0e080699a09f admin admin] PATH_INFO: `/v3/users/0ee2668ca1c34b1e8708de4d0623ca09` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:38.278786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af61077-68ff-4b61-8b21-0e080699a09f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee2668ca1c34b1e8708de4d0623ca09)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:38.278786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af61077-68ff-4b61-8b21-0e080699a09f admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:38.293355 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:38.533509 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7af61077-68ff-4b61-8b21-0e080699a09f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee2668ca1c34b1e8708de4d0623ca09'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:38.666905 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7af61077-68ff-4b61-8b21-0e080699a09f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee2668ca1c34b1e8708de4d0623ca09'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:38.681350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7af61077-68ff-4b61-8b21-0e080699a09f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee2668ca1c34b1e8708de4d0623ca09'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:38.681350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7af61077-68ff-4b61-8b21-0e080699a09f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee2668ca1c34b1e8708de4d0623ca09'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:38.681350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-7af61077-68ff-4b61-8b21-0e080699a09f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee2668ca1c34b1e8708de4d0623ca09'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:38.696707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1378/2723] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:57:38 2022] DELETE /identity/v3/users/0ee2668ca1c34b1e8708de4d0623ca09 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:38.701308 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904da2e8-87ee-454e-b22d-b505721e1311 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:38.710006 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904da2e8-87ee-454e-b22d-b505721e1311 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:38.710006 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904da2e8-87ee-454e-b22d-b505721e1311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:38.723917 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-904da2e8-87ee-454e-b22d-b505721e1311 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:38.725194 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-904da2e8-87ee-454e-b22d-b505721e1311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:38.787779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1346/2724] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:38.798554 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af61077-68ff-4b61-8b21-0e080699a09f admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:38.804625 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7af61077-68ff-4b61-8b21-0e080699a09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:38.871716 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af61077-68ff-4b61-8b21-0e080699a09f admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:38.871716 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03084bf1-9297-413a-8032-8714e209d85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:38.872048 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03084bf1-9297-413a-8032-8714e209d85c service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:38.872169 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03084bf1-9297-413a-8032-8714e209d85c service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:38.872513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03084bf1-9297-413a-8032-8714e209d85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:38.883308 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03084bf1-9297-413a-8032-8714e209d85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:38.884827 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03084bf1-9297-413a-8032-8714e209d85c service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:38.895327 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1379/2725] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:39.149194 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904da2e8-87ee-454e-b22d-b505721e1311 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:39.161784 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904da2e8-87ee-454e-b22d-b505721e1311 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:39.166017 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8ac95-b431-4c8e-bd3f-cd78007f6401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:39.166639 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8ac95-b431-4c8e-bd3f-cd78007f6401 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:39.166919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8ac95-b431-4c8e-bd3f-cd78007f6401 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:39.167331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8ac95-b431-4c8e-bd3f-cd78007f6401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:39.170323 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f6d8ac95-b431-4c8e-bd3f-cd78007f6401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:39.184078 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8ac95-b431-4c8e-bd3f-cd78007f6401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:39.185629 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8ac95-b431-4c8e-bd3f-cd78007f6401 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:39.194758 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1347/2726] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:39.396581 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03084bf1-9297-413a-8032-8714e209d85c service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:39.398338 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-03084bf1-9297-413a-8032-8714e209d85c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:39.416022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03084bf1-9297-413a-8032-8714e209d85c service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:39.423503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6b1f2-f360-47d7-9d27-6b85d687fda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:39.428897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6b1f2-f360-47d7-9d27-6b85d687fda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:39.428897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6b1f2-f360-47d7-9d27-6b85d687fda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:39.428897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6b1f2-f360-47d7-9d27-6b85d687fda1 admin admin] PATH_INFO: `/v3/projects/d9024cfb2f304c77950dc75f53325a12` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:39.428897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6b1f2-f360-47d7-9d27-6b85d687fda1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9024cfb2f304c77950dc75f53325a12)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:39.428897 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6b1f2-f360-47d7-9d27-6b85d687fda1 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:39.587039 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8ac95-b431-4c8e-bd3f-cd78007f6401 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:39.589053 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f6d8ac95-b431-4c8e-bd3f-cd78007f6401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:39.595524 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-e7f6b1f2-f360-47d7-9d27-6b85d687fda1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9024cfb2f304c77950dc75f53325a12', 'request_id': 'req-e7f6b1f2-f360-47d7-9d27-6b85d687fda1'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:39.605866 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-e7f6b1f2-f360-47d7-9d27-6b85d687fda1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9024cfb2f304c77950dc75f53325a12', 'request_id': 'req-e7f6b1f2-f360-47d7-9d27-6b85d687fda1'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:39.621860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:39.658928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8ac95-b431-4c8e-bd3f-cd78007f6401 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:39.680648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-e7f6b1f2-f360-47d7-9d27-6b85d687fda1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9024cfb2f304c77950dc75f53325a12', 'request_id': 'req-e7f6b1f2-f360-47d7-9d27-6b85d687fda1'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:39.703316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-e7f6b1f2-f360-47d7-9d27-6b85d687fda1 admin admin] The token cache is being invalidate because project d9024cfb2f304c77950dc75f53325a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:57:39.703875 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-e7f6b1f2-f360-47d7-9d27-6b85d687fda1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:39.705284 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-e7f6b1f2-f360-47d7-9d27-6b85d687fda1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:39.709699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1380/2727] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:57:39 2022] DELETE /identity/v3/projects/d9024cfb2f304c77950dc75f53325a12 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:39.709699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61748ed3-d175-42a0-bf32-34a73a46a769 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:39.709699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61748ed3-d175-42a0-bf32-34a73a46a769 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:39.710141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61748ed3-d175-42a0-bf32-34a73a46a769 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:39.711745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1381/2728] 10.222.0.25 () {54 vars in 921 bytes} [Wed Sep 7 16:57:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:57:39.712540 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61748ed3-d175-42a0-bf32-34a73a46a769 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:39.714523 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-61748ed3-d175-42a0-bf32-34a73a46a769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:39.739126 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d580c3-a272-4cd2-b8a5-d03ad188c0d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:39.739842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d580c3-a272-4cd2-b8a5-d03ad188c0d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:39.740124 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d580c3-a272-4cd2-b8a5-d03ad188c0d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:39.740336 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d580c3-a272-4cd2-b8a5-d03ad188c0d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:39.742395 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-92d580c3-a272-4cd2-b8a5-d03ad188c0d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:39.742867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:39.797201 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61748ed3-d175-42a0-bf32-34a73a46a769 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:39.802258 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82629597-bc78-41a2-a0a1-0a9b5cd4e97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:39.803030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82629597-bc78-41a2-a0a1-0a9b5cd4e97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:39.803385 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82629597-bc78-41a2-a0a1-0a9b5cd4e97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:39.803750 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82629597-bc78-41a2-a0a1-0a9b5cd4e97a admin admin] PATH_INFO: `/v3/users/f52f3cf449d440dbbec1bb7d5ba6d395` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:39.805002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82629597-bc78-41a2-a0a1-0a9b5cd4e97a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f52f3cf449d440dbbec1bb7d5ba6d395)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:39.807747 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82629597-bc78-41a2-a0a1-0a9b5cd4e97a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:39.829783 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d580c3-a272-4cd2-b8a5-d03ad188c0d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:39.831487 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d580c3-a272-4cd2-b8a5-d03ad188c0d8 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:39.851232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1348/2729] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:57:39.853140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037043fa-e7b5-496a-b490-4f6de40bd205 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:39.853431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037043fa-e7b5-496a-b490-4f6de40bd205 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:39.853708 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037043fa-e7b5-496a-b490-4f6de40bd205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:39.877471 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-037043fa-e7b5-496a-b490-4f6de40bd205 None None] MFA Rules not processed for user `cf48978c20f04173b114e15e1ce2157c`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:39.880131 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-037043fa-e7b5-496a-b490-4f6de40bd205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:39.971429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1349/2730] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Sep 7 16:57:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:39.987219 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037043fa-e7b5-496a-b490-4f6de40bd205 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:39.988725 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-037043fa-e7b5-496a-b490-4f6de40bd205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:40.012742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:40.050958 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037043fa-e7b5-496a-b490-4f6de40bd205 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:40.055358 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c75cb7-04f0-409d-9008-3c1d24a365f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52705fc64cd54b1985ef2cb02f6c47fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:40.056129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c75cb7-04f0-409d-9008-3c1d24a365f7 service glance] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:40.056411 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c75cb7-04f0-409d-9008-3c1d24a365f7 service glance] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:40.056687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c75cb7-04f0-409d-9008-3c1d24a365f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:40.068836 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-82629597-bc78-41a2-a0a1-0a9b5cd4e97a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f52f3cf449d440dbbec1bb7d5ba6d395'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:40.069607 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c75cb7-04f0-409d-9008-3c1d24a365f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:40.071079 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c75cb7-04f0-409d-9008-3c1d24a365f7 service glance] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:40.084775 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1350/2731] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:57:40.176520 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-82629597-bc78-41a2-a0a1-0a9b5cd4e97a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f52f3cf449d440dbbec1bb7d5ba6d395'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:40.177146 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-82629597-bc78-41a2-a0a1-0a9b5cd4e97a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f52f3cf449d440dbbec1bb7d5ba6d395'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:40.177767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-82629597-bc78-41a2-a0a1-0a9b5cd4e97a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f52f3cf449d440dbbec1bb7d5ba6d395'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:40.186874 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-82629597-bc78-41a2-a0a1-0a9b5cd4e97a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f52f3cf449d440dbbec1bb7d5ba6d395'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:40.210406 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1382/2732] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:57:39 2022] DELETE /identity/v3/users/f52f3cf449d440dbbec1bb7d5ba6d395 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:40.441793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36887d0-719c-46c0-a2b8-5df8fc39fd46 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:40.442079 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36887d0-719c-46c0-a2b8-5df8fc39fd46 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:40.442352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36887d0-719c-46c0-a2b8-5df8fc39fd46 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:40.443832 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1351/2733] 10.222.0.25 () {54 vars in 921 bytes} [Wed Sep 7 16:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:57:40.449695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf89d6e-057c-45cd-8d22-e2fe7f92cf47 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:40.449695 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf89d6e-057c-45cd-8d22-e2fe7f92cf47 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:40.450323 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf89d6e-057c-45cd-8d22-e2fe7f92cf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:40.472107 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8bf89d6e-057c-45cd-8d22-e2fe7f92cf47 None None] MFA Rules not processed for user `bac099b78bd04e02b8614c8afce53ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:40.473562 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8bf89d6e-057c-45cd-8d22-e2fe7f92cf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:40.545958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1383/2734] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Sep 7 16:57:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:40.560692 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36887d0-719c-46c0-a2b8-5df8fc39fd46 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:40.564430 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-f36887d0-719c-46c0-a2b8-5df8fc39fd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:40.582963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36887d0-719c-46c0-a2b8-5df8fc39fd46 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:40.587400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e8aa3-ab89-4160-b7b0-dd05c3432bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:40.588068 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e8aa3-ab89-4160-b7b0-dd05c3432bff service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:40.594741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e8aa3-ab89-4160-b7b0-dd05c3432bff service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:40.594741 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e8aa3-ab89-4160-b7b0-dd05c3432bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:40.598495 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e8aa3-ab89-4160-b7b0-dd05c3432bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:40.600000 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e8aa3-ab89-4160-b7b0-dd05c3432bff service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:40.610767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1352/2735] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:40.708493 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebfc1f-1386-4e04-b8b2-2a312a92409b None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:40.708802 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebfc1f-1386-4e04-b8b2-2a312a92409b None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:40.709079 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebfc1f-1386-4e04-b8b2-2a312a92409b None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:40.710503 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1384/2736] 10.222.0.25 () {54 vars in 921 bytes} [Wed Sep 7 16:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:57:40.717028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd89531-f070-42ed-9d95-88e7a732b2e8 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:40.717314 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd89531-f070-42ed-9d95-88e7a732b2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:40.717589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd89531-f070-42ed-9d95-88e7a732b2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:40.739817 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-7cd89531-f070-42ed-9d95-88e7a732b2e8 None None] MFA Rules not processed for user `cf48978c20f04173b114e15e1ce2157c`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:40.741120 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-7cd89531-f070-42ed-9d95-88e7a732b2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:40.774954 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebfc1f-1386-4e04-b8b2-2a312a92409b None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:40.782961 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-09ebfc1f-1386-4e04-b8b2-2a312a92409b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:40.833688 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1353/2737] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Sep 7 16:57:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:40.848584 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd89531-f070-42ed-9d95-88e7a732b2e8 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:40.859370 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd89531-f070-42ed-9d95-88e7a732b2e8 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:40.865348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a930c3-03fb-44ba-b32e-13712382d9ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:40.866132 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a930c3-03fb-44ba-b32e-13712382d9ca service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:40.868972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a930c3-03fb-44ba-b32e-13712382d9ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:40.868972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a930c3-03fb-44ba-b32e-13712382d9ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:40.880768 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a930c3-03fb-44ba-b32e-13712382d9ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:40.881220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:40.882173 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a930c3-03fb-44ba-b32e-13712382d9ca service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:40.899179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1354/2738] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:57:40.905277 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebfc1f-1386-4e04-b8b2-2a312a92409b None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:40.911866 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bc7d4-c2eb-4fe2-b282-106bc69f7a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:40.912531 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bc7d4-c2eb-4fe2-b282-106bc69f7a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:40.912808 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bc7d4-c2eb-4fe2-b282-106bc69f7a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:40.913086 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bc7d4-c2eb-4fe2-b282-106bc69f7a93 admin admin] PATH_INFO: `/v3/projects/8e65ded1529f4935b4d0e28db20de1ec` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:40.914558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bc7d4-c2eb-4fe2-b282-106bc69f7a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e65ded1529f4935b4d0e28db20de1ec)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:40.916568 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bc7d4-c2eb-4fe2-b282-106bc69f7a93 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:41.100150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ed5bc7d4-c2eb-4fe2-b282-106bc69f7a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e65ded1529f4935b4d0e28db20de1ec', 'request_id': 'req-ed5bc7d4-c2eb-4fe2-b282-106bc69f7a93'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:41.116326 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ed5bc7d4-c2eb-4fe2-b282-106bc69f7a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e65ded1529f4935b4d0e28db20de1ec', 'request_id': 'req-ed5bc7d4-c2eb-4fe2-b282-106bc69f7a93'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:41.290597 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ed5bc7d4-c2eb-4fe2-b282-106bc69f7a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e65ded1529f4935b4d0e28db20de1ec', 'request_id': 'req-ed5bc7d4-c2eb-4fe2-b282-106bc69f7a93'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:41.303416 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ed5bc7d4-c2eb-4fe2-b282-106bc69f7a93 admin admin] The token cache is being invalidate because project 8e65ded1529f4935b4d0e28db20de1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:57:41.307591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ed5bc7d4-c2eb-4fe2-b282-106bc69f7a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:41.307591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-ed5bc7d4-c2eb-4fe2-b282-106bc69f7a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:41.307591 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1385/2739] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:57:40 2022] DELETE /identity/v3/projects/8e65ded1529f4935b4d0e28db20de1ec => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:41.316731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25f4de-6086-41eb-83b9-d095a3b35c48 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:41.318490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25f4de-6086-41eb-83b9-d095a3b35c48 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:41.318778 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25f4de-6086-41eb-83b9-d095a3b35c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:41.361421 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-6e25f4de-6086-41eb-83b9-d095a3b35c48 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:41.363644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-6e25f4de-6086-41eb-83b9-d095a3b35c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:41.452603 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1355/2740] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:41.461211 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852850b-ffe9-4873-a2dc-ce38e67ce68f None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:41.461774 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852850b-ffe9-4873-a2dc-ce38e67ce68f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:41.461774 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852850b-ffe9-4873-a2dc-ce38e67ce68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:41.486003 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-b852850b-ffe9-4873-a2dc-ce38e67ce68f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:41.487278 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b852850b-ffe9-4873-a2dc-ce38e67ce68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:41.495815 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1386/2741] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:41.500247 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25f4de-6086-41eb-83b9-d095a3b35c48 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:41.510494 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25f4de-6086-41eb-83b9-d095a3b35c48 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:41.515129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1791e-4326-41c7-a46b-a3c454991ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:41.515851 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1791e-4326-41c7-a46b-a3c454991ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:41.518134 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1791e-4326-41c7-a46b-a3c454991ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:41.518134 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1791e-4326-41c7-a46b-a3c454991ae8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:41.518134 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1791e-4326-41c7-a46b-a3c454991ae8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:57:41.518134 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1791e-4326-41c7-a46b-a3c454991ae8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:41.521447 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1791e-4326-41c7-a46b-a3c454991ae8 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:41.548394 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1356/2742] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:57:41.549702 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852850b-ffe9-4873-a2dc-ce38e67ce68f None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:41.560180 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852850b-ffe9-4873-a2dc-ce38e67ce68f None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:41.572480 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4393edd-6bc0-4483-a3ab-d067618d4870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:41.573115 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4393edd-6bc0-4483-a3ab-d067618d4870 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:41.573456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4393edd-6bc0-4483-a3ab-d067618d4870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:41.573729 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4393edd-6bc0-4483-a3ab-d067618d4870 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:41.574375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4393edd-6bc0-4483-a3ab-d067618d4870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:41.576473 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4393edd-6bc0-4483-a3ab-d067618d4870 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:41.713617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1387/2743] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:41 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:41.718167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1791e-4326-41c7-a46b-a3c454991ae8 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:41.731522 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1791e-4326-41c7-a46b-a3c454991ae8 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:41.749028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=100 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:41.805386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a13c58-c1f9-4f5b-a35c-2b38804d97d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:41.805902 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a13c58-c1f9-4f5b-a35c-2b38804d97d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:41.806176 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a13c58-c1f9-4f5b-a35c-2b38804d97d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:41.806444 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a13c58-c1f9-4f5b-a35c-2b38804d97d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:41.807071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a13c58-c1f9-4f5b-a35c-2b38804d97d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:41.809097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a13c58-c1f9-4f5b-a35c-2b38804d97d1 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:41.916063 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1357/2744] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:41 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:41.920307 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4393edd-6bc0-4483-a3ab-d067618d4870 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:41.931971 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4393edd-6bc0-4483-a3ab-d067618d4870 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:41.937184 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08a791-f954-41a5-b70a-96abb06b7223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:41.937893 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08a791-f954-41a5-b70a-96abb06b7223 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:41.938225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08a791-f954-41a5-b70a-96abb06b7223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:41.938556 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08a791-f954-41a5-b70a-96abb06b7223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:41.939366 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08a791-f954-41a5-b70a-96abb06b7223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:41.941093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08a791-f954-41a5-b70a-96abb06b7223 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:41.952671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1388/2745] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:41.957640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a13c58-c1f9-4f5b-a35c-2b38804d97d1 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:41.968510 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a13c58-c1f9-4f5b-a35c-2b38804d97d1 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:41.976457 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c0340-884a-4999-93c6-e2340c5cb5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:41.978873 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c0340-884a-4999-93c6-e2340c5cb5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:41.979162 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c0340-884a-4999-93c6-e2340c5cb5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:41.979439 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c0340-884a-4999-93c6-e2340c5cb5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:41.980141 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c0340-884a-4999-93c6-e2340c5cb5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:41.981775 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c0340-884a-4999-93c6-e2340c5cb5c0 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:41.993679 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1358/2746] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:41.997948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08a791-f954-41a5-b70a-96abb06b7223 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:42.009461 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08a791-f954-41a5-b70a-96abb06b7223 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:42.015550 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54436aa9-88fd-4f7e-9c29-a2f67a1bf52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:42.016920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54436aa9-88fd-4f7e-9c29-a2f67a1bf52b admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:42.017276 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54436aa9-88fd-4f7e-9c29-a2f67a1bf52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:42.017745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54436aa9-88fd-4f7e-9c29-a2f67a1bf52b admin admin] PATH_INFO: `/v3/projects/a635a1ea4c6b451f8f27d00a3887d42e/users/2de6db91c9c2408c8409600e2f241692/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:42.036875 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54436aa9-88fd-4f7e-9c29-a2f67a1bf52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a635a1ea4c6b451f8f27d00a3887d42e, user_id=2de6db91c9c2408c8409600e2f241692, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:42.039948 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54436aa9-88fd-4f7e-9c29-a2f67a1bf52b admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:42.195992 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1389/2747] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:41 2022] PUT /identity/v3/projects/a635a1ea4c6b451f8f27d00a3887d42e/users/2de6db91c9c2408c8409600e2f241692/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:42.211018 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b25c2-a11f-43ce-83b3-f6e9d420c256 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:42.211018 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b25c2-a11f-43ce-83b3-f6e9d420c256 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:42.211018 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b25c2-a11f-43ce-83b3-f6e9d420c256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:42.241920 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-822b25c2-a11f-43ce-83b3-f6e9d420c256 None None] MFA Rules not processed for user `2de6db91c9c2408c8409600e2f241692`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:42.243177 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-822b25c2-a11f-43ce-83b3-f6e9d420c256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:42.315545 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1359/2748] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:42.326722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54436aa9-88fd-4f7e-9c29-a2f67a1bf52b admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:42.329144 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-54436aa9-88fd-4f7e-9c29-a2f67a1bf52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:42.397955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54436aa9-88fd-4f7e-9c29-a2f67a1bf52b admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:42.402420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5cd57-8206-46dd-af8c-7a6c0a8eb120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:42.402763 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5cd57-8206-46dd-af8c-7a6c0a8eb120 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:42.403053 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5cd57-8206-46dd-af8c-7a6c0a8eb120 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:42.403346 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5cd57-8206-46dd-af8c-7a6c0a8eb120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:42.414785 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5cd57-8206-46dd-af8c-7a6c0a8eb120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:42.422767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5cd57-8206-46dd-af8c-7a6c0a8eb120 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:42.427299 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1390/2749] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:45.252532 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b25c2-a11f-43ce-83b3-f6e9d420c256 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:45.253977 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-822b25c2-a11f-43ce-83b3-f6e9d420c256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:45.340823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b25c2-a11f-43ce-83b3-f6e9d420c256 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:45.345922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d089548-d5b4-4e3e-b347-30a848cfcd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:45.346554 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d089548-d5b4-4e3e-b347-30a848cfcd76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:45.346830 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d089548-d5b4-4e3e-b347-30a848cfcd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:45.347106 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d089548-d5b4-4e3e-b347-30a848cfcd76 admin admin] PATH_INFO: `/v3/users/7b9763150f78416e9528dd07496a03a4` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:45.348379 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d089548-d5b4-4e3e-b347-30a848cfcd76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b9763150f78416e9528dd07496a03a4)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:45.350340 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d089548-d5b4-4e3e-b347-30a848cfcd76 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:45.435854 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:45.440741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b21c9b-4876-449d-81a8-28cf60bf77c6 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:45.441253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b21c9b-4876-449d-81a8-28cf60bf77c6 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:45.441354 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b21c9b-4876-449d-81a8-28cf60bf77c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:45.460816 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-e5b21c9b-4876-449d-81a8-28cf60bf77c6 None None] MFA Rules not processed for user `87ba67fc171b4258b6fda72094ed11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:45.462016 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e5b21c9b-4876-449d-81a8-28cf60bf77c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:45.471586 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:45.508716 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8d089548-d5b4-4e3e-b347-30a848cfcd76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b9763150f78416e9528dd07496a03a4'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:45.509715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8d089548-d5b4-4e3e-b347-30a848cfcd76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b9763150f78416e9528dd07496a03a4'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:45.517385 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8d089548-d5b4-4e3e-b347-30a848cfcd76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b9763150f78416e9528dd07496a03a4'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:45.520210 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1391/2750] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Sep 7 16:57:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:45.533433 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b21c9b-4876-449d-81a8-28cf60bf77c6 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:45.535150 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e5b21c9b-4876-449d-81a8-28cf60bf77c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:45.539154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8d089548-d5b4-4e3e-b347-30a848cfcd76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b9763150f78416e9528dd07496a03a4'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:45.539853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8d089548-d5b4-4e3e-b347-30a848cfcd76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b9763150f78416e9528dd07496a03a4'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:45.617683 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b21c9b-4876-449d-81a8-28cf60bf77c6 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:45.623530 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef916cb-e04b-4d05-a1f8-b918a50b008e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56cd868e866d436aa1d601f7791e812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:45.624148 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef916cb-e04b-4d05-a1f8-b918a50b008e service swift] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:45.624434 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef916cb-e04b-4d05-a1f8-b918a50b008e service swift] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:45.624712 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef916cb-e04b-4d05-a1f8-b918a50b008e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:45.630087 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1360/2751] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:57:45 2022] DELETE /identity/v3/users/7b9763150f78416e9528dd07496a03a4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:45.634505 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ea781-7142-4381-af4d-0c8b1bdbe4ab None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:45.634792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ea781-7142-4381-af4d-0c8b1bdbe4ab None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:45.635013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef916cb-e04b-4d05-a1f8-b918a50b008e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:45.635130 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ea781-7142-4381-af4d-0c8b1bdbe4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:45.636727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef916cb-e04b-4d05-a1f8-b918a50b008e service swift] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:45.646390 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1392/2752] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Sep 7 16:57:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 16:57:45.662813 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-578ea781-7142-4381-af4d-0c8b1bdbe4ab None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:45.664446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-578ea781-7142-4381-af4d-0c8b1bdbe4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:45.735638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1361/2753] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:45.742364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef916cb-e04b-4d05-a1f8-b918a50b008e service swift] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:45.744135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7ef916cb-e04b-4d05-a1f8-b918a50b008e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:45.809549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef916cb-e04b-4d05-a1f8-b918a50b008e service swift] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:45.872614 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9293e-b08e-4f8b-94cd-c92e7e53f0eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:45.873479 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9293e-b08e-4f8b-94cd-c92e7e53f0eb service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:45.873820 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9293e-b08e-4f8b-94cd-c92e7e53f0eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:45.874291 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9293e-b08e-4f8b-94cd-c92e7e53f0eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:45.889523 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9293e-b08e-4f8b-94cd-c92e7e53f0eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:45.894959 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9293e-b08e-4f8b-94cd-c92e7e53f0eb service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:45.911331 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1393/2754] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:46.398993 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ea781-7142-4381-af4d-0c8b1bdbe4ab None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:46.400563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-578ea781-7142-4381-af4d-0c8b1bdbe4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:46.415900 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ea781-7142-4381-af4d-0c8b1bdbe4ab None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:46.420695 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29a86c-c612-4047-83b1-29a346871ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:46.421343 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29a86c-c612-4047-83b1-29a346871ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:46.421626 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29a86c-c612-4047-83b1-29a346871ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:46.422486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29a86c-c612-4047-83b1-29a346871ccf admin admin] PATH_INFO: `/v3/projects/62eb6775e4c744d3bf47b4e12f889b98` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:46.424043 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29a86c-c612-4047-83b1-29a346871ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=62eb6775e4c744d3bf47b4e12f889b98)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:46.425980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29a86c-c612-4047-83b1-29a346871ccf admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:46.592894 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-6f29a86c-c612-4047-83b1-29a346871ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62eb6775e4c744d3bf47b4e12f889b98', 'request_id': 'req-6f29a86c-c612-4047-83b1-29a346871ccf'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:46.709119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-6f29a86c-c612-4047-83b1-29a346871ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62eb6775e4c744d3bf47b4e12f889b98', 'request_id': 'req-6f29a86c-c612-4047-83b1-29a346871ccf'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:46.716824 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-6f29a86c-c612-4047-83b1-29a346871ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62eb6775e4c744d3bf47b4e12f889b98', 'request_id': 'req-6f29a86c-c612-4047-83b1-29a346871ccf'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:46.730253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-6f29a86c-c612-4047-83b1-29a346871ccf admin admin] The token cache is being invalidate because project 62eb6775e4c744d3bf47b4e12f889b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:57:46.730542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-6f29a86c-c612-4047-83b1-29a346871ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:46.731309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-6f29a86c-c612-4047-83b1-29a346871ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:46.733508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1362/2755] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:57:46 2022] DELETE /identity/v3/projects/62eb6775e4c744d3bf47b4e12f889b98 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:46.738178 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9293e-b08e-4f8b-94cd-c92e7e53f0eb service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:46.752563 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9293e-b08e-4f8b-94cd-c92e7e53f0eb service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:46.762298 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=100 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:46.821015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa8762-bed5-4e2e-a929-7d7827ce36fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:46.821654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa8762-bed5-4e2e-a929-7d7827ce36fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:46.821951 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa8762-bed5-4e2e-a929-7d7827ce36fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:46.822272 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa8762-bed5-4e2e-a929-7d7827ce36fc admin admin] PATH_INFO: `/v3/users/b6596c5ee97e473f91726aa6fc27ad04` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:46.823342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa8762-bed5-4e2e-a929-7d7827ce36fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6596c5ee97e473f91726aa6fc27ad04)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:46.825305 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa8762-bed5-4e2e-a929-7d7827ce36fc admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:47.012727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4daa8762-bed5-4e2e-a929-7d7827ce36fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6596c5ee97e473f91726aa6fc27ad04'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:47.077766 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29a86c-c612-4047-83b1-29a346871ccf admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:47.080265 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-6f29a86c-c612-4047-83b1-29a346871ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:47.092587 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4daa8762-bed5-4e2e-a929-7d7827ce36fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6596c5ee97e473f91726aa6fc27ad04'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:47.093480 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4daa8762-bed5-4e2e-a929-7d7827ce36fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6596c5ee97e473f91726aa6fc27ad04'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:47.096190 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4daa8762-bed5-4e2e-a929-7d7827ce36fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6596c5ee97e473f91726aa6fc27ad04'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:47.096310 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29a86c-c612-4047-83b1-29a346871ccf admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:47.103105 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324717b8-34c4-4f52-83ba-260b98431dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:47.109814 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4daa8762-bed5-4e2e-a929-7d7827ce36fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6596c5ee97e473f91726aa6fc27ad04'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:47.113490 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324717b8-34c4-4f52-83ba-260b98431dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:47.114416 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324717b8-34c4-4f52-83ba-260b98431dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:47.114936 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324717b8-34c4-4f52-83ba-260b98431dc3 admin admin] PATH_INFO: `/v3/users/2de6db91c9c2408c8409600e2f241692` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:47.116745 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324717b8-34c4-4f52-83ba-260b98431dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de6db91c9c2408c8409600e2f241692)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:47.120241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324717b8-34c4-4f52-83ba-260b98431dc3 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:47.143523 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1394/2756] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:57:46 2022] DELETE /identity/v3/users/b6596c5ee97e473f91726aa6fc27ad04 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:47.170486 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:47.365611 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-324717b8-34c4-4f52-83ba-260b98431dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de6db91c9c2408c8409600e2f241692'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:47.369270 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-324717b8-34c4-4f52-83ba-260b98431dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de6db91c9c2408c8409600e2f241692'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:47.375422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-324717b8-34c4-4f52-83ba-260b98431dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de6db91c9c2408c8409600e2f241692'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:47.411641 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-324717b8-34c4-4f52-83ba-260b98431dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de6db91c9c2408c8409600e2f241692'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:47.413616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-324717b8-34c4-4f52-83ba-260b98431dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de6db91c9c2408c8409600e2f241692'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:47.485621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1363/2757] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:57:47 2022] DELETE /identity/v3/users/2de6db91c9c2408c8409600e2f241692 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:47.490090 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17c02c-6573-4fc4-97c9-662dc8b03237 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:47.490376 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17c02c-6573-4fc4-97c9-662dc8b03237 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:47.490654 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17c02c-6573-4fc4-97c9-662dc8b03237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:47.536827 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8b17c02c-6573-4fc4-97c9-662dc8b03237 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:47.538034 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8b17c02c-6573-4fc4-97c9-662dc8b03237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:47.630612 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1395/2758] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:47.641685 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324717b8-34c4-4f52-83ba-260b98431dc3 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:47.643457 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-324717b8-34c4-4f52-83ba-260b98431dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:47.714460 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324717b8-34c4-4f52-83ba-260b98431dc3 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:47.718318 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f410a77-52ba-4b3c-8dd8-db5f1bebecf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:47.719455 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f410a77-52ba-4b3c-8dd8-db5f1bebecf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:47.727194 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f410a77-52ba-4b3c-8dd8-db5f1bebecf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:47.727194 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f410a77-52ba-4b3c-8dd8-db5f1bebecf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:47.729080 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17c02c-6573-4fc4-97c9-662dc8b03237 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:47.730768 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8b17c02c-6573-4fc4-97c9-662dc8b03237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:47.737754 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f410a77-52ba-4b3c-8dd8-db5f1bebecf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:47.739401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f410a77-52ba-4b3c-8dd8-db5f1bebecf6 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:47.751159 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17c02c-6573-4fc4-97c9-662dc8b03237 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:47.758632 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1364/2759] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:47.758784 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:47.758784 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:47.758784 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:47.758784 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53 admin admin] PATH_INFO: `/v3/projects/bc983badbaa14e33bf5e88df0556a590` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:47.759268 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc983badbaa14e33bf5e88df0556a590)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:47.761361 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:47.792117 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:47.916921 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc983badbaa14e33bf5e88df0556a590', 'request_id': 'req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:47.924227 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc983badbaa14e33bf5e88df0556a590', 'request_id': 'req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:48.032785 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc983badbaa14e33bf5e88df0556a590', 'request_id': 'req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:48.049316 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53 admin admin] The token cache is being invalidate because project bc983badbaa14e33bf5e88df0556a590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:57:48.054553 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:48.054553 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:48.054553 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1396/2760] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:57:47 2022] DELETE /identity/v3/projects/bc983badbaa14e33bf5e88df0556a590 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:48.056485 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f410a77-52ba-4b3c-8dd8-db5f1bebecf6 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:48.072223 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f410a77-52ba-4b3c-8dd8-db5f1bebecf6 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:48.168747 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b210d-a18e-4487-b17a-3e562f01ee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:48.169602 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b210d-a18e-4487-b17a-3e562f01ee42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:48.170042 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b210d-a18e-4487-b17a-3e562f01ee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:48.170647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b210d-a18e-4487-b17a-3e562f01ee42 admin admin] PATH_INFO: `/v3/users/c1cd86367168446390f2c45f666ada30` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:48.173441 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b210d-a18e-4487-b17a-3e562f01ee42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1cd86367168446390f2c45f666ada30)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:48.176201 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b210d-a18e-4487-b17a-3e562f01ee42 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:48.380974 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:48.382759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:48.411510 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4f0f2-6d08-480d-b7b8-7d8b700ffe53 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:48.421370 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa5199-5202-4e19-b6e9-3049712589f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:48.422618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5199-5202-4e19-b6e9-3049712589f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:48.422887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5199-5202-4e19-b6e9-3049712589f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:48.423161 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5199-5202-4e19-b6e9-3049712589f5 admin admin] PATH_INFO: `/v3/projects/a635a1ea4c6b451f8f27d00a3887d42e` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:48.424398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa5199-5202-4e19-b6e9-3049712589f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a635a1ea4c6b451f8f27d00a3887d42e)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:48.426443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa5199-5202-4e19-b6e9-3049712589f5 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:48.458867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:48.462230 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cd2b210d-a18e-4487-b17a-3e562f01ee42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1cd86367168446390f2c45f666ada30'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:48.462917 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cd2b210d-a18e-4487-b17a-3e562f01ee42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1cd86367168446390f2c45f666ada30'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:48.486583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cd2b210d-a18e-4487-b17a-3e562f01ee42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1cd86367168446390f2c45f666ada30'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:48.502548 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cd2b210d-a18e-4487-b17a-3e562f01ee42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1cd86367168446390f2c45f666ada30'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:48.503284 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cd2b210d-a18e-4487-b17a-3e562f01ee42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1cd86367168446390f2c45f666ada30'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:48.604671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-a9fa5199-5202-4e19-b6e9-3049712589f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a635a1ea4c6b451f8f27d00a3887d42e', 'request_id': 'req-a9fa5199-5202-4e19-b6e9-3049712589f5'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:48.612205 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-a9fa5199-5202-4e19-b6e9-3049712589f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a635a1ea4c6b451f8f27d00a3887d42e', 'request_id': 'req-a9fa5199-5202-4e19-b6e9-3049712589f5'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:48.618245 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1365/2761] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:57:48 2022] DELETE /identity/v3/users/c1cd86367168446390f2c45f666ada30 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:48.744037 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-a9fa5199-5202-4e19-b6e9-3049712589f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a635a1ea4c6b451f8f27d00a3887d42e', 'request_id': 'req-a9fa5199-5202-4e19-b6e9-3049712589f5'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:48.763906 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-a9fa5199-5202-4e19-b6e9-3049712589f5 admin admin] The token cache is being invalidate because project a635a1ea4c6b451f8f27d00a3887d42e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:57:48.764576 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-a9fa5199-5202-4e19-b6e9-3049712589f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:48.766012 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-a9fa5199-5202-4e19-b6e9-3049712589f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:48.768093 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1397/2762] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:57:48 2022] DELETE /identity/v3/projects/a635a1ea4c6b451f8f27d00a3887d42e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:48.774251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc1723-0477-4fa6-aebd-00ba5ead613d None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:48.774604 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc1723-0477-4fa6-aebd-00ba5ead613d None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:48.774969 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc1723-0477-4fa6-aebd-00ba5ead613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:48.800361 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-7bcc1723-0477-4fa6-aebd-00ba5ead613d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:48.801756 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-7bcc1723-0477-4fa6-aebd-00ba5ead613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:48.902337 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1366/2763] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:48.982212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b1b28-866c-4d35-8164-c019ac91ec6f None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:48.982570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b1b28-866c-4d35-8164-c019ac91ec6f None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:48.982768 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b1b28-866c-4d35-8164-c019ac91ec6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:49.004284 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-463b1b28-866c-4d35-8164-c019ac91ec6f None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:49.005526 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-463b1b28-866c-4d35-8164-c019ac91ec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:49.014377 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1398/2764] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:49.020331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc1723-0477-4fa6-aebd-00ba5ead613d None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:49.039095 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc1723-0477-4fa6-aebd-00ba5ead613d None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:49.044565 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7991db2-91a7-4ed7-9db5-3f7d111c5cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:49.045189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7991db2-91a7-4ed7-9db5-3f7d111c5cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:49.045501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7991db2-91a7-4ed7-9db5-3f7d111c5cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:49.045768 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7991db2-91a7-4ed7-9db5-3f7d111c5cb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:49.046421 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7991db2-91a7-4ed7-9db5-3f7d111c5cb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:57:49.046856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7991db2-91a7-4ed7-9db5-3f7d111c5cb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:49.049269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7991db2-91a7-4ed7-9db5-3f7d111c5cb8 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:49.066984 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1367/2765] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:57:49.071574 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b1b28-866c-4d35-8164-c019ac91ec6f None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:49.082125 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b1b28-866c-4d35-8164-c019ac91ec6f None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:49.087157 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1879bb3-9c5d-4179-a2da-35c68e616205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:49.087958 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1879bb3-9c5d-4179-a2da-35c68e616205 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:49.088334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1879bb3-9c5d-4179-a2da-35c68e616205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:49.088706 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1879bb3-9c5d-4179-a2da-35c68e616205 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:49.089459 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1879bb3-9c5d-4179-a2da-35c68e616205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:49.091574 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1879bb3-9c5d-4179-a2da-35c68e616205 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:49.194285 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7991db2-91a7-4ed7-9db5-3f7d111c5cb8 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:49.196032 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b7991db2-91a7-4ed7-9db5-3f7d111c5cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:49.210643 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7991db2-91a7-4ed7-9db5-3f7d111c5cb8 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:49.215809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed41a7-a93a-4521-856a-11bfa4ced422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:49.216658 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed41a7-a93a-4521-856a-11bfa4ced422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:49.216921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed41a7-a93a-4521-856a-11bfa4ced422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:49.217427 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed41a7-a93a-4521-856a-11bfa4ced422 admin admin] PATH_INFO: `/v3/projects/0d5860135a034b9bae3a381b580c97d9` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:49.218787 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed41a7-a93a-4521-856a-11bfa4ced422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5860135a034b9bae3a381b580c97d9)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:49.220948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed41a7-a93a-4521-856a-11bfa4ced422 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:49.248484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1399/2766] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:49 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:49.249560 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1879bb3-9c5d-4179-a2da-35c68e616205 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:49.336967 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1879bb3-9c5d-4179-a2da-35c68e616205 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:49.341751 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c04b3-8544-4427-83fc-a60290799abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:49.342344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c04b3-8544-4427-83fc-a60290799abc admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:49.342648 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c04b3-8544-4427-83fc-a60290799abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:49.343057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c04b3-8544-4427-83fc-a60290799abc admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:49.343761 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c04b3-8544-4427-83fc-a60290799abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:49.346386 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c04b3-8544-4427-83fc-a60290799abc admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:49.359171 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=81,keystone:DELETE=13,keystone:INSERT=6 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:49.387946 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d7ed41a7-a93a-4521-856a-11bfa4ced422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5860135a034b9bae3a381b580c97d9', 'request_id': 'req-d7ed41a7-a93a-4521-856a-11bfa4ced422'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:49.494446 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1400/2767] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:49 2022] POST /identity/v3/users => generated 286 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:49.498357 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c04b3-8544-4427-83fc-a60290799abc admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:49.512973 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c04b3-8544-4427-83fc-a60290799abc admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:49.528114 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d7ed41a7-a93a-4521-856a-11bfa4ced422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5860135a034b9bae3a381b580c97d9', 'request_id': 'req-d7ed41a7-a93a-4521-856a-11bfa4ced422'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:49.538590 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d7ed41a7-a93a-4521-856a-11bfa4ced422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5860135a034b9bae3a381b580c97d9', 'request_id': 'req-d7ed41a7-a93a-4521-856a-11bfa4ced422'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:49.559050 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d7ed41a7-a93a-4521-856a-11bfa4ced422 admin admin] The token cache is being invalidate because project 0d5860135a034b9bae3a381b580c97d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:57:49.559968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d7ed41a7-a93a-4521-856a-11bfa4ced422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:49.562220 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-d7ed41a7-a93a-4521-856a-11bfa4ced422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:57:49.574269 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1368/2768] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:57:49 2022] DELETE /identity/v3/projects/0d5860135a034b9bae3a381b580c97d9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:57:49.586066 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e4f35-812a-48ab-badd-7b9b3295a82a None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:49.587033 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e4f35-812a-48ab-badd-7b9b3295a82a None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:49.588156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e4f35-812a-48ab-badd-7b9b3295a82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:49.607050 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578adbfc-4e93-415d-94f4-a9320b0ef1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:49.608807 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578adbfc-4e93-415d-94f4-a9320b0ef1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:49.610151 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578adbfc-4e93-415d-94f4-a9320b0ef1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:49.610818 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578adbfc-4e93-415d-94f4-a9320b0ef1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:49.611432 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578adbfc-4e93-415d-94f4-a9320b0ef1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:49.614468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578adbfc-4e93-415d-94f4-a9320b0ef1d1 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:49.630282 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1401/2769] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:49.634353 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578adbfc-4e93-415d-94f4-a9320b0ef1d1 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:49.637089 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-578adbfc-4e93-415d-94f4-a9320b0ef1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:49.646052 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-402e4f35-812a-48ab-badd-7b9b3295a82a None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:49.647674 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-402e4f35-812a-48ab-badd-7b9b3295a82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:49.659118 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1369/2770] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:49.662152 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578adbfc-4e93-415d-94f4-a9320b0ef1d1 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:49.675294 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d907a1a-852f-419f-a777-321aec23e035 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:49.675643 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d907a1a-852f-419f-a777-321aec23e035 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:49.675995 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d907a1a-852f-419f-a777-321aec23e035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:49.678790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0befa-6ebc-40a6-bd49-fa0a7f3cd625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:49.679415 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0befa-6ebc-40a6-bd49-fa0a7f3cd625 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:49.679730 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0befa-6ebc-40a6-bd49-fa0a7f3cd625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:49.680007 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0befa-6ebc-40a6-bd49-fa0a7f3cd625 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:49.681415 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0befa-6ebc-40a6-bd49-fa0a7f3cd625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:49.682389 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0befa-6ebc-40a6-bd49-fa0a7f3cd625 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:49.694427 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1402/2771] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:49.698598 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0befa-6ebc-40a6-bd49-fa0a7f3cd625 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:49.711410 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-1d907a1a-852f-419f-a777-321aec23e035 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:49.712964 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1d907a1a-852f-419f-a777-321aec23e035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:49.714291 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0befa-6ebc-40a6-bd49-fa0a7f3cd625 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:49.725067 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907b9e2-6031-428a-8f3d-7e544cfaa764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:49.726945 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1370/2772] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:49.731040 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907b9e2-6031-428a-8f3d-7e544cfaa764 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:49.731460 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907b9e2-6031-428a-8f3d-7e544cfaa764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:49.731844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907b9e2-6031-428a-8f3d-7e544cfaa764 admin admin] PATH_INFO: `/v3/projects/8148049da5eb42ffa26ab35a53407808/users/d3447c3440a54e29ac144988cbfa8c34/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:49.731970 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d907a1a-852f-419f-a777-321aec23e035 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:49.743881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d907a1a-852f-419f-a777-321aec23e035 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:49.754261 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907b9e2-6031-428a-8f3d-7e544cfaa764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8148049da5eb42ffa26ab35a53407808, user_id=d3447c3440a54e29ac144988cbfa8c34, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:49.755376 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208d2e2-fbef-4b15-b9b0-283e63d0f468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:49.756393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208d2e2-fbef-4b15-b9b0-283e63d0f468 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:49.757346 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907b9e2-6031-428a-8f3d-7e544cfaa764 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:49.757531 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208d2e2-fbef-4b15-b9b0-283e63d0f468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:49.759254 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208d2e2-fbef-4b15-b9b0-283e63d0f468 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:49.760387 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208d2e2-fbef-4b15-b9b0-283e63d0f468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:57:49.761257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208d2e2-fbef-4b15-b9b0-283e63d0f468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:49.763948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208d2e2-fbef-4b15-b9b0-283e63d0f468 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:49.777079 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1371/2773] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 16:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:57:49.781806 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208d2e2-fbef-4b15-b9b0-283e63d0f468 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:49.789473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:49.799180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208d2e2-fbef-4b15-b9b0-283e63d0f468 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:49.805352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8237c-d904-4f0d-8303-fb800e33f077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:49.805980 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8237c-d904-4f0d-8303-fb800e33f077 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:49.806262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8237c-d904-4f0d-8303-fb800e33f077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:49.806542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8237c-d904-4f0d-8303-fb800e33f077 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:49.807197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8237c-d904-4f0d-8303-fb800e33f077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:49.809255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8237c-d904-4f0d-8303-fb800e33f077 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:49.894334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1403/2774] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:49 2022] PUT /identity/v3/projects/8148049da5eb42ffa26ab35a53407808/users/d3447c3440a54e29ac144988cbfa8c34/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:49.899714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6624d-3c62-4523-9472-519fd5297601 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:49.899996 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6624d-3c62-4523-9472-519fd5297601 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:49.900270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6624d-3c62-4523-9472-519fd5297601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:49.924102 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-34f6624d-3c62-4523-9472-519fd5297601 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:49.925357 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-34f6624d-3c62-4523-9472-519fd5297601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:49.992837 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1404/2775] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:50.005720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1372/2776] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:49 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:50.005956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6624d-3c62-4523-9472-519fd5297601 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:50.006156 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-34f6624d-3c62-4523-9472-519fd5297601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:50.018591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8237c-d904-4f0d-8303-fb800e33f077 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:50.077248 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6624d-3c62-4523-9472-519fd5297601 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:50.090191 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:50.124810 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8237c-d904-4f0d-8303-fb800e33f077 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:50.139878 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e13571-3469-48bf-95e5-3348495ef1ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:50.140745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e13571-3469-48bf-95e5-3348495ef1ac service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:50.141181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e13571-3469-48bf-95e5-3348495ef1ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:50.141558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e13571-3469-48bf-95e5-3348495ef1ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:50.143056 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d084128-7139-4a7b-bc66-e13e5f9c7cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:50.143973 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d084128-7139-4a7b-bc66-e13e5f9c7cae admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:50.144586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d084128-7139-4a7b-bc66-e13e5f9c7cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:50.145203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d084128-7139-4a7b-bc66-e13e5f9c7cae admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:50.146567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d084128-7139-4a7b-bc66-e13e5f9c7cae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:50.149233 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d084128-7139-4a7b-bc66-e13e5f9c7cae admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:50.153992 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e13571-3469-48bf-95e5-3348495ef1ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:50.155842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e13571-3469-48bf-95e5-3348495ef1ac service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:50.168209 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1405/2777] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:50.284865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1373/2778] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:50 2022] POST /identity/v3/users => generated 287 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:50.285727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e13571-3469-48bf-95e5-3348495ef1ac service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:50.307593 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e13571-3469-48bf-95e5-3348495ef1ac service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:50.313934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab28aa3-c7c3-4bfb-93f9-769fe12abeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:50.314717 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab28aa3-c7c3-4bfb-93f9-769fe12abeee admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:50.315106 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab28aa3-c7c3-4bfb-93f9-769fe12abeee admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:50.315529 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab28aa3-c7c3-4bfb-93f9-769fe12abeee admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:50.316243 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab28aa3-c7c3-4bfb-93f9-769fe12abeee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:50.320238 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab28aa3-c7c3-4bfb-93f9-769fe12abeee admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:50.339991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d084128-7139-4a7b-bc66-e13e5f9c7cae admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:50.347805 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1406/2779] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:57:50.353056 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d084128-7139-4a7b-bc66-e13e5f9c7cae admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:50.360916 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae85d6c-817a-4b28-8d00-20a6689d6eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:50.361535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae85d6c-817a-4b28-8d00-20a6689d6eda admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:50.361814 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae85d6c-817a-4b28-8d00-20a6689d6eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:50.362091 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae85d6c-817a-4b28-8d00-20a6689d6eda admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:50.362742 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae85d6c-817a-4b28-8d00-20a6689d6eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:50.364624 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae85d6c-817a-4b28-8d00-20a6689d6eda admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:50.377108 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1374/2780] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:50.388127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab28aa3-c7c3-4bfb-93f9-769fe12abeee admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:50.414886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab28aa3-c7c3-4bfb-93f9-769fe12abeee admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:50.415216 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c1031-ec48-40a4-941f-1d24327fd52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:50.415713 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c1031-ec48-40a4-941f-1d24327fd52a admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:50.415993 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c1031-ec48-40a4-941f-1d24327fd52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:50.416272 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c1031-ec48-40a4-941f-1d24327fd52a admin admin] PATH_INFO: `/v3/projects/639bb2d3141440d9b390daf9105532de/users/2f4a726edffb4c07b056f254858e26bc/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:50.436881 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c1031-ec48-40a4-941f-1d24327fd52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=639bb2d3141440d9b390daf9105532de, user_id=2f4a726edffb4c07b056f254858e26bc, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:50.439320 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c1031-ec48-40a4-941f-1d24327fd52a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:50.539127 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1407/2781] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:50 2022] PUT /identity/v3/projects/639bb2d3141440d9b390daf9105532de/users/2f4a726edffb4c07b056f254858e26bc/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:50.544299 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7662cb-628a-46f8-acdf-644ac40a1ab6 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:50.545243 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7662cb-628a-46f8-acdf-644ac40a1ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:50.545779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7662cb-628a-46f8-acdf-644ac40a1ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:50.581292 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-ca7662cb-628a-46f8-acdf-644ac40a1ab6 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:50.583664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-ca7662cb-628a-46f8-acdf-644ac40a1ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:50.664743 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1375/2782] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:57:50.676135 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c1031-ec48-40a4-941f-1d24327fd52a admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:50.685117 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-da4c1031-ec48-40a4-941f-1d24327fd52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:50.809251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c1031-ec48-40a4-941f-1d24327fd52a admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:50.827681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7193b-a939-4251-b279-900860b2ffb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:50.829171 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7193b-a939-4251-b279-900860b2ffb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:50.829452 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7193b-a939-4251-b279-900860b2ffb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:50.829728 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7193b-a939-4251-b279-900860b2ffb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:50.850077 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7193b-a939-4251-b279-900860b2ffb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:50.856696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7193b-a939-4251-b279-900860b2ffb8 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:50.871841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1408/2783] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:51.963172 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39770-6f59-48ed-ae7b-5e20eb04a25e None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:51.963688 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39770-6f59-48ed-ae7b-5e20eb04a25e None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:51.963775 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39770-6f59-48ed-ae7b-5e20eb04a25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:52.003024 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-d3d39770-6f59-48ed-ae7b-5e20eb04a25e None None] MFA Rules not processed for user `d3447c3440a54e29ac144988cbfa8c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:52.004535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-d3d39770-6f59-48ed-ae7b-5e20eb04a25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:52.073339 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:52.094981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1376/2784] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:52.113988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7193b-a939-4251-b279-900860b2ffb8 service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:52.115627 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-32b7193b-a939-4251-b279-900860b2ffb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:52.204830 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7193b-a939-4251-b279-900860b2ffb8 service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:52.208665 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f61455-1d93-454d-94aa-44d1096a436d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:52.209607 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f61455-1d93-454d-94aa-44d1096a436d service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:52.209936 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f61455-1d93-454d-94aa-44d1096a436d service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:52.210307 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f61455-1d93-454d-94aa-44d1096a436d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:52.228623 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f61455-1d93-454d-94aa-44d1096a436d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:52.233910 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f61455-1d93-454d-94aa-44d1096a436d service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:52.246440 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1409/2785] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:57:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:57:54.481113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cf38d-31fe-4fef-be26-870001c4e6ff None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:54.483542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cf38d-31fe-4fef-be26-870001c4e6ff None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:54.483542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cf38d-31fe-4fef-be26-870001c4e6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:54.501350 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-2c0cf38d-31fe-4fef-be26-870001c4e6ff None None] MFA Rules not processed for user `d3447c3440a54e29ac144988cbfa8c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:54.502512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-2c0cf38d-31fe-4fef-be26-870001c4e6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:54.509930 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1377/2786] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:58.760801 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1d72b-032b-4e93-846b-e2f5f1b198f5 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:58.761405 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1d72b-032b-4e93-846b-e2f5f1b198f5 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:58.761405 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1d72b-032b-4e93-846b-e2f5f1b198f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:58.792329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8bf1d72b-032b-4e93-846b-e2f5f1b198f5 None None] MFA Rules not processed for user `2f4a726edffb4c07b056f254858e26bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:57:58.795579 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8bf1d72b-032b-4e93-846b-e2f5f1b198f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:57:58.826181 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:57:58.870605 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1410/2787] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:57:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:57:58.875657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cf38d-31fe-4fef-be26-870001c4e6ff None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:58.888316 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cf38d-31fe-4fef-be26-870001c4e6ff None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:58.893064 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b81d9-1188-4f16-968a-0e22dc86e6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:58.893680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b81d9-1188-4f16-968a-0e22dc86e6bb admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:58.893956 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b81d9-1188-4f16-968a-0e22dc86e6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:58.894236 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b81d9-1188-4f16-968a-0e22dc86e6bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:58.894895 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b81d9-1188-4f16-968a-0e22dc86e6bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:58.897011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b81d9-1188-4f16-968a-0e22dc86e6bb admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:59.442566 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1378/2788] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 16:57:58 2022] POST /identity/v3/projects => generated 371 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:57:59.443354 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1d72b-032b-4e93-846b-e2f5f1b198f5 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:59.455014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1d72b-032b-4e93-846b-e2f5f1b198f5 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:59.556570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bef650-7a71-4cc2-b88f-5f81c6efaf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:59.560278 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bef650-7a71-4cc2-b88f-5f81c6efaf37 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:59.560763 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bef650-7a71-4cc2-b88f-5f81c6efaf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:59.561208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bef650-7a71-4cc2-b88f-5f81c6efaf37 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:59.563678 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bef650-7a71-4cc2-b88f-5f81c6efaf37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:59.566096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bef650-7a71-4cc2-b88f-5f81c6efaf37 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:59.729747 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1411/2789] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 16:57:59 2022] POST /identity/v3/users => generated 292 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:57:59.741129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b81d9-1188-4f16-968a-0e22dc86e6bb admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:59.744587 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b81d9-1188-4f16-968a-0e22dc86e6bb admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:59.764093 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacbfb3-c257-4119-b657-023b0cf5ef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:59.766364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacbfb3-c257-4119-b657-023b0cf5ef41 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:59.766821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacbfb3-c257-4119-b657-023b0cf5ef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:59.767313 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacbfb3-c257-4119-b657-023b0cf5ef41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:59.768333 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacbfb3-c257-4119-b657-023b0cf5ef41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:59.770008 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacbfb3-c257-4119-b657-023b0cf5ef41 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:59.799716 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1379/2790] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:57:59.800976 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bef650-7a71-4cc2-b88f-5f81c6efaf37 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:59.822179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bef650-7a71-4cc2-b88f-5f81c6efaf37 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:57:59.827644 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc212f-cbb4-4f0a-a722-f31792b333b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:57:59.833505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc212f-cbb4-4f0a-a722-f31792b333b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:57:59.833505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc212f-cbb4-4f0a-a722-f31792b333b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:57:59.833505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc212f-cbb4-4f0a-a722-f31792b333b6 admin admin] PATH_INFO: `/v3/projects/7ca2ac17189b4169951e6202405dabe2/users/3edfc250419e4f44bf566b9e66f489c8/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:57:59.854825 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc212f-cbb4-4f0a-a722-f31792b333b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca2ac17189b4169951e6202405dabe2, user_id=3edfc250419e4f44bf566b9e66f489c8, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:57:59.858003 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc212f-cbb4-4f0a-a722-f31792b333b6 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:57:59.961112 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1412/2791] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:57:59 2022] PUT /identity/v3/projects/7ca2ac17189b4169951e6202405dabe2/users/3edfc250419e4f44bf566b9e66f489c8/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:57:59.965431 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacbfb3-c257-4119-b657-023b0cf5ef41 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:57:59.993891 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacbfb3-c257-4119-b657-023b0cf5ef41 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:58:00.070774 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2300d1-a9d7-4db3-9219-f4c4ea6be372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:58:00.072015 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2300d1-a9d7-4db3-9219-f4c4ea6be372 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:58:00.077923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2300d1-a9d7-4db3-9219-f4c4ea6be372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:58:00.077923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2300d1-a9d7-4db3-9219-f4c4ea6be372 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:58:00.077923 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2300d1-a9d7-4db3-9219-f4c4ea6be372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:58:00.085069 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2300d1-a9d7-4db3-9219-f4c4ea6be372 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:58:00.107453 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1380/2792] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 16:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:58:00.112319 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc212f-cbb4-4f0a-a722-f31792b333b6 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:58:00.123265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc212f-cbb4-4f0a-a722-f31792b333b6 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:58:00.128936 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e5c17-6a59-40b9-b97f-0f0bb6b16082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:58:00.130497 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e5c17-6a59-40b9-b97f-0f0bb6b16082 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:58:00.133696 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e5c17-6a59-40b9-b97f-0f0bb6b16082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:58:00.134403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e5c17-6a59-40b9-b97f-0f0bb6b16082 admin admin] PATH_INFO: `/v3/projects/7ca2ac17189b4169951e6202405dabe2/users/3edfc250419e4f44bf566b9e66f489c8/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:58:00.137731 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e5c17-6a59-40b9-b97f-0f0bb6b16082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca2ac17189b4169951e6202405dabe2, user_id=3edfc250419e4f44bf566b9e66f489c8, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:58:00.141375 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e5c17-6a59-40b9-b97f-0f0bb6b16082 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:58:00.159072 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1413/2793] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 16:58:00 2022] PUT /identity/v3/projects/7ca2ac17189b4169951e6202405dabe2/users/3edfc250419e4f44bf566b9e66f489c8/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:58:01.761746 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b75a72-fa91-4099-8005-a2f0ee4530f8 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:58:01.763143 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b75a72-fa91-4099-8005-a2f0ee4530f8 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:58:01.763720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b75a72-fa91-4099-8005-a2f0ee4530f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:58:01.807788 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-56b75a72-fa91-4099-8005-a2f0ee4530f8 None None] MFA Rules not processed for user `87ba67fc171b4258b6fda72094ed11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:58:01.813298 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-56b75a72-fa91-4099-8005-a2f0ee4530f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:58:01.942167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1381/2794] 10.222.0.25 () {58 vars in 967 bytes} [Wed Sep 7 16:58:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:58:01.958890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e5c17-6a59-40b9-b97f-0f0bb6b16082 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:58:01.961723 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-887e5c17-6a59-40b9-b97f-0f0bb6b16082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:58:02.130236 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e5c17-6a59-40b9-b97f-0f0bb6b16082 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:58:02.148195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cee0a-3753-4399-b955-9eac6e08d4f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56cd868e866d436aa1d601f7791e812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:58:02.149117 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cee0a-3753-4399-b955-9eac6e08d4f9 service swift] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:58:02.149402 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cee0a-3753-4399-b955-9eac6e08d4f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:58:02.149677 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cee0a-3753-4399-b955-9eac6e08d4f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:58:02.164656 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cee0a-3753-4399-b955-9eac6e08d4f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:58:02.166694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cee0a-3753-4399-b955-9eac6e08d4f9 service swift] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:58:02.172273 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:58:02.185122 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1414/2795] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Sep 7 16:58:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:58:06.477873 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c327c-ebe5-43aa-8a0c-9d776ac7a95f None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:58:06.484142 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c327c-ebe5-43aa-8a0c-9d776ac7a95f None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:58:06.484142 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c327c-ebe5-43aa-8a0c-9d776ac7a95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:58:06.515260 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-791c327c-ebe5-43aa-8a0c-9d776ac7a95f None None] MFA Rules not processed for user `3edfc250419e4f44bf566b9e66f489c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:58:06.517164 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-791c327c-ebe5-43aa-8a0c-9d776ac7a95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:58:06.571354 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:58:06.602983 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1382/2796] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:58:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:58:06.617412 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cee0a-3753-4399-b955-9eac6e08d4f9 service swift] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:58:06.618856 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-2c2cee0a-3753-4399-b955-9eac6e08d4f9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:58:06.751256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cee0a-3753-4399-b955-9eac6e08d4f9 service swift] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:58:06.765300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d59a93-8539-4571-903d-8a099fa9fa87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:58:06.766076 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d59a93-8539-4571-903d-8a099fa9fa87 service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:58:06.766353 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d59a93-8539-4571-903d-8a099fa9fa87 service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:58:06.766620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d59a93-8539-4571-903d-8a099fa9fa87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:58:06.840354 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d59a93-8539-4571-903d-8a099fa9fa87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:58:06.842100 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d59a93-8539-4571-903d-8a099fa9fa87 service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:58:06.859786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1415/2797] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:58:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:58:10.470246 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdcd73-f3fb-4b05-902f-d9705c2cee6f None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:58:10.471223 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdcd73-f3fb-4b05-902f-d9705c2cee6f None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:58:10.471717 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdcd73-f3fb-4b05-902f-d9705c2cee6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:58:10.501657 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-37fdcd73-f3fb-4b05-902f-d9705c2cee6f None None] MFA Rules not processed for user `2f4a726edffb4c07b056f254858e26bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:58:10.503302 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-37fdcd73-f3fb-4b05-902f-d9705c2cee6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:58:10.513739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1383/2798] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:58:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:58:15.701514 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce98e1-d09f-4cba-bc7f-e09d24bb6ac4 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:58:15.702210 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce98e1-d09f-4cba-bc7f-e09d24bb6ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:58:15.702210 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce98e1-d09f-4cba-bc7f-e09d24bb6ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:58:15.730073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f6ce98e1-d09f-4cba-bc7f-e09d24bb6ac4 None None] MFA Rules not processed for user `d3447c3440a54e29ac144988cbfa8c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:58:15.732637 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f6ce98e1-d09f-4cba-bc7f-e09d24bb6ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:58:15.811220 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1416/2799] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:58:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:58:20.493240 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=13 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:58:25.804194 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=82 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:58:28.312469 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdcd73-f3fb-4b05-902f-d9705c2cee6f None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:58:28.314843 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-37fdcd73-f3fb-4b05-902f-d9705c2cee6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:58:28.447444 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdcd73-f3fb-4b05-902f-d9705c2cee6f None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:58:28.453199 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f0a99-296c-481c-901f-386b26fa330b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256e8478e5fb4c01acde0d597bae0b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:58:28.453940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f0a99-296c-481c-901f-386b26fa330b service placement] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:58:28.454364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f0a99-296c-481c-901f-386b26fa330b service placement] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:58:28.454572 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f0a99-296c-481c-901f-386b26fa330b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:58:28.456361 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b66f0a99-296c-481c-901f-386b26fa330b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:58:28.469054 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f0a99-296c-481c-901f-386b26fa330b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:58:28.470647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f0a99-296c-481c-901f-386b26fa330b service placement] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:58:28.481273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1384/2800] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:58:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:58:37.944945 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce58c0a-0f61-49db-b6a2-3ed76416af40 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:58:37.945478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce58c0a-0f61-49db-b6a2-3ed76416af40 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:58:37.945585 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce58c0a-0f61-49db-b6a2-3ed76416af40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:58:37.965245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-8ce58c0a-0f61-49db-b6a2-3ed76416af40 None None] MFA Rules not processed for user `87ba67fc171b4258b6fda72094ed11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:58:37.966466 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8ce58c0a-0f61-49db-b6a2-3ed76416af40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:58:37.982114 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1417/2801] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Sep 7 16:58:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:58:38.006219 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f0a99-296c-481c-901f-386b26fa330b service placement] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:58:38.018262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f0a99-296c-481c-901f-386b26fa330b service placement] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:58:38.023542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f79d07-3eda-4624-b53d-baef6c5810a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56cd868e866d436aa1d601f7791e812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:58:38.024158 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f79d07-3eda-4624-b53d-baef6c5810a1 service swift] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:58:38.024433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f79d07-3eda-4624-b53d-baef6c5810a1 service swift] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:58:38.024700 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f79d07-3eda-4624-b53d-baef6c5810a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:58:38.033791 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f79d07-3eda-4624-b53d-baef6c5810a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:58:38.035365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f79d07-3eda-4624-b53d-baef6c5810a1 service swift] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:58:38.044995 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1385/2802] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Sep 7 16:58:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:58:43.905941 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce58c0a-0f61-49db-b6a2-3ed76416af40 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:58:43.992208 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce58c0a-0f61-49db-b6a2-3ed76416af40 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:58:43.995861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c562e-c0da-4116-a889-9a5a6b3380d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:58:43.996481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c562e-c0da-4116-a889-9a5a6b3380d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:58:43.996765 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c562e-c0da-4116-a889-9a5a6b3380d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:58:43.997021 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c562e-c0da-4116-a889-9a5a6b3380d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:58:44.009494 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c562e-c0da-4116-a889-9a5a6b3380d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:58:44.011116 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c562e-c0da-4116-a889-9a5a6b3380d3 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:58:44.025219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1418/2803] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:58:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:58:46.952551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f79d07-3eda-4624-b53d-baef6c5810a1 service swift] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:58:46.981240 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f79d07-3eda-4624-b53d-baef6c5810a1 service swift] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:58:46.989634 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f3351-695f-4ed9-a2d5-9d0fdba3e00b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:58:46.991231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3351-695f-4ed9-a2d5-9d0fdba3e00b service nova] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:58:46.991761 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3351-695f-4ed9-a2d5-9d0fdba3e00b service nova] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:58:46.995644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3351-695f-4ed9-a2d5-9d0fdba3e00b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:58:47.010893 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3c9f3351-695f-4ed9-a2d5-9d0fdba3e00b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:58:47.082582 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f3351-695f-4ed9-a2d5-9d0fdba3e00b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:58:47.085200 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f3351-695f-4ed9-a2d5-9d0fdba3e00b service nova] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:58:47.101146 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1386/2804] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 16:58:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:58:50.771618 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec90f50-7650-48d4-84c2-9d5149a2d9fd None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:58:50.772506 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec90f50-7650-48d4-84c2-9d5149a2d9fd None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:58:50.773319 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec90f50-7650-48d4-84c2-9d5149a2d9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:58:50.799041 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-0ec90f50-7650-48d4-84c2-9d5149a2d9fd None None] MFA Rules not processed for user `2a6796a4bca94d448ae6c52fd28e2c35`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:58:50.800456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-0ec90f50-7650-48d4-84c2-9d5149a2d9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:58:50.874906 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1419/2805] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 16:58:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:58:57.111752 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=62 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:58:57.817065 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab59bf8-230a-4d88-b45c-0da7c6dfe099 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:58:57.817643 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab59bf8-230a-4d88-b45c-0da7c6dfe099 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:58:57.817916 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab59bf8-230a-4d88-b45c-0da7c6dfe099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:58:57.837714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-dab59bf8-230a-4d88-b45c-0da7c6dfe099 None None] MFA Rules not processed for user `87ba67fc171b4258b6fda72094ed11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:58:57.838940 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-dab59bf8-230a-4d88-b45c-0da7c6dfe099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:58:57.846865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1387/2806] 10.222.0.25 () {58 vars in 967 bytes} [Wed Sep 7 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:58:57.861239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec90f50-7650-48d4-84c2-9d5149a2d9fd None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:58:57.874075 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec90f50-7650-48d4-84c2-9d5149a2d9fd None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:58:57.879258 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695cc50-5836-4404-ac91-bbb0c4883316 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56cd868e866d436aa1d601f7791e812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:58:57.879927 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695cc50-5836-4404-ac91-bbb0c4883316 service swift] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:58:57.880205 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695cc50-5836-4404-ac91-bbb0c4883316 service swift] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:58:57.880483 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695cc50-5836-4404-ac91-bbb0c4883316 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:58:57.889923 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695cc50-5836-4404-ac91-bbb0c4883316 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:58:57.891629 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695cc50-5836-4404-ac91-bbb0c4883316 service swift] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:58:57.900247 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1420/2807] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Sep 7 16:58:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:59:01.061216 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab59bf8-230a-4d88-b45c-0da7c6dfe099 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:59:01.131334 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab59bf8-230a-4d88-b45c-0da7c6dfe099 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:59:01.136211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be4fc4-be0a-4653-bbe2-0d40918f5214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:59:01.136860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be4fc4-be0a-4653-bbe2-0d40918f5214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:59:01.137141 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be4fc4-be0a-4653-bbe2-0d40918f5214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:59:01.137415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be4fc4-be0a-4653-bbe2-0d40918f5214 admin admin] PATH_INFO: `/v3/users/d3447c3440a54e29ac144988cbfa8c34` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:59:01.139118 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be4fc4-be0a-4653-bbe2-0d40918f5214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3447c3440a54e29ac144988cbfa8c34)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:59:01.141115 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be4fc4-be0a-4653-bbe2-0d40918f5214 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:59:01.353527 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-92be4fc4-be0a-4653-bbe2-0d40918f5214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3447c3440a54e29ac144988cbfa8c34'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:59:01.354336 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-92be4fc4-be0a-4653-bbe2-0d40918f5214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3447c3440a54e29ac144988cbfa8c34'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:59:01.362822 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-92be4fc4-be0a-4653-bbe2-0d40918f5214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3447c3440a54e29ac144988cbfa8c34'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:59:01.377273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-92be4fc4-be0a-4653-bbe2-0d40918f5214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3447c3440a54e29ac144988cbfa8c34'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:59:01.378207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-92be4fc4-be0a-4653-bbe2-0d40918f5214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3447c3440a54e29ac144988cbfa8c34'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:59:01.483747 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1388/2808] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 16:59:01 2022] DELETE /identity/v3/users/d3447c3440a54e29ac144988cbfa8c34 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:59:01.771679 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695cc50-5836-4404-ac91-bbb0c4883316 service swift] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:59:01.783110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695cc50-5836-4404-ac91-bbb0c4883316 service swift] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:59:01.864959 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d607840-f993-485b-82dc-7bff0bf2e71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:59:01.865505 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d607840-f993-485b-82dc-7bff0bf2e71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:59:01.865820 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d607840-f993-485b-82dc-7bff0bf2e71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:59:01.866039 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d607840-f993-485b-82dc-7bff0bf2e71e admin admin] PATH_INFO: `/v3/projects/8148049da5eb42ffa26ab35a53407808` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:59:01.867166 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d607840-f993-485b-82dc-7bff0bf2e71e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8148049da5eb42ffa26ab35a53407808)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:59:01.869121 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d607840-f993-485b-82dc-7bff0bf2e71e admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:59:01.897641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:59:01.976063 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3d607840-f993-485b-82dc-7bff0bf2e71e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8148049da5eb42ffa26ab35a53407808', 'request_id': 'req-3d607840-f993-485b-82dc-7bff0bf2e71e'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:59:01.983265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3d607840-f993-485b-82dc-7bff0bf2e71e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8148049da5eb42ffa26ab35a53407808', 'request_id': 'req-3d607840-f993-485b-82dc-7bff0bf2e71e'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:59:02.060226 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3d607840-f993-485b-82dc-7bff0bf2e71e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8148049da5eb42ffa26ab35a53407808', 'request_id': 'req-3d607840-f993-485b-82dc-7bff0bf2e71e'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:59:02.072732 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3d607840-f993-485b-82dc-7bff0bf2e71e admin admin] The token cache is being invalidate because project 8148049da5eb42ffa26ab35a53407808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:59:02.073030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3d607840-f993-485b-82dc-7bff0bf2e71e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:59:02.073694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-3d607840-f993-485b-82dc-7bff0bf2e71e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:59:02.075251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1421/2809] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 16:59:01 2022] DELETE /identity/v3/projects/8148049da5eb42ffa26ab35a53407808 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:59:11.479530 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:59:12.134834 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:59:59.450773 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11678b4-dda0-4870-85b3-4d8a71e89b68 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:59:59.451391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11678b4-dda0-4870-85b3-4d8a71e89b68 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:59:59.451391 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11678b4-dda0-4870-85b3-4d8a71e89b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:59:59.476439 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-a11678b4-dda0-4870-85b3-4d8a71e89b68 None None] MFA Rules not processed for user `87ba67fc171b4258b6fda72094ed11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:59:59.477683 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a11678b4-dda0-4870-85b3-4d8a71e89b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:59:59.535659 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1389/2810] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Sep 7 16:59:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:59:59.669015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d607840-f993-485b-82dc-7bff0bf2e71e admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:59:59.670430 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-3d607840-f993-485b-82dc-7bff0bf2e71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:59:59.750412 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d607840-f993-485b-82dc-7bff0bf2e71e admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:59:59.756239 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed9078-6381-49a1-aa3b-0957bd15d289 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56cd868e866d436aa1d601f7791e812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:59:59.768646 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed9078-6381-49a1-aa3b-0957bd15d289 service swift] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:59:59.768646 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed9078-6381-49a1-aa3b-0957bd15d289 service swift] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:59:59.768646 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed9078-6381-49a1-aa3b-0957bd15d289 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:59:59.771994 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed9078-6381-49a1-aa3b-0957bd15d289 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:59:59.775185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed9078-6381-49a1-aa3b-0957bd15d289 service swift] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:59:59.793470 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1422/2811] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Sep 7 16:59:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 17:00:09.527888 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=25 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:00:09.786684 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=32 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:00:13.826722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11678b4-dda0-4870-85b3-4d8a71e89b68 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:00:13.828443 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a11678b4-dda0-4870-85b3-4d8a71e89b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:00:13.894251 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11678b4-dda0-4870-85b3-4d8a71e89b68 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:00:13.897881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850fd3f-8e24-4d89-bc21-b94acb0ed060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:00:13.898489 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850fd3f-8e24-4d89-bc21-b94acb0ed060 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:00:13.900909 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850fd3f-8e24-4d89-bc21-b94acb0ed060 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:00:13.900909 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850fd3f-8e24-4d89-bc21-b94acb0ed060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:00:13.900909 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4850fd3f-8e24-4d89-bc21-b94acb0ed060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:00:13.984296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850fd3f-8e24-4d89-bc21-b94acb0ed060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:00:13.986324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850fd3f-8e24-4d89-bc21-b94acb0ed060 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:00:14.005960 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1390/2812] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:00:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:00:16.107234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078c2e3-baae-4010-89b3-f90bfea357b7 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:00:16.112872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078c2e3-baae-4010-89b3-f90bfea357b7 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:00:16.112872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078c2e3-baae-4010-89b3-f90bfea357b7 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:00:16.112872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1423/2813] 10.222.0.25 () {54 vars in 921 bytes} [Wed Sep 7 17:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 17:00:16.117886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954c032-87cb-4da7-a653-4aee9503276b None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:00:16.118652 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954c032-87cb-4da7-a653-4aee9503276b None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:00:16.118652 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954c032-87cb-4da7-a653-4aee9503276b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:00:16.171021 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-6954c032-87cb-4da7-a653-4aee9503276b None None] MFA Rules not processed for user `cf48978c20f04173b114e15e1ce2157c`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:00:16.172352 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-6954c032-87cb-4da7-a653-4aee9503276b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:00:16.182094 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1391/2814] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Sep 7 17:00:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 17:00:16.195210 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078c2e3-baae-4010-89b3-f90bfea357b7 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:00:16.197211 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9078c2e3-baae-4010-89b3-f90bfea357b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:00:16.262077 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078c2e3-baae-4010-89b3-f90bfea357b7 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:00:16.268251 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02313feb-917b-43c9-a54e-ee41a77ac774 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52705fc64cd54b1985ef2cb02f6c47fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:00:16.268946 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02313feb-917b-43c9-a54e-ee41a77ac774 service glance] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:00:16.269242 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02313feb-917b-43c9-a54e-ee41a77ac774 service glance] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:00:16.269719 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02313feb-917b-43c9-a54e-ee41a77ac774 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:00:16.283707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02313feb-917b-43c9-a54e-ee41a77ac774 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:00:16.285492 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02313feb-917b-43c9-a54e-ee41a77ac774 service glance] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:00:16.298646 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1424/2815] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:00:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:00:16.506510 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392721be-60c1-4b02-b0bc-f70de97ccce1 None None] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:00:16.506821 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392721be-60c1-4b02-b0bc-f70de97ccce1 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:00:16.507053 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392721be-60c1-4b02-b0bc-f70de97ccce1 None None] PATH_INFO: `/` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:00:16.508625 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1392/2816] 10.222.0.25 () {54 vars in 921 bytes} [Wed Sep 7 17:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 17:00:16.517015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af0602-f293-4626-a0e6-088e7a1474be None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:00:16.517015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af0602-f293-4626-a0e6-088e7a1474be None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:00:16.517015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af0602-f293-4626-a0e6-088e7a1474be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:00:16.535180 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-95af0602-f293-4626-a0e6-088e7a1474be None None] MFA Rules not processed for user `bac099b78bd04e02b8614c8afce53ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:00:16.536442 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-95af0602-f293-4626-a0e6-088e7a1474be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:00:16.598280 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1425/2817] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Sep 7 17:00:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:00:16.611508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392721be-60c1-4b02-b0bc-f70de97ccce1 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:00:16.613372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-392721be-60c1-4b02-b0bc-f70de97ccce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:00:16.630939 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392721be-60c1-4b02-b0bc-f70de97ccce1 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:00:16.634642 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9151ed3-66a9-4015-9387-e4a25da2b907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:00:16.635253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9151ed3-66a9-4015-9387-e4a25da2b907 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:00:16.635583 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9151ed3-66a9-4015-9387-e4a25da2b907 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:00:16.635846 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9151ed3-66a9-4015-9387-e4a25da2b907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:00:16.643569 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9151ed3-66a9-4015-9387-e4a25da2b907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:00:16.645002 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9151ed3-66a9-4015-9387-e4a25da2b907 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:00:16.652868 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1393/2818] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:00:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:00:16.740267 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1019efe-000e-42d7-b653-b48a5a0429e0 None None] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:00:16.740549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1019efe-000e-42d7-b653-b48a5a0429e0 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:00:16.740851 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1019efe-000e-42d7-b653-b48a5a0429e0 None None] PATH_INFO: `/` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:00:16.742178 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1426/2819] 10.222.0.25 () {54 vars in 921 bytes} [Wed Sep 7 17:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 17:00:16.747672 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41e9db-ca40-4326-bc7d-1a97e09fc8a4 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:00:16.748157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41e9db-ca40-4326-bc7d-1a97e09fc8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:00:16.748157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41e9db-ca40-4326-bc7d-1a97e09fc8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:00:16.770881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-1a41e9db-ca40-4326-bc7d-1a97e09fc8a4 None None] MFA Rules not processed for user `cf48978c20f04173b114e15e1ce2157c`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:00:16.772129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-1a41e9db-ca40-4326-bc7d-1a97e09fc8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:00:16.786574 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1394/2820] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Sep 7 17:00:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:00:16.797559 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1019efe-000e-42d7-b653-b48a5a0429e0 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:00:16.808632 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1019efe-000e-42d7-b653-b48a5a0429e0 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:00:16.813842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334aa80-7c98-44fa-92fa-e300e440fa67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:00:16.814456 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334aa80-7c98-44fa-92fa-e300e440fa67 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:00:16.814736 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334aa80-7c98-44fa-92fa-e300e440fa67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:00:16.815008 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334aa80-7c98-44fa-92fa-e300e440fa67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:00:16.825754 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334aa80-7c98-44fa-92fa-e300e440fa67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:00:16.827178 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334aa80-7c98-44fa-92fa-e300e440fa67 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:00:16.838063 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1427/2821] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:00:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:00:18.463001 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41e9db-ca40-4326-bc7d-1a97e09fc8a4 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:00:18.472969 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41e9db-ca40-4326-bc7d-1a97e09fc8a4 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:00:18.476652 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bc7b6-0357-4b94-b6f4-d801fc37a47f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:00:18.477262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bc7b6-0357-4b94-b6f4-d801fc37a47f service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:00:18.477725 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bc7b6-0357-4b94-b6f4-d801fc37a47f service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:00:18.477999 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bc7b6-0357-4b94-b6f4-d801fc37a47f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:00:18.479834 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0e1bc7b6-0357-4b94-b6f4-d801fc37a47f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:00:18.494721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bc7b6-0357-4b94-b6f4-d801fc37a47f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:00:18.496225 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bc7b6-0357-4b94-b6f4-d801fc37a47f service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:00:18.509778 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1395/2822] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:00:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:00:19.475210 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35f389-0ead-49ec-b28a-4cb4bef0a3d0 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:00:19.475715 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35f389-0ead-49ec-b28a-4cb4bef0a3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:00:19.475811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35f389-0ead-49ec-b28a-4cb4bef0a3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:00:19.496290 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-eb35f389-0ead-49ec-b28a-4cb4bef0a3d0 None None] MFA Rules not processed for user `87ba67fc171b4258b6fda72094ed11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:00:19.497586 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-eb35f389-0ead-49ec-b28a-4cb4bef0a3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:00:19.505387 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1428/2823] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Sep 7 17:00:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:00:19.518528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bc7b6-0357-4b94-b6f4-d801fc37a47f service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:00:19.533205 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bc7b6-0357-4b94-b6f4-d801fc37a47f service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:00:19.538359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8b117-9352-4021-ba72-a5f285aea7af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56cd868e866d436aa1d601f7791e812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:00:19.538965 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8b117-9352-4021-ba72-a5f285aea7af service swift] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:00:19.539241 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8b117-9352-4021-ba72-a5f285aea7af service swift] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:00:19.539535 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8b117-9352-4021-ba72-a5f285aea7af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:00:19.549155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8b117-9352-4021-ba72-a5f285aea7af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:00:19.550739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8b117-9352-4021-ba72-a5f285aea7af service swift] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:00:19.559397 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1396/2824] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Sep 7 17:00:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 17:00:29.490949 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=58 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:00:29.555929 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=84 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:00:33.531703 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ee0f-10b7-4fd0-b8eb-1c567cb43ca4 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:00:33.532263 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ee0f-10b7-4fd0-b8eb-1c567cb43ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:00:33.532263 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ee0f-10b7-4fd0-b8eb-1c567cb43ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:00:33.553204 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-b009ee0f-10b7-4fd0-b8eb-1c567cb43ca4 None None] MFA Rules not processed for user `87ba67fc171b4258b6fda72094ed11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:00:33.554478 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-b009ee0f-10b7-4fd0-b8eb-1c567cb43ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:00:33.561863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1429/2825] 10.222.0.25 () {58 vars in 967 bytes} [Wed Sep 7 17:00:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:00:33.575938 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8b117-9352-4021-ba72-a5f285aea7af service swift] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:00:33.588001 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8b117-9352-4021-ba72-a5f285aea7af service swift] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:00:33.593744 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b74f85-3857-4965-a33f-db57cbdb0969 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56cd868e866d436aa1d601f7791e812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:00:33.594335 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b74f85-3857-4965-a33f-db57cbdb0969 service swift] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:00:33.594640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b74f85-3857-4965-a33f-db57cbdb0969 service swift] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:00:33.594904 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b74f85-3857-4965-a33f-db57cbdb0969 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:00:33.603180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b74f85-3857-4965-a33f-db57cbdb0969 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:00:33.604778 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b74f85-3857-4965-a33f-db57cbdb0969 service swift] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:00:33.613689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1397/2826] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Sep 7 17:00:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 17:00:43.547352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:00:43.609845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=6 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:00:58.833763 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009ee0f-10b7-4fd0-b8eb-1c567cb43ca4 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:00:58.844087 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009ee0f-10b7-4fd0-b8eb-1c567cb43ca4 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:00:58.847863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012b74c-fbaf-4ca1-9411-509f18e884c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:00:58.848465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012b74c-fbaf-4ca1-9411-509f18e884c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:00:58.848743 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012b74c-fbaf-4ca1-9411-509f18e884c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:00:58.849031 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012b74c-fbaf-4ca1-9411-509f18e884c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:00:58.850786 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8012b74c-fbaf-4ca1-9411-509f18e884c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:00:58.861915 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012b74c-fbaf-4ca1-9411-509f18e884c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:00:58.863396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012b74c-fbaf-4ca1-9411-509f18e884c9 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:00:58.873277 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1430/2827] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:00:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:01:08.531543 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b74f85-3857-4965-a33f-db57cbdb0969 service swift] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:08.540955 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b74f85-3857-4965-a33f-db57cbdb0969 service swift] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:08.544901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f054dae-884c-446a-9590-a4414267f165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:08.545496 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f054dae-884c-446a-9590-a4414267f165 service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:08.545777 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f054dae-884c-446a-9590-a4414267f165 service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:08.546049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f054dae-884c-446a-9590-a4414267f165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:08.547793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-7f054dae-884c-446a-9590-a4414267f165 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:08.609567 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f054dae-884c-446a-9590-a4414267f165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:08.611011 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f054dae-884c-446a-9590-a4414267f165 service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:08.620206 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1398/2828] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:01:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:01:08.869066 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=6 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:11.429642 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012b74c-fbaf-4ca1-9411-509f18e884c9 service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:11.430253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-8012b74c-fbaf-4ca1-9411-509f18e884c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:11.448300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012b74c-fbaf-4ca1-9411-509f18e884c9 service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:11.458257 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7134f-430f-468a-b2a4-20c0b5e7848c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf48978c20f04173b114e15e1ce2157c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:11.458257 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7134f-430f-468a-b2a4-20c0b5e7848c service nova] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:11.458257 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7134f-430f-468a-b2a4-20c0b5e7848c service nova] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:11.458257 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7134f-430f-468a-b2a4-20c0b5e7848c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:11.458647 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-64c7134f-430f-468a-b2a4-20c0b5e7848c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:11.474968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7134f-430f-468a-b2a4-20c0b5e7848c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:11.476643 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7134f-430f-468a-b2a4-20c0b5e7848c service nova] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:11.488999 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1431/2829] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:01:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:01:16.578922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f054dae-884c-446a-9590-a4414267f165 service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:16.580273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-7f054dae-884c-446a-9590-a4414267f165 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:16.593860 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f054dae-884c-446a-9590-a4414267f165 service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:16.597556 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce66a9f-b687-470c-bb82-16af0386b62b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:16.598197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce66a9f-b687-470c-bb82-16af0386b62b service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:16.598468 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce66a9f-b687-470c-bb82-16af0386b62b service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:16.598740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce66a9f-b687-470c-bb82-16af0386b62b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:16.600528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-cce66a9f-b687-470c-bb82-16af0386b62b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:16.669156 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce66a9f-b687-470c-bb82-16af0386b62b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:16.670615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce66a9f-b687-470c-bb82-16af0386b62b service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:16.680615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1399/2830] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:01:20.627121 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7134f-430f-468a-b2a4-20c0b5e7848c service nova] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:20.630516 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-64c7134f-430f-468a-b2a4-20c0b5e7848c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:20.710309 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7134f-430f-468a-b2a4-20c0b5e7848c service nova] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:20.716453 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbb2d9-477d-4587-ad0b-ead5a177f490 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256e8478e5fb4c01acde0d597bae0b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:20.717076 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbb2d9-477d-4587-ad0b-ead5a177f490 service placement] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:20.717358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbb2d9-477d-4587-ad0b-ead5a177f490 service placement] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:20.717623 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbb2d9-477d-4587-ad0b-ead5a177f490 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:20.719606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-92fbb2d9-477d-4587-ad0b-ead5a177f490 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:20.732252 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbb2d9-477d-4587-ad0b-ead5a177f490 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:20.733901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbb2d9-477d-4587-ad0b-ead5a177f490 service placement] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:20.746147 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1432/2831] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:01:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:01:20.755389 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce66a9f-b687-470c-bb82-16af0386b62b service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:20.759028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-cce66a9f-b687-470c-bb82-16af0386b62b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:20.783273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce66a9f-b687-470c-bb82-16af0386b62b service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:20.791364 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c4941-2508-4673-8951-621a87b32260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:20.792520 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c4941-2508-4673-8951-621a87b32260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:20.793257 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c4941-2508-4673-8951-621a87b32260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:20.793727 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c4941-2508-4673-8951-621a87b32260 admin admin] PATH_INFO: `/v3/users/2a6796a4bca94d448ae6c52fd28e2c35` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:20.795837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c4941-2508-4673-8951-621a87b32260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a6796a4bca94d448ae6c52fd28e2c35)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:20.798903 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c4941-2508-4673-8951-621a87b32260 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:21.011638 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-278c4941-2508-4673-8951-621a87b32260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a6796a4bca94d448ae6c52fd28e2c35'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:21.012295 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-278c4941-2508-4673-8951-621a87b32260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a6796a4bca94d448ae6c52fd28e2c35'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:21.020767 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-278c4941-2508-4673-8951-621a87b32260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a6796a4bca94d448ae6c52fd28e2c35'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:21.035040 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-278c4941-2508-4673-8951-621a87b32260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a6796a4bca94d448ae6c52fd28e2c35'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:21.035802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-278c4941-2508-4673-8951-621a87b32260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a6796a4bca94d448ae6c52fd28e2c35'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:21.128997 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1400/2832] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 17:01:20 2022] DELETE /identity/v3/users/2a6796a4bca94d448ae6c52fd28e2c35 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:01:21.446096 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbb2d9-477d-4587-ad0b-ead5a177f490 service placement] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:21.459178 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbb2d9-477d-4587-ad0b-ead5a177f490 service placement] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:21.529820 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b563c3-88af-4ef4-824a-fc66fdfd21c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:21.530374 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b563c3-88af-4ef4-824a-fc66fdfd21c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:21.530900 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b563c3-88af-4ef4-824a-fc66fdfd21c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:21.531173 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b563c3-88af-4ef4-824a-fc66fdfd21c1 admin admin] PATH_INFO: `/v3/projects/bbe1aed3b47241cab459752c0320ef55` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:21.532341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b563c3-88af-4ef4-824a-fc66fdfd21c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe1aed3b47241cab459752c0320ef55)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:21.534243 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b563c3-88af-4ef4-824a-fc66fdfd21c1 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:21.639612 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-71b563c3-88af-4ef4-824a-fc66fdfd21c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe1aed3b47241cab459752c0320ef55', 'request_id': 'req-71b563c3-88af-4ef4-824a-fc66fdfd21c1'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:21.646617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-71b563c3-88af-4ef4-824a-fc66fdfd21c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe1aed3b47241cab459752c0320ef55', 'request_id': 'req-71b563c3-88af-4ef4-824a-fc66fdfd21c1'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:21.748357 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-71b563c3-88af-4ef4-824a-fc66fdfd21c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe1aed3b47241cab459752c0320ef55', 'request_id': 'req-71b563c3-88af-4ef4-824a-fc66fdfd21c1'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:21.761376 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-71b563c3-88af-4ef4-824a-fc66fdfd21c1 admin admin] The token cache is being invalidate because project bbe1aed3b47241cab459752c0320ef55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 17:01:21.761870 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-71b563c3-88af-4ef4-824a-fc66fdfd21c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:21.762759 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-71b563c3-88af-4ef4-824a-fc66fdfd21c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:21.764374 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1433/2833] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 17:01:21 2022] DELETE /identity/v3/projects/bbe1aed3b47241cab459752c0320ef55 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 17:01:21.770736 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6da5f-ea91-4bb8-89fb-68e8989ad8fb None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:21.771324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6da5f-ea91-4bb8-89fb-68e8989ad8fb None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:21.771324 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6da5f-ea91-4bb8-89fb-68e8989ad8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:21.781478 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:21.796733 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-b4b6da5f-ea91-4bb8-89fb-68e8989ad8fb None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:01:21.798380 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b4b6da5f-ea91-4bb8-89fb-68e8989ad8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:21.873246 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1401/2834] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:01:21.881835 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f759dc-dcb2-49c6-8a65-4cdea97d09be None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:21.882182 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f759dc-dcb2-49c6-8a65-4cdea97d09be None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:21.882551 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f759dc-dcb2-49c6-8a65-4cdea97d09be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:21.900029 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:21.906597 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-05f759dc-dcb2-49c6-8a65-4cdea97d09be None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:01:21.907862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-05f759dc-dcb2-49c6-8a65-4cdea97d09be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:21.916082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1434/2835] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:01:21.934226 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6da5f-ea91-4bb8-89fb-68e8989ad8fb None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:21.944151 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6da5f-ea91-4bb8-89fb-68e8989ad8fb None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:21.950630 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9315c4b-6665-490d-9b37-49089e14d19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:21.951373 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9315c4b-6665-490d-9b37-49089e14d19f admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:21.951700 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9315c4b-6665-490d-9b37-49089e14d19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:21.951978 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9315c4b-6665-490d-9b37-49089e14d19f admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:21.952658 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9315c4b-6665-490d-9b37-49089e14d19f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 17:01:21.952987 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9315c4b-6665-490d-9b37-49089e14d19f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:21.954668 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9315c4b-6665-490d-9b37-49089e14d19f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:21.967718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1402/2836] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 17:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 17:01:21.972404 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f759dc-dcb2-49c6-8a65-4cdea97d09be None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:21.982947 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f759dc-dcb2-49c6-8a65-4cdea97d09be None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:21.987855 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ae6c3-4ef6-4d73-865d-eae3dcd940f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:21.988502 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ae6c3-4ef6-4d73-865d-eae3dcd940f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:21.988781 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ae6c3-4ef6-4d73-865d-eae3dcd940f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:21.989055 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ae6c3-4ef6-4d73-865d-eae3dcd940f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:21.989767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ae6c3-4ef6-4d73-865d-eae3dcd940f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:21.991699 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ae6c3-4ef6-4d73-865d-eae3dcd940f3 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:22.102799 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1435/2837] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 17:01:21 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 17:01:22.107905 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9315c4b-6665-490d-9b37-49089e14d19f admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:22.118497 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9315c4b-6665-490d-9b37-49089e14d19f admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:22.181277 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7ff4c-1396-4c6d-a4d7-a8b20a96dd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:22.181917 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7ff4c-1396-4c6d-a4d7-a8b20a96dd2a admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:22.182203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7ff4c-1396-4c6d-a4d7-a8b20a96dd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:22.183331 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7ff4c-1396-4c6d-a4d7-a8b20a96dd2a admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:22.184025 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7ff4c-1396-4c6d-a4d7-a8b20a96dd2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:22.186018 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7ff4c-1396-4c6d-a4d7-a8b20a96dd2a admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:22.331842 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1403/2838] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 17:01:22 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 17:01:22.336091 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ae6c3-4ef6-4d73-865d-eae3dcd940f3 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:22.346911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ae6c3-4ef6-4d73-865d-eae3dcd940f3 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:22.353101 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21dc3b-ec3e-4e3e-a5e7-708bca9aff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:22.353784 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21dc3b-ec3e-4e3e-a5e7-708bca9aff32 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:22.354065 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21dc3b-ec3e-4e3e-a5e7-708bca9aff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:22.354885 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21dc3b-ec3e-4e3e-a5e7-708bca9aff32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:22.355603 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21dc3b-ec3e-4e3e-a5e7-708bca9aff32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:22.357303 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21dc3b-ec3e-4e3e-a5e7-708bca9aff32 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:22.368613 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1436/2839] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 17:01:22.375501 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7ff4c-1396-4c6d-a4d7-a8b20a96dd2a admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:22.393454 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7ff4c-1396-4c6d-a4d7-a8b20a96dd2a admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:22.401393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd171f-7bf8-4fe9-8ec2-6bd746c7897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:22.402433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd171f-7bf8-4fe9-8ec2-6bd746c7897e admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:22.402928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd171f-7bf8-4fe9-8ec2-6bd746c7897e admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:22.403401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd171f-7bf8-4fe9-8ec2-6bd746c7897e admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:22.404617 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd171f-7bf8-4fe9-8ec2-6bd746c7897e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:22.408005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd171f-7bf8-4fe9-8ec2-6bd746c7897e admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:22.426429 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1404/2840] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 17:01:22.430981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21dc3b-ec3e-4e3e-a5e7-708bca9aff32 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:22.442270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21dc3b-ec3e-4e3e-a5e7-708bca9aff32 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:22.449212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a57ea-fdc9-428e-86bf-5a699c0cb993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:22.449901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a57ea-fdc9-428e-86bf-5a699c0cb993 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:22.450187 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a57ea-fdc9-428e-86bf-5a699c0cb993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:22.450461 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a57ea-fdc9-428e-86bf-5a699c0cb993 admin admin] PATH_INFO: `/v3/projects/e8cf5a0345a04cd6bd78596440b649ae/users/d6bcf7e4658b4c50ac170d6392c113aa/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:22.468542 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a57ea-fdc9-428e-86bf-5a699c0cb993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8cf5a0345a04cd6bd78596440b649ae, user_id=d6bcf7e4658b4c50ac170d6392c113aa, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:22.471185 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a57ea-fdc9-428e-86bf-5a699c0cb993 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:22.552666 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1437/2841] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 17:01:22 2022] PUT /identity/v3/projects/e8cf5a0345a04cd6bd78596440b649ae/users/d6bcf7e4658b4c50ac170d6392c113aa/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:01:22.563867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd6ac-083b-4167-8359-ccacbef47e81 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:22.564148 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd6ac-083b-4167-8359-ccacbef47e81 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:22.564425 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd6ac-083b-4167-8359-ccacbef47e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:22.597687 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-b4cbd6ac-083b-4167-8359-ccacbef47e81 None None] MFA Rules not processed for user `d6bcf7e4658b4c50ac170d6392c113aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:01:22.598957 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b4cbd6ac-083b-4167-8359-ccacbef47e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:22.669720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:22.673942 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1405/2842] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:01:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:01:22.678842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a57ea-fdc9-428e-86bf-5a699c0cb993 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:22.749014 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a57ea-fdc9-428e-86bf-5a699c0cb993 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:22.753925 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc2ac7-6088-4b9e-a4e5-38bb6aba8320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:22.754549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc2ac7-6088-4b9e-a4e5-38bb6aba8320 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:22.754847 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc2ac7-6088-4b9e-a4e5-38bb6aba8320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:22.755267 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc2ac7-6088-4b9e-a4e5-38bb6aba8320 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:22.755955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc2ac7-6088-4b9e-a4e5-38bb6aba8320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:22.757863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc2ac7-6088-4b9e-a4e5-38bb6aba8320 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:22.885176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1438/2843] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 17:01:22 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 17:01:22.890067 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbd6ac-083b-4167-8359-ccacbef47e81 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:22.902847 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbd6ac-083b-4167-8359-ccacbef47e81 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:22.970886 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5685b-4370-4b2a-ae7b-e34884c9716d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:22.971413 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5685b-4370-4b2a-ae7b-e34884c9716d admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:22.971722 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5685b-4370-4b2a-ae7b-e34884c9716d admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:22.971990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5685b-4370-4b2a-ae7b-e34884c9716d admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:22.972680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5685b-4370-4b2a-ae7b-e34884c9716d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:22.974799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5685b-4370-4b2a-ae7b-e34884c9716d admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:23.089754 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1406/2844] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 17:01:22 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 17:01:23.094021 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc2ac7-6088-4b9e-a4e5-38bb6aba8320 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:23.104840 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc2ac7-6088-4b9e-a4e5-38bb6aba8320 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:23.109547 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e3737-976c-4998-9d0b-2ee8474beba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:23.110146 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e3737-976c-4998-9d0b-2ee8474beba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:23.110424 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e3737-976c-4998-9d0b-2ee8474beba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:23.110698 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e3737-976c-4998-9d0b-2ee8474beba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:23.111330 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e3737-976c-4998-9d0b-2ee8474beba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:23.113002 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e3737-976c-4998-9d0b-2ee8474beba4 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:23.124108 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1439/2845] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 17:01:23.128531 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5685b-4370-4b2a-ae7b-e34884c9716d admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:23.139550 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5685b-4370-4b2a-ae7b-e34884c9716d admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:23.144401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fda82-2050-4fea-ba11-779cc124238e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:23.145059 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fda82-2050-4fea-ba11-779cc124238e admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:23.145341 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fda82-2050-4fea-ba11-779cc124238e admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:23.145617 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fda82-2050-4fea-ba11-779cc124238e admin admin] PATH_INFO: `/v3/projects/1692b0012a364908bbcdde597ba4876a/users/f1748094935145b2bbb6e62b793a30a1/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:23.164507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fda82-2050-4fea-ba11-779cc124238e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1692b0012a364908bbcdde597ba4876a, user_id=f1748094935145b2bbb6e62b793a30a1, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:23.167255 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fda82-2050-4fea-ba11-779cc124238e admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:23.306473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1407/2846] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 17:01:23 2022] PUT /identity/v3/projects/1692b0012a364908bbcdde597ba4876a/users/f1748094935145b2bbb6e62b793a30a1/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 17:01:23.311805 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e3737-976c-4998-9d0b-2ee8474beba4 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:23.322079 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e3737-976c-4998-9d0b-2ee8474beba4 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:23.383293 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3103a-9be2-4063-8a34-6db479f2814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:23.383934 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3103a-9be2-4063-8a34-6db479f2814f admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:23.384206 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3103a-9be2-4063-8a34-6db479f2814f admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:23.384475 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3103a-9be2-4063-8a34-6db479f2814f admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:23.385110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3103a-9be2-4063-8a34-6db479f2814f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:23.387490 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3103a-9be2-4063-8a34-6db479f2814f admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:23.398673 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1440/2847] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 17:01:23.405658 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fda82-2050-4fea-ba11-779cc124238e admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:23.417074 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fda82-2050-4fea-ba11-779cc124238e admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:23.421999 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c384741-bb2f-43af-9bb6-dc0350e3b885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:23.422674 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c384741-bb2f-43af-9bb6-dc0350e3b885 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:23.422953 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c384741-bb2f-43af-9bb6-dc0350e3b885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:23.423225 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c384741-bb2f-43af-9bb6-dc0350e3b885 admin admin] PATH_INFO: `/v3/projects/1692b0012a364908bbcdde597ba4876a/users/f1748094935145b2bbb6e62b793a30a1/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:23.425239 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c384741-bb2f-43af-9bb6-dc0350e3b885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1692b0012a364908bbcdde597ba4876a, user_id=f1748094935145b2bbb6e62b793a30a1, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:23.427948 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c384741-bb2f-43af-9bb6-dc0350e3b885 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:23.440453 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1408/2848] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 17:01:23 2022] PUT /identity/v3/projects/1692b0012a364908bbcdde597ba4876a/users/f1748094935145b2bbb6e62b793a30a1/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:01:23.453492 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d6e83-7003-4164-bb67-31024b2691f2 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:23.453790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d6e83-7003-4164-bb67-31024b2691f2 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:23.454047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d6e83-7003-4164-bb67-31024b2691f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:23.480192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:23.483321 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-6a6d6e83-7003-4164-bb67-31024b2691f2 None None] MFA Rules not processed for user `f1748094935145b2bbb6e62b793a30a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:01:23.484611 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-6a6d6e83-7003-4164-bb67-31024b2691f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:23.556424 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1441/2849] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:01:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:01:23.568032 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c384741-bb2f-43af-9bb6-dc0350e3b885 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:23.571448 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-7c384741-bb2f-43af-9bb6-dc0350e3b885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:23.631885 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c384741-bb2f-43af-9bb6-dc0350e3b885 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:23.636342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbca2a-da66-4f36-8e75-edfce60c293a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:23.636968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbca2a-da66-4f36-8e75-edfce60c293a service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:23.637359 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbca2a-da66-4f36-8e75-edfce60c293a service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:23.637632 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbca2a-da66-4f36-8e75-edfce60c293a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:23.701006 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbca2a-da66-4f36-8e75-edfce60c293a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:23.702444 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbca2a-da66-4f36-8e75-edfce60c293a service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:23.711461 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1409/2850] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:01:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:01:26.884205 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d6e83-7003-4164-bb67-31024b2691f2 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:26.954422 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d6e83-7003-4164-bb67-31024b2691f2 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:26.958938 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919f020-aada-48f9-b467-ba3a6be4783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:26.959616 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919f020-aada-48f9-b467-ba3a6be4783a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:26.959896 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919f020-aada-48f9-b467-ba3a6be4783a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:26.960172 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919f020-aada-48f9-b467-ba3a6be4783a admin admin] PATH_INFO: `/v3/users/d6bcf7e4658b4c50ac170d6392c113aa` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:26.961338 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919f020-aada-48f9-b467-ba3a6be4783a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6bcf7e4658b4c50ac170d6392c113aa)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:26.963281 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919f020-aada-48f9-b467-ba3a6be4783a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:27.340271 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9919f020-aada-48f9-b467-ba3a6be4783a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6bcf7e4658b4c50ac170d6392c113aa'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:27.410773 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9919f020-aada-48f9-b467-ba3a6be4783a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6bcf7e4658b4c50ac170d6392c113aa'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:27.411612 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9919f020-aada-48f9-b467-ba3a6be4783a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6bcf7e4658b4c50ac170d6392c113aa'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:27.412426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9919f020-aada-48f9-b467-ba3a6be4783a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6bcf7e4658b4c50ac170d6392c113aa'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:27.422104 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-9919f020-aada-48f9-b467-ba3a6be4783a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6bcf7e4658b4c50ac170d6392c113aa'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:27.446267 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1442/2851] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 17:01:26 2022] DELETE /identity/v3/users/d6bcf7e4658b4c50ac170d6392c113aa => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:01:27.454713 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79a85b-7276-4adf-a83d-e5c79f0845cf None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:27.462218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79a85b-7276-4adf-a83d-e5c79f0845cf None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:27.462218 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79a85b-7276-4adf-a83d-e5c79f0845cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:27.486214 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:27.496202 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-df79a85b-7276-4adf-a83d-e5c79f0845cf None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:01:27.498266 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-df79a85b-7276-4adf-a83d-e5c79f0845cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:27.593155 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1410/2852] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:01:27.603038 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919f020-aada-48f9-b467-ba3a6be4783a admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:27.604507 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9919f020-aada-48f9-b467-ba3a6be4783a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:27.624570 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:27.664842 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919f020-aada-48f9-b467-ba3a6be4783a admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:27.668778 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6834f9-957d-4eb8-b197-2e88c9ca2ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:27.669411 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6834f9-957d-4eb8-b197-2e88c9ca2ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:27.669691 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6834f9-957d-4eb8-b197-2e88c9ca2ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:27.669963 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6834f9-957d-4eb8-b197-2e88c9ca2ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:27.680344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6834f9-957d-4eb8-b197-2e88c9ca2ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:27.681869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6834f9-957d-4eb8-b197-2e88c9ca2ec6 service neutron] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:27.692742 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1443/2853] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:01:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:01:28.168193 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79a85b-7276-4adf-a83d-e5c79f0845cf None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:28.170450 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-df79a85b-7276-4adf-a83d-e5c79f0845cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:28.187141 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79a85b-7276-4adf-a83d-e5c79f0845cf None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:28.195300 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b5b61-f1ea-403b-8248-251bebaa7a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:28.198348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b5b61-f1ea-403b-8248-251bebaa7a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:28.198348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b5b61-f1ea-403b-8248-251bebaa7a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:28.198348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b5b61-f1ea-403b-8248-251bebaa7a95 admin admin] PATH_INFO: `/v3/projects/e8cf5a0345a04cd6bd78596440b649ae` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:28.200134 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b5b61-f1ea-403b-8248-251bebaa7a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8cf5a0345a04cd6bd78596440b649ae)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:28.203316 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b5b61-f1ea-403b-8248-251bebaa7a95 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:28.348745 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-523b5b61-f1ea-403b-8248-251bebaa7a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8cf5a0345a04cd6bd78596440b649ae', 'request_id': 'req-523b5b61-f1ea-403b-8248-251bebaa7a95'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:28.428182 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-523b5b61-f1ea-403b-8248-251bebaa7a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8cf5a0345a04cd6bd78596440b649ae', 'request_id': 'req-523b5b61-f1ea-403b-8248-251bebaa7a95'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:28.436088 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-523b5b61-f1ea-403b-8248-251bebaa7a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8cf5a0345a04cd6bd78596440b649ae', 'request_id': 'req-523b5b61-f1ea-403b-8248-251bebaa7a95'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:28.448246 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-523b5b61-f1ea-403b-8248-251bebaa7a95 admin admin] The token cache is being invalidate because project e8cf5a0345a04cd6bd78596440b649ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 17:01:28.448525 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-523b5b61-f1ea-403b-8248-251bebaa7a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:28.449288 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-523b5b61-f1ea-403b-8248-251bebaa7a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:28.451446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1411/2854] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 17:01:28 2022] DELETE /identity/v3/projects/e8cf5a0345a04cd6bd78596440b649ae => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:01:28.456111 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6834f9-957d-4eb8-b197-2e88c9ca2ec6 service neutron] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:28.468472 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6834f9-957d-4eb8-b197-2e88c9ca2ec6 service neutron] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:28.535546 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd642eb-e1b5-47e5-a095-eb555c11988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:28.536201 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd642eb-e1b5-47e5-a095-eb555c11988d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:28.536485 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd642eb-e1b5-47e5-a095-eb555c11988d admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:28.536760 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd642eb-e1b5-47e5-a095-eb555c11988d admin admin] PATH_INFO: `/v3/users/f1748094935145b2bbb6e62b793a30a1` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:28.537935 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd642eb-e1b5-47e5-a095-eb555c11988d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1748094935145b2bbb6e62b793a30a1)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:28.539932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd642eb-e1b5-47e5-a095-eb555c11988d admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:28.741412 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-abd642eb-e1b5-47e5-a095-eb555c11988d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1748094935145b2bbb6e62b793a30a1'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:28.827714 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-abd642eb-e1b5-47e5-a095-eb555c11988d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1748094935145b2bbb6e62b793a30a1'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:28.828344 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-abd642eb-e1b5-47e5-a095-eb555c11988d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1748094935145b2bbb6e62b793a30a1'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:28.828952 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-abd642eb-e1b5-47e5-a095-eb555c11988d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1748094935145b2bbb6e62b793a30a1'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:28.836888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-abd642eb-e1b5-47e5-a095-eb555c11988d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1748094935145b2bbb6e62b793a30a1'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:28.856617 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1444/2855] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 17:01:28 2022] DELETE /identity/v3/users/f1748094935145b2bbb6e62b793a30a1 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:01:29.461071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b5b61-f1ea-403b-8248-251bebaa7a95 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:29.467811 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-523b5b61-f1ea-403b-8248-251bebaa7a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:29.476872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b5b61-f1ea-403b-8248-251bebaa7a95 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:29.539197 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fd3da-6455-4c98-ab71-61d947b00070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:29.539884 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fd3da-6455-4c98-ab71-61d947b00070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:29.540164 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fd3da-6455-4c98-ab71-61d947b00070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:29.540436 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fd3da-6455-4c98-ab71-61d947b00070 admin admin] PATH_INFO: `/v3/projects/1692b0012a364908bbcdde597ba4876a` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:29.541549 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fd3da-6455-4c98-ab71-61d947b00070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1692b0012a364908bbcdde597ba4876a)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:29.543576 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fd3da-6455-4c98-ab71-61d947b00070 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:29.689298 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:29.702260 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-094fd3da-6455-4c98-ab71-61d947b00070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1692b0012a364908bbcdde597ba4876a', 'request_id': 'req-094fd3da-6455-4c98-ab71-61d947b00070'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:29.805396 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-094fd3da-6455-4c98-ab71-61d947b00070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1692b0012a364908bbcdde597ba4876a', 'request_id': 'req-094fd3da-6455-4c98-ab71-61d947b00070'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:29.813211 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-094fd3da-6455-4c98-ab71-61d947b00070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1692b0012a364908bbcdde597ba4876a', 'request_id': 'req-094fd3da-6455-4c98-ab71-61d947b00070'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:29.824654 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-094fd3da-6455-4c98-ab71-61d947b00070 admin admin] The token cache is being invalidate because project 1692b0012a364908bbcdde597ba4876a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 17:01:29.824945 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-094fd3da-6455-4c98-ab71-61d947b00070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:29.826437 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-094fd3da-6455-4c98-ab71-61d947b00070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:29.828221 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1412/2856] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 17:01:29 2022] DELETE /identity/v3/projects/1692b0012a364908bbcdde597ba4876a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:01:29.833425 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d355ba-114c-41e8-91d0-b937b7db098d None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:29.835302 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d355ba-114c-41e8-91d0-b937b7db098d None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:29.835302 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d355ba-114c-41e8-91d0-b937b7db098d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:29.855813 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f2d355ba-114c-41e8-91d0-b937b7db098d None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:01:29.858234 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f2d355ba-114c-41e8-91d0-b937b7db098d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:29.907884 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:29.939641 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1445/2857] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:01:29.948206 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53ef68-c71b-404c-b730-f6ea6a4256d3 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:29.948658 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53ef68-c71b-404c-b730-f6ea6a4256d3 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:29.948937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53ef68-c71b-404c-b730-f6ea6a4256d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:30.097179 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-0a53ef68-c71b-404c-b730-f6ea6a4256d3 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:01:30.098428 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-0a53ef68-c71b-404c-b730-f6ea6a4256d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:30.107140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1413/2858] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:01:30.112310 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d355ba-114c-41e8-91d0-b937b7db098d None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:30.124148 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d355ba-114c-41e8-91d0-b937b7db098d None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:30.129420 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d11dd-a98c-4b77-b2b5-095dfbebdbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:30.130058 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d11dd-a98c-4b77-b2b5-095dfbebdbaa admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:30.130334 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d11dd-a98c-4b77-b2b5-095dfbebdbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:30.130606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d11dd-a98c-4b77-b2b5-095dfbebdbaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:30.131341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d11dd-a98c-4b77-b2b5-095dfbebdbaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81876) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 17:01:30.131740 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d11dd-a98c-4b77-b2b5-095dfbebdbaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:30.133424 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d11dd-a98c-4b77-b2b5-095dfbebdbaa admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:30.147790 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1446/2859] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 17:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 17:01:30.152538 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53ef68-c71b-404c-b730-f6ea6a4256d3 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:30.163369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53ef68-c71b-404c-b730-f6ea6a4256d3 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:30.168116 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7f68f-341b-4a8f-89a3-3ebc9252f393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:30.168721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7f68f-341b-4a8f-89a3-3ebc9252f393 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:30.169002 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7f68f-341b-4a8f-89a3-3ebc9252f393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:30.169263 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7f68f-341b-4a8f-89a3-3ebc9252f393 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:30.169906 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7f68f-341b-4a8f-89a3-3ebc9252f393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:30.171877 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7f68f-341b-4a8f-89a3-3ebc9252f393 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:30.264624 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1414/2860] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 17:01:30 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 17:01:30.269054 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d11dd-a98c-4b77-b2b5-095dfbebdbaa admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:30.279607 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d11dd-a98c-4b77-b2b5-095dfbebdbaa admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:30.338747 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96559ee-049b-4b03-a016-8fa280aa46d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:30.339350 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96559ee-049b-4b03-a016-8fa280aa46d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:30.339659 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96559ee-049b-4b03-a016-8fa280aa46d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:30.339932 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96559ee-049b-4b03-a016-8fa280aa46d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:30.340569 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96559ee-049b-4b03-a016-8fa280aa46d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:30.342539 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96559ee-049b-4b03-a016-8fa280aa46d8 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:30.448898 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1447/2861] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 17:01:30 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 17:01:30.453369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7f68f-341b-4a8f-89a3-3ebc9252f393 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:30.466341 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7f68f-341b-4a8f-89a3-3ebc9252f393 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:30.471440 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87761e87-be1d-444f-b6ff-8fd8f5582c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:30.472174 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87761e87-be1d-444f-b6ff-8fd8f5582c50 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:30.472450 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87761e87-be1d-444f-b6ff-8fd8f5582c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:30.472737 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87761e87-be1d-444f-b6ff-8fd8f5582c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:30.473388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87761e87-be1d-444f-b6ff-8fd8f5582c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:30.475035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87761e87-be1d-444f-b6ff-8fd8f5582c50 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:30.486718 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1415/2862] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 17:01:30.490867 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96559ee-049b-4b03-a016-8fa280aa46d8 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:30.501819 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96559ee-049b-4b03-a016-8fa280aa46d8 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:30.506651 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2f919-c320-4964-aa4e-5beb85097455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:30.507272 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2f919-c320-4964-aa4e-5beb85097455 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:30.507652 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2f919-c320-4964-aa4e-5beb85097455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:30.507962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2f919-c320-4964-aa4e-5beb85097455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:30.508600 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2f919-c320-4964-aa4e-5beb85097455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:30.510190 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2f919-c320-4964-aa4e-5beb85097455 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:30.523304 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1448/2863] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 17:01:30.527764 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87761e87-be1d-444f-b6ff-8fd8f5582c50 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:30.538418 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87761e87-be1d-444f-b6ff-8fd8f5582c50 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:30.542998 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019cd99-e69e-451e-bef6-673bfb8e23b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:30.543688 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019cd99-e69e-451e-bef6-673bfb8e23b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:30.544029 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019cd99-e69e-451e-bef6-673bfb8e23b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:30.545005 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019cd99-e69e-451e-bef6-673bfb8e23b4 admin admin] PATH_INFO: `/v3/projects/38d1317bae7a40bf9a6cb260285ecb2b/users/4dc30ac1fccf4b8e887d3c9a83e22ea1/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:30.560972 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019cd99-e69e-451e-bef6-673bfb8e23b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d1317bae7a40bf9a6cb260285ecb2b, user_id=4dc30ac1fccf4b8e887d3c9a83e22ea1, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:30.563910 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019cd99-e69e-451e-bef6-673bfb8e23b4 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:30.657586 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1416/2864] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 17:01:30 2022] PUT /identity/v3/projects/38d1317bae7a40bf9a6cb260285ecb2b/users/4dc30ac1fccf4b8e887d3c9a83e22ea1/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 17:01:30.668433 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7f5d9-2484-4c2f-bd5a-b0b70854ebd3 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:30.668835 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7f5d9-2484-4c2f-bd5a-b0b70854ebd3 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:30.668987 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7f5d9-2484-4c2f-bd5a-b0b70854ebd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:30.701901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-f8d7f5d9-2484-4c2f-bd5a-b0b70854ebd3 None None] MFA Rules not processed for user `4dc30ac1fccf4b8e887d3c9a83e22ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:01:30.701901 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-f8d7f5d9-2484-4c2f-bd5a-b0b70854ebd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:30.767446 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1449/2865] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:01:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:01:30.772136 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019cd99-e69e-451e-bef6-673bfb8e23b4 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:30.835704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019cd99-e69e-451e-bef6-673bfb8e23b4 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:30.840612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c590b-4dee-4a6e-a951-7d2b25ff258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:30.844866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c590b-4dee-4a6e-a951-7d2b25ff258c admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:30.844866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c590b-4dee-4a6e-a951-7d2b25ff258c admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:30.844866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c590b-4dee-4a6e-a951-7d2b25ff258c admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:30.844866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c590b-4dee-4a6e-a951-7d2b25ff258c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:30.845246 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c590b-4dee-4a6e-a951-7d2b25ff258c admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:30.935714 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1417/2866] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 17:01:30 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 17:01:30.939908 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7f5d9-2484-4c2f-bd5a-b0b70854ebd3 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:30.951302 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7f5d9-2484-4c2f-bd5a-b0b70854ebd3 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:30.986069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:31.010628 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32278ed2-1c09-4e81-befc-49f57255bd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:31.011241 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32278ed2-1c09-4e81-befc-49f57255bd42 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:31.011549 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32278ed2-1c09-4e81-befc-49f57255bd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:31.011829 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32278ed2-1c09-4e81-befc-49f57255bd42 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:31.012464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32278ed2-1c09-4e81-befc-49f57255bd42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:31.014573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32278ed2-1c09-4e81-befc-49f57255bd42 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:31.125792 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1450/2867] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 17:01:30 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 17:01:31.128012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c590b-4dee-4a6e-a951-7d2b25ff258c admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:31.139726 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c590b-4dee-4a6e-a951-7d2b25ff258c admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:31.144483 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98a0dd-6a71-499c-8914-73db8d51c686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:31.145132 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98a0dd-6a71-499c-8914-73db8d51c686 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:31.145400 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98a0dd-6a71-499c-8914-73db8d51c686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:31.145664 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98a0dd-6a71-499c-8914-73db8d51c686 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:31.146304 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98a0dd-6a71-499c-8914-73db8d51c686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:31.147943 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98a0dd-6a71-499c-8914-73db8d51c686 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:31.159815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1418/2868] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 17:01:31.163970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32278ed2-1c09-4e81-befc-49f57255bd42 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:31.174317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32278ed2-1c09-4e81-befc-49f57255bd42 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:31.179192 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e722971-d946-4de4-9b64-029a1cc93d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:31.179843 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e722971-d946-4de4-9b64-029a1cc93d49 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:31.180120 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e722971-d946-4de4-9b64-029a1cc93d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:31.180391 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e722971-d946-4de4-9b64-029a1cc93d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:31.181038 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e722971-d946-4de4-9b64-029a1cc93d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:31.182637 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e722971-d946-4de4-9b64-029a1cc93d49 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:31.194225 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1451/2869] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 17:01:31.198671 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98a0dd-6a71-499c-8914-73db8d51c686 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:31.211757 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98a0dd-6a71-499c-8914-73db8d51c686 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:31.217330 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ced06b-f39e-4de4-869c-c9d1278b4615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:31.217997 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ced06b-f39e-4de4-869c-c9d1278b4615 admin admin] REQUEST_METHOD: `PUT` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:31.218267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ced06b-f39e-4de4-869c-c9d1278b4615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:31.218542 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ced06b-f39e-4de4-869c-c9d1278b4615 admin admin] PATH_INFO: `/v3/projects/f44f294a156f484f81eb185b652578dd/users/0eef1f70355f42b0b2db33d4cd41c69c/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:31.238162 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ced06b-f39e-4de4-869c-c9d1278b4615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44f294a156f484f81eb185b652578dd, user_id=0eef1f70355f42b0b2db33d4cd41c69c, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:31.241007 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ced06b-f39e-4de4-869c-c9d1278b4615 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:31.326267 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1419/2870] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 17:01:31 2022] PUT /identity/v3/projects/f44f294a156f484f81eb185b652578dd/users/0eef1f70355f42b0b2db33d4cd41c69c/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:01:31.338660 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bf5b1-8af8-42de-b3db-d4efc04a37fe None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:31.342410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bf5b1-8af8-42de-b3db-d4efc04a37fe None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:31.342410 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bf5b1-8af8-42de-b3db-d4efc04a37fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:31.375447 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-ef9bf5b1-8af8-42de-b3db-d4efc04a37fe None None] MFA Rules not processed for user `0eef1f70355f42b0b2db33d4cd41c69c`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:01:31.376910 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-ef9bf5b1-8af8-42de-b3db-d4efc04a37fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:31.454888 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1452/2871] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:01:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 17:01:31.459637 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ced06b-f39e-4de4-869c-c9d1278b4615 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:31.470052 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:31.540546 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ced06b-f39e-4de4-869c-c9d1278b4615 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:31.545388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e9b1e-71ea-4e9a-949c-cd32c9cc21a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:31.546006 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e9b1e-71ea-4e9a-949c-cd32c9cc21a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:31.546295 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e9b1e-71ea-4e9a-949c-cd32c9cc21a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:31.546562 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e9b1e-71ea-4e9a-949c-cd32c9cc21a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:31.547201 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e9b1e-71ea-4e9a-949c-cd32c9cc21a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:31.549180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e9b1e-71ea-4e9a-949c-cd32c9cc21a0 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:31.650689 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1420/2872] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 17:01:31 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 17:01:31.655317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bf5b1-8af8-42de-b3db-d4efc04a37fe None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:31.667789 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bf5b1-8af8-42de-b3db-d4efc04a37fe None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:31.738442 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7c8d3-90ac-4746-9a90-f3da1fd1ba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:31.739057 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7c8d3-90ac-4746-9a90-f3da1fd1ba91 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:31.739340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7c8d3-90ac-4746-9a90-f3da1fd1ba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:31.739685 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7c8d3-90ac-4746-9a90-f3da1fd1ba91 admin admin] PATH_INFO: `/v3/users` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:31.740352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7c8d3-90ac-4746-9a90-f3da1fd1ba91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:31.742245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7c8d3-90ac-4746-9a90-f3da1fd1ba91 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:31.881923 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1453/2873] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 17:01:31 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 17:01:31.886792 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e9b1e-71ea-4e9a-949c-cd32c9cc21a0 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:31.899060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e9b1e-71ea-4e9a-949c-cd32c9cc21a0 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:31.904401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1d26f-2d36-4a14-861b-4b3b74637a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:31.905458 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d26f-2d36-4a14-861b-4b3b74637a97 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:31.905799 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d26f-2d36-4a14-861b-4b3b74637a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:31.906119 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d26f-2d36-4a14-861b-4b3b74637a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:31.906894 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1d26f-2d36-4a14-861b-4b3b74637a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:31.908579 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1d26f-2d36-4a14-861b-4b3b74637a97 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:31.919604 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1421/2874] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 17:01:31.924394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7c8d3-90ac-4746-9a90-f3da1fd1ba91 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:31.934754 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7c8d3-90ac-4746-9a90-f3da1fd1ba91 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:31.939995 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefad4db-07af-4592-aa33-677946b69760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:31.940649 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefad4db-07af-4592-aa33-677946b69760 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:31.940929 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefad4db-07af-4592-aa33-677946b69760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:31.941207 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefad4db-07af-4592-aa33-677946b69760 admin admin] PATH_INFO: `/v3/projects/2c87b5b76bcb485cbdd1acc18d3f3b88/users/4ea98c2f6f0a4cfbb85194ffd1a86fa4/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:31.956479 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefad4db-07af-4592-aa33-677946b69760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c87b5b76bcb485cbdd1acc18d3f3b88, user_id=4ea98c2f6f0a4cfbb85194ffd1a86fa4, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:31.959070 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefad4db-07af-4592-aa33-677946b69760 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:32.069629 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1454/2875] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 17:01:31 2022] PUT /identity/v3/projects/2c87b5b76bcb485cbdd1acc18d3f3b88/users/4ea98c2f6f0a4cfbb85194ffd1a86fa4/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:01:32.074836 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1d26f-2d36-4a14-861b-4b3b74637a97 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:32.085207 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1d26f-2d36-4a14-861b-4b3b74637a97 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:32.146236 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e393c-a017-4b2a-ad52-8e169c7fb031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:32.146757 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e393c-a017-4b2a-ad52-8e169c7fb031 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:32.147034 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e393c-a017-4b2a-ad52-8e169c7fb031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:32.147307 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e393c-a017-4b2a-ad52-8e169c7fb031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:32.147970 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e393c-a017-4b2a-ad52-8e169c7fb031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:32.149566 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e393c-a017-4b2a-ad52-8e169c7fb031 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:32.159865 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1422/2876] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 17:01:32.164081 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefad4db-07af-4592-aa33-677946b69760 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:32.175890 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefad4db-07af-4592-aa33-677946b69760 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:32.180661 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7203d-92cc-493e-9a67-5007d460e9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:32.181317 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7203d-92cc-493e-9a67-5007d460e9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:32.181630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7203d-92cc-493e-9a67-5007d460e9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:32.182076 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7203d-92cc-493e-9a67-5007d460e9a4 admin admin] PATH_INFO: `/v3/projects/2c87b5b76bcb485cbdd1acc18d3f3b88/users/4ea98c2f6f0a4cfbb85194ffd1a86fa4/roles/d318a8a7f3744d3688dbf1b172690c2a` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:32.183863 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7203d-92cc-493e-9a67-5007d460e9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c87b5b76bcb485cbdd1acc18d3f3b88, user_id=4ea98c2f6f0a4cfbb85194ffd1a86fa4, role_id=d318a8a7f3744d3688dbf1b172690c2a)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:32.187310 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7203d-92cc-493e-9a67-5007d460e9a4 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:32.190722 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:32.198513 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1455/2877] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 17:01:32 2022] PUT /identity/v3/projects/2c87b5b76bcb485cbdd1acc18d3f3b88/users/4ea98c2f6f0a4cfbb85194ffd1a86fa4/roles/d318a8a7f3744d3688dbf1b172690c2a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 17:01:32.209336 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd7cc6-05b6-49ad-a3d1-4f3a03524db7 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:32.209711 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd7cc6-05b6-49ad-a3d1-4f3a03524db7 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:32.210012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd7cc6-05b6-49ad-a3d1-4f3a03524db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:32.241831 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-b2dd7cc6-05b6-49ad-a3d1-4f3a03524db7 None None] MFA Rules not processed for user `4ea98c2f6f0a4cfbb85194ffd1a86fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:01:32.243107 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b2dd7cc6-05b6-49ad-a3d1-4f3a03524db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:32.314040 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1423/2878] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:01:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:01:32.326005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7203d-92cc-493e-9a67-5007d460e9a4 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:32.331627 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-a4f7203d-92cc-493e-9a67-5007d460e9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:32.388745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7203d-92cc-493e-9a67-5007d460e9a4 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:32.392468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63938f09-3cd4-49e8-a267-5dbb4b35c02c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:32.393121 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63938f09-3cd4-49e8-a267-5dbb4b35c02c service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:32.393398 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63938f09-3cd4-49e8-a267-5dbb4b35c02c service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:32.393672 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63938f09-3cd4-49e8-a267-5dbb4b35c02c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:32.457323 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63938f09-3cd4-49e8-a267-5dbb4b35c02c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:32.458681 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63938f09-3cd4-49e8-a267-5dbb4b35c02c service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:32.469381 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1456/2879] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:01:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:01:34.573369 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd7cc6-05b6-49ad-a3d1-4f3a03524db7 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:34.574891 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-b2dd7cc6-05b6-49ad-a3d1-4f3a03524db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:34.581901 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:34.587577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd7cc6-05b6-49ad-a3d1-4f3a03524db7 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:34.591414 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb22620-b720-45a0-b06d-acd7a49b1e6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:34.592899 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb22620-b720-45a0-b06d-acd7a49b1e6a service cinder] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:34.595348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb22620-b720-45a0-b06d-acd7a49b1e6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:34.595348 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb22620-b720-45a0-b06d-acd7a49b1e6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:34.654551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb22620-b720-45a0-b06d-acd7a49b1e6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:34.657079 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb22620-b720-45a0-b06d-acd7a49b1e6a service cinder] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:34.666900 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1424/2880] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:01:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:01:36.115384 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63938f09-3cd4-49e8-a267-5dbb4b35c02c service cinder] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:36.125179 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63938f09-3cd4-49e8-a267-5dbb4b35c02c service cinder] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:36.128938 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733178e-d3b9-4b19-a75f-0c35264e7d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:36.129620 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733178e-d3b9-4b19-a75f-0c35264e7d1e service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:36.129804 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733178e-d3b9-4b19-a75f-0c35264e7d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:36.130073 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733178e-d3b9-4b19-a75f-0c35264e7d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:36.139624 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733178e-d3b9-4b19-a75f-0c35264e7d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:36.141396 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733178e-d3b9-4b19-a75f-0c35264e7d1e service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:36.150835 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1457/2881] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:01:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:01:40.823095 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb22620-b720-45a0-b06d-acd7a49b1e6a service cinder] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:40.892898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb22620-b720-45a0-b06d-acd7a49b1e6a service cinder] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:40.897519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81a400-8374-420b-8a29-b59f578cbc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:40.898157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81a400-8374-420b-8a29-b59f578cbc8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:40.898469 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81a400-8374-420b-8a29-b59f578cbc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:40.898739 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81a400-8374-420b-8a29-b59f578cbc8d admin admin] PATH_INFO: `/v3/users/4dc30ac1fccf4b8e887d3c9a83e22ea1` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:40.899990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81a400-8374-420b-8a29-b59f578cbc8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dc30ac1fccf4b8e887d3c9a83e22ea1)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:40.901895 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81a400-8374-420b-8a29-b59f578cbc8d admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:41.147595 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3e81a400-8374-420b-8a29-b59f578cbc8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dc30ac1fccf4b8e887d3c9a83e22ea1'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:41.148256 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3e81a400-8374-420b-8a29-b59f578cbc8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dc30ac1fccf4b8e887d3c9a83e22ea1'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:41.156899 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3e81a400-8374-420b-8a29-b59f578cbc8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dc30ac1fccf4b8e887d3c9a83e22ea1'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:41.169101 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3e81a400-8374-420b-8a29-b59f578cbc8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dc30ac1fccf4b8e887d3c9a83e22ea1'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:41.169769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-3e81a400-8374-420b-8a29-b59f578cbc8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dc30ac1fccf4b8e887d3c9a83e22ea1'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:41.282575 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1425/2882] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 17:01:40 2022] DELETE /identity/v3/users/4dc30ac1fccf4b8e887d3c9a83e22ea1 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:01:41.287806 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee73cf-4f73-4130-9fde-c366e8e4fc10 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:41.288566 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee73cf-4f73-4130-9fde-c366e8e4fc10 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:41.288566 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee73cf-4f73-4130-9fde-c366e8e4fc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:41.308970 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-16ee73cf-4f73-4130-9fde-c366e8e4fc10 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:01:41.310199 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-16ee73cf-4f73-4130-9fde-c366e8e4fc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:41.368675 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1458/2883] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 17:01:41.380041 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81a400-8374-420b-8a29-b59f578cbc8d admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:41.381556 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-3e81a400-8374-420b-8a29-b59f578cbc8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:41.407220 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:41.463060 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81a400-8374-420b-8a29-b59f578cbc8d admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:41.468103 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1c30a-c365-4f7f-bcb5-af91275033c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:41.469545 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1c30a-c365-4f7f-bcb5-af91275033c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:41.469874 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1c30a-c365-4f7f-bcb5-af91275033c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:41.470157 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1c30a-c365-4f7f-bcb5-af91275033c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:41.480945 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1c30a-c365-4f7f-bcb5-af91275033c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:41.482381 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1c30a-c365-4f7f-bcb5-af91275033c8 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:41.494305 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1426/2884] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:01:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 17:01:42.214209 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee73cf-4f73-4130-9fde-c366e8e4fc10 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:42.217519 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-16ee73cf-4f73-4130-9fde-c366e8e4fc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:42.243029 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee73cf-4f73-4130-9fde-c366e8e4fc10 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:42.248928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3a233-273d-4c89-8274-d446b00da600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:42.250301 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3a233-273d-4c89-8274-d446b00da600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:42.250584 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3a233-273d-4c89-8274-d446b00da600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:42.250866 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3a233-273d-4c89-8274-d446b00da600 admin admin] PATH_INFO: `/v3/projects/38d1317bae7a40bf9a6cb260285ecb2b` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:42.252186 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3a233-273d-4c89-8274-d446b00da600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d1317bae7a40bf9a6cb260285ecb2b)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:42.254121 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3a233-273d-4c89-8274-d446b00da600 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:42.356820 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:42.371631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-86c3a233-273d-4c89-8274-d446b00da600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d1317bae7a40bf9a6cb260285ecb2b', 'request_id': 'req-86c3a233-273d-4c89-8274-d446b00da600'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:42.378321 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-86c3a233-273d-4c89-8274-d446b00da600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d1317bae7a40bf9a6cb260285ecb2b', 'request_id': 'req-86c3a233-273d-4c89-8274-d446b00da600'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:42.490214 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-86c3a233-273d-4c89-8274-d446b00da600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d1317bae7a40bf9a6cb260285ecb2b', 'request_id': 'req-86c3a233-273d-4c89-8274-d446b00da600'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:42.503451 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-86c3a233-273d-4c89-8274-d446b00da600 admin admin] The token cache is being invalidate because project 38d1317bae7a40bf9a6cb260285ecb2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 17:01:42.503694 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-86c3a233-273d-4c89-8274-d446b00da600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:42.504411 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-86c3a233-273d-4c89-8274-d446b00da600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:42.506074 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1459/2885] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 17:01:42 2022] DELETE /identity/v3/projects/38d1317bae7a40bf9a6cb260285ecb2b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:01:42.510191 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1c30a-c365-4f7f-bcb5-af91275033c8 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:42.521019 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1c30a-c365-4f7f-bcb5-af91275033c8 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:42.583227 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a2dfa-6fd6-4a53-973a-bc16c09d0c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:42.583887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a2dfa-6fd6-4a53-973a-bc16c09d0c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:42.584196 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a2dfa-6fd6-4a53-973a-bc16c09d0c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:42.584467 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a2dfa-6fd6-4a53-973a-bc16c09d0c8f admin admin] PATH_INFO: `/v3/users/0eef1f70355f42b0b2db33d4cd41c69c` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:42.585571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a2dfa-6fd6-4a53-973a-bc16c09d0c8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eef1f70355f42b0b2db33d4cd41c69c)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:42.587610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a2dfa-6fd6-4a53-973a-bc16c09d0c8f admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:42.806681 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-459a2dfa-6fd6-4a53-973a-bc16c09d0c8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eef1f70355f42b0b2db33d4cd41c69c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:42.807258 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-459a2dfa-6fd6-4a53-973a-bc16c09d0c8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eef1f70355f42b0b2db33d4cd41c69c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:42.816006 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-459a2dfa-6fd6-4a53-973a-bc16c09d0c8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eef1f70355f42b0b2db33d4cd41c69c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:42.829346 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-459a2dfa-6fd6-4a53-973a-bc16c09d0c8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eef1f70355f42b0b2db33d4cd41c69c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:42.830102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-459a2dfa-6fd6-4a53-973a-bc16c09d0c8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eef1f70355f42b0b2db33d4cd41c69c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:42.927909 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1427/2886] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 17:01:42 2022] DELETE /identity/v3/users/0eef1f70355f42b0b2db33d4cd41c69c => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:01:43.386601 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3a233-273d-4c89-8274-d446b00da600 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:43.388178 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-86c3a233-273d-4c89-8274-d446b00da600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:43.403919 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3a233-273d-4c89-8274-d446b00da600 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:43.471811 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306fbf2-8988-49e6-893f-bfac0e643548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:43.475444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306fbf2-8988-49e6-893f-bfac0e643548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:43.475444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306fbf2-8988-49e6-893f-bfac0e643548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:43.475444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306fbf2-8988-49e6-893f-bfac0e643548 admin admin] PATH_INFO: `/v3/projects/f44f294a156f484f81eb185b652578dd` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:43.475444 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306fbf2-8988-49e6-893f-bfac0e643548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f44f294a156f484f81eb185b652578dd)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:43.476165 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306fbf2-8988-49e6-893f-bfac0e643548 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:43.598727 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4306fbf2-8988-49e6-893f-bfac0e643548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f44f294a156f484f81eb185b652578dd', 'request_id': 'req-4306fbf2-8988-49e6-893f-bfac0e643548'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:43.606341 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4306fbf2-8988-49e6-893f-bfac0e643548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f44f294a156f484f81eb185b652578dd', 'request_id': 'req-4306fbf2-8988-49e6-893f-bfac0e643548'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:43.698915 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4306fbf2-8988-49e6-893f-bfac0e643548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f44f294a156f484f81eb185b652578dd', 'request_id': 'req-4306fbf2-8988-49e6-893f-bfac0e643548'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:43.713426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4306fbf2-8988-49e6-893f-bfac0e643548 admin admin] The token cache is being invalidate because project f44f294a156f484f81eb185b652578dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 17:01:43.713959 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4306fbf2-8988-49e6-893f-bfac0e643548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:43.714871 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4306fbf2-8988-49e6-893f-bfac0e643548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:43.717369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1460/2887] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 17:01:43 2022] DELETE /identity/v3/projects/f44f294a156f484f81eb185b652578dd => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:01:43.722789 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a2dfa-6fd6-4a53-973a-bc16c09d0c8f admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:43.724563 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-459a2dfa-6fd6-4a53-973a-bc16c09d0c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:43.738837 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a2dfa-6fd6-4a53-973a-bc16c09d0c8f admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:43.779867 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:43.798759 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc1cfb-a241-44b6-bc13-341d3ea779b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:43.799405 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc1cfb-a241-44b6-bc13-341d3ea779b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:43.799715 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc1cfb-a241-44b6-bc13-341d3ea779b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:43.799990 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc1cfb-a241-44b6-bc13-341d3ea779b3 admin admin] PATH_INFO: `/v3/users/4ea98c2f6f0a4cfbb85194ffd1a86fa4` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:43.801214 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc1cfb-a241-44b6-bc13-341d3ea779b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea98c2f6f0a4cfbb85194ffd1a86fa4)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:43.803129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc1cfb-a241-44b6-bc13-341d3ea779b3 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:44.030936 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-eefc1cfb-a241-44b6-bc13-341d3ea779b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea98c2f6f0a4cfbb85194ffd1a86fa4'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:44.031685 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-eefc1cfb-a241-44b6-bc13-341d3ea779b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea98c2f6f0a4cfbb85194ffd1a86fa4'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:44.039916 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-eefc1cfb-a241-44b6-bc13-341d3ea779b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea98c2f6f0a4cfbb85194ffd1a86fa4'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:44.052521 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-eefc1cfb-a241-44b6-bc13-341d3ea779b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea98c2f6f0a4cfbb85194ffd1a86fa4'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:44.053256 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-eefc1cfb-a241-44b6-bc13-341d3ea779b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea98c2f6f0a4cfbb85194ffd1a86fa4'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:44.124518 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1428/2888] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 17:01:43 2022] DELETE /identity/v3/users/4ea98c2f6f0a4cfbb85194ffd1a86fa4 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:01:44.589013 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306fbf2-8988-49e6-893f-bfac0e643548 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:44.590519 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-4306fbf2-8988-49e6-893f-bfac0e643548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:44.607110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306fbf2-8988-49e6-893f-bfac0e643548 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:44.661053 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:44.671689 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be9f2f-2c5c-410a-bf90-153e7da0a0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:44.672358 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be9f2f-2c5c-410a-bf90-153e7da0a0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:44.673925 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be9f2f-2c5c-410a-bf90-153e7da0a0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:44.673925 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be9f2f-2c5c-410a-bf90-153e7da0a0ee admin admin] PATH_INFO: `/v3/projects/2c87b5b76bcb485cbdd1acc18d3f3b88` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:44.674132 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be9f2f-2c5c-410a-bf90-153e7da0a0ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c87b5b76bcb485cbdd1acc18d3f3b88)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:44.676063 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be9f2f-2c5c-410a-bf90-153e7da0a0ee admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:44.816357 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-81be9f2f-2c5c-410a-bf90-153e7da0a0ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c87b5b76bcb485cbdd1acc18d3f3b88', 'request_id': 'req-81be9f2f-2c5c-410a-bf90-153e7da0a0ee'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:44.822928 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-81be9f2f-2c5c-410a-bf90-153e7da0a0ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c87b5b76bcb485cbdd1acc18d3f3b88', 'request_id': 'req-81be9f2f-2c5c-410a-bf90-153e7da0a0ee'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:44.896554 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-81be9f2f-2c5c-410a-bf90-153e7da0a0ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c87b5b76bcb485cbdd1acc18d3f3b88', 'request_id': 'req-81be9f2f-2c5c-410a-bf90-153e7da0a0ee'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:44.909614 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-81be9f2f-2c5c-410a-bf90-153e7da0a0ee admin admin] The token cache is being invalidate because project 2c87b5b76bcb485cbdd1acc18d3f3b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 17:01:44.909900 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-81be9f2f-2c5c-410a-bf90-153e7da0a0ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:44.914745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-81be9f2f-2c5c-410a-bf90-153e7da0a0ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:01:44.914745 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1461/2889] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 17:01:44 2022] DELETE /identity/v3/projects/2c87b5b76bcb485cbdd1acc18d3f3b88 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:01:44.918190 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d91f73-7c60-4c74-a189-d305cfce28ba None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:44.918685 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d91f73-7c60-4c74-a189-d305cfce28ba None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:44.918801 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d91f73-7c60-4c74-a189-d305cfce28ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:44.941498 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-e1d91f73-7c60-4c74-a189-d305cfce28ba None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:01:44.951571 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-e1d91f73-7c60-4c74-a189-d305cfce28ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:45.006589 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1429/2890] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:01:45.070474 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182a0a8-680c-4736-870c-fc937b1dc162 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:45.070760 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182a0a8-680c-4736-870c-fc937b1dc162 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:45.071572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182a0a8-680c-4736-870c-fc937b1dc162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:45.092369 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-0182a0a8-680c-4736-870c-fc937b1dc162 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:01:45.095112 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-0182a0a8-680c-4736-870c-fc937b1dc162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:45.106329 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1462/2891] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:01:45.112262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d91f73-7c60-4c74-a189-d305cfce28ba None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:45.122557 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d91f73-7c60-4c74-a189-d305cfce28ba None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:45.127683 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526a37a-9105-43bb-a84c-03a4b23d98b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:45.128386 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526a37a-9105-43bb-a84c-03a4b23d98b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:45.128719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526a37a-9105-43bb-a84c-03a4b23d98b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:45.128991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526a37a-9105-43bb-a84c-03a4b23d98b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:45.129641 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526a37a-9105-43bb-a84c-03a4b23d98b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 17:01:45.129944 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526a37a-9105-43bb-a84c-03a4b23d98b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:45.131591 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526a37a-9105-43bb-a84c-03a4b23d98b6 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:45.144590 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1430/2892] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 17:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 17:01:45.149758 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182a0a8-680c-4736-870c-fc937b1dc162 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:45.160481 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182a0a8-680c-4736-870c-fc937b1dc162 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:45.165492 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792a5cf-0a37-424f-8c74-e9c317370620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:45.166105 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792a5cf-0a37-424f-8c74-e9c317370620 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:45.166378 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792a5cf-0a37-424f-8c74-e9c317370620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:45.166647 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792a5cf-0a37-424f-8c74-e9c317370620 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:45.167301 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792a5cf-0a37-424f-8c74-e9c317370620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:45.169224 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792a5cf-0a37-424f-8c74-e9c317370620 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:45.255042 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1463/2893] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 17:01:45 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 17:01:45.260489 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526a37a-9105-43bb-a84c-03a4b23d98b6 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:45.273171 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526a37a-9105-43bb-a84c-03a4b23d98b6 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:45.322685 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:45.335845 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fac37-5f41-415f-a107-1c1b1470cda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:45.336462 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fac37-5f41-415f-a107-1c1b1470cda7 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:45.336743 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fac37-5f41-415f-a107-1c1b1470cda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:45.337018 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fac37-5f41-415f-a107-1c1b1470cda7 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:45.337656 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fac37-5f41-415f-a107-1c1b1470cda7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:45.339762 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fac37-5f41-415f-a107-1c1b1470cda7 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:45.455491 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1431/2894] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 17:01:45 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 17:01:45.459832 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792a5cf-0a37-424f-8c74-e9c317370620 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:45.471243 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792a5cf-0a37-424f-8c74-e9c317370620 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:45.476421 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa21472-9930-4873-ae1b-e587a44527b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:45.477026 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa21472-9930-4873-ae1b-e587a44527b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:45.477313 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa21472-9930-4873-ae1b-e587a44527b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:45.477578 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa21472-9930-4873-ae1b-e587a44527b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:45.478218 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa21472-9930-4873-ae1b-e587a44527b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:45.479968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa21472-9930-4873-ae1b-e587a44527b2 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:45.490968 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1464/2895] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 17:01:45.500351 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fac37-5f41-415f-a107-1c1b1470cda7 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:45.511530 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fac37-5f41-415f-a107-1c1b1470cda7 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:45.517887 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97b746-0d86-49d5-80c4-1b9cf77eac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:45.518498 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97b746-0d86-49d5-80c4-1b9cf77eac49 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:45.518774 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97b746-0d86-49d5-80c4-1b9cf77eac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:45.519040 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97b746-0d86-49d5-80c4-1b9cf77eac49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:45.519707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97b746-0d86-49d5-80c4-1b9cf77eac49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:45.521720 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97b746-0d86-49d5-80c4-1b9cf77eac49 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:45.538020 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1432/2896] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 17:01:45.542387 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa21472-9930-4873-ae1b-e587a44527b2 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:45.553872 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa21472-9930-4873-ae1b-e587a44527b2 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:45.558610 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674928c3-373a-4470-a2dd-beddfd113d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:45.559326 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674928c3-373a-4470-a2dd-beddfd113d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:45.559650 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674928c3-373a-4470-a2dd-beddfd113d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:45.559926 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674928c3-373a-4470-a2dd-beddfd113d5a admin admin] PATH_INFO: `/v3/projects/6697fda520a94ed391a951975d23f173/users/31d4e4831edc4e3185b24b186dabef2c/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:45.576778 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674928c3-373a-4470-a2dd-beddfd113d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6697fda520a94ed391a951975d23f173, user_id=31d4e4831edc4e3185b24b186dabef2c, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:45.582392 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674928c3-373a-4470-a2dd-beddfd113d5a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:45.688703 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1465/2897] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 17:01:45 2022] PUT /identity/v3/projects/6697fda520a94ed391a951975d23f173/users/31d4e4831edc4e3185b24b186dabef2c/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:01:45.699048 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5eaa4-3614-4d6d-abe1-fea96a5872ca None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:45.699361 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5eaa4-3614-4d6d-abe1-fea96a5872ca None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:45.699673 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5eaa4-3614-4d6d-abe1-fea96a5872ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:45.735422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-4ab5eaa4-3614-4d6d-abe1-fea96a5872ca None None] MFA Rules not processed for user `31d4e4831edc4e3185b24b186dabef2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:01:45.735422 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-4ab5eaa4-3614-4d6d-abe1-fea96a5872ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:45.802738 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1433/2898] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:01:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:01:45.815756 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674928c3-373a-4470-a2dd-beddfd113d5a admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:01:45.817469 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-674928c3-373a-4470-a2dd-beddfd113d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:01:45.877627 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674928c3-373a-4470-a2dd-beddfd113d5a admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:01:45.881380 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe217df0-5266-4c71-ace0-ba067737e663 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52705fc64cd54b1985ef2cb02f6c47fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:01:45.881997 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe217df0-5266-4c71-ace0-ba067737e663 service glance] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:01:45.882280 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe217df0-5266-4c71-ace0-ba067737e663 service glance] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:01:45.895823 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe217df0-5266-4c71-ace0-ba067737e663 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:01:45.895823 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe217df0-5266-4c71-ace0-ba067737e663 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:01:45.895823 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe217df0-5266-4c71-ace0-ba067737e663 service glance] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:01:45.904005 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1466/2899] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:01:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:01:55.799469 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:01:55.899915 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:02:11.288111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5eaa4-3614-4d6d-abe1-fea96a5872ca None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:11.353158 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5eaa4-3614-4d6d-abe1-fea96a5872ca None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:11.358184 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f6e56-0a6c-44e5-8915-756230c8acf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:11.358825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f6e56-0a6c-44e5-8915-756230c8acf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:11.359102 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f6e56-0a6c-44e5-8915-756230c8acf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:11.359372 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f6e56-0a6c-44e5-8915-756230c8acf3 admin admin] PATH_INFO: `/v3/users/31d4e4831edc4e3185b24b186dabef2c` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:11.360545 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f6e56-0a6c-44e5-8915-756230c8acf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31d4e4831edc4e3185b24b186dabef2c)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:11.362473 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f6e56-0a6c-44e5-8915-756230c8acf3 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:11.602921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-997f6e56-0a6c-44e5-8915-756230c8acf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31d4e4831edc4e3185b24b186dabef2c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:11.604232 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-997f6e56-0a6c-44e5-8915-756230c8acf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31d4e4831edc4e3185b24b186dabef2c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:11.611288 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-997f6e56-0a6c-44e5-8915-756230c8acf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31d4e4831edc4e3185b24b186dabef2c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:11.624776 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-997f6e56-0a6c-44e5-8915-756230c8acf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31d4e4831edc4e3185b24b186dabef2c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:11.625472 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-997f6e56-0a6c-44e5-8915-756230c8acf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31d4e4831edc4e3185b24b186dabef2c'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:11.703910 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1434/2900] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 17:02:11 2022] DELETE /identity/v3/users/31d4e4831edc4e3185b24b186dabef2c => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:02:11.708465 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29080264-4ac2-420b-90fc-48e926280681 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:11.708986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29080264-4ac2-420b-90fc-48e926280681 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:11.708986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29080264-4ac2-420b-90fc-48e926280681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:11.730862 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-29080264-4ac2-420b-90fc-48e926280681 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:02:11.732099 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-29080264-4ac2-420b-90fc-48e926280681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:11.799270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1467/2901] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:02:11.809834 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f6e56-0a6c-44e5-8915-756230c8acf3 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:11.811320 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-997f6e56-0a6c-44e5-8915-756230c8acf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:11.876022 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f6e56-0a6c-44e5-8915-756230c8acf3 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:11.879614 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7e84e-97cb-4ae9-87ab-92dfa8583e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:11.880229 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7e84e-97cb-4ae9-87ab-92dfa8583e7c service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:11.880508 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7e84e-97cb-4ae9-87ab-92dfa8583e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:11.880779 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7e84e-97cb-4ae9-87ab-92dfa8583e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:11.890019 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7e84e-97cb-4ae9-87ab-92dfa8583e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:11.891452 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7e84e-97cb-4ae9-87ab-92dfa8583e7c service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:11.901961 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1435/2902] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:02:12.331443 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29080264-4ac2-420b-90fc-48e926280681 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:12.332979 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-29080264-4ac2-420b-90fc-48e926280681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:12.351955 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29080264-4ac2-420b-90fc-48e926280681 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:12.357417 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6a8fe-deee-48af-8719-7c81672c08ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:12.358061 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6a8fe-deee-48af-8719-7c81672c08ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:12.358338 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6a8fe-deee-48af-8719-7c81672c08ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:12.359176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6a8fe-deee-48af-8719-7c81672c08ed admin admin] PATH_INFO: `/v3/projects/6697fda520a94ed391a951975d23f173` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:12.360468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6a8fe-deee-48af-8719-7c81672c08ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=6697fda520a94ed391a951975d23f173)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:12.362426 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6a8fe-deee-48af-8719-7c81672c08ed admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:12.489256 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-1de6a8fe-deee-48af-8719-7c81672c08ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6697fda520a94ed391a951975d23f173', 'request_id': 'req-1de6a8fe-deee-48af-8719-7c81672c08ed'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:12.496299 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-1de6a8fe-deee-48af-8719-7c81672c08ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6697fda520a94ed391a951975d23f173', 'request_id': 'req-1de6a8fe-deee-48af-8719-7c81672c08ed'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:12.600414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-1de6a8fe-deee-48af-8719-7c81672c08ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6697fda520a94ed391a951975d23f173', 'request_id': 'req-1de6a8fe-deee-48af-8719-7c81672c08ed'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:12.612313 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-1de6a8fe-deee-48af-8719-7c81672c08ed admin admin] The token cache is being invalidate because project 6697fda520a94ed391a951975d23f173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 17:02:12.612606 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-1de6a8fe-deee-48af-8719-7c81672c08ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:12.613270 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-1de6a8fe-deee-48af-8719-7c81672c08ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:12.614911 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1468/2903] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 17:02:12 2022] DELETE /identity/v3/projects/6697fda520a94ed391a951975d23f173 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:02:12.620615 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a4931-5069-4160-8e08-945dfe2ffcf9 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:12.621165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a4931-5069-4160-8e08-945dfe2ffcf9 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:12.621165 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a4931-5069-4160-8e08-945dfe2ffcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:12.641888 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-c36a4931-5069-4160-8e08-945dfe2ffcf9 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:02:12.643110 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-c36a4931-5069-4160-8e08-945dfe2ffcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:12.662009 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:02:12.704682 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1436/2904] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:02:12.713361 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb277ab-2c2d-4b05-a4ff-a543b625a5a7 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:12.713886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb277ab-2c2d-4b05-a4ff-a543b625a5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:12.713886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb277ab-2c2d-4b05-a4ff-a543b625a5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:12.734539 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-7bb277ab-2c2d-4b05-a4ff-a543b625a5a7 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:02:12.735775 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7bb277ab-2c2d-4b05-a4ff-a543b625a5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:12.743896 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1469/2905] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:02:12.748519 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a4931-5069-4160-8e08-945dfe2ffcf9 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:12.758900 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a4931-5069-4160-8e08-945dfe2ffcf9 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:12.763896 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa1e6d-7ab4-499b-b3a9-de1986febea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:12.764621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa1e6d-7ab4-499b-b3a9-de1986febea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:12.765147 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa1e6d-7ab4-499b-b3a9-de1986febea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:12.765598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa1e6d-7ab4-499b-b3a9-de1986febea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:12.766678 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa1e6d-7ab4-499b-b3a9-de1986febea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 17:02:12.767035 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa1e6d-7ab4-499b-b3a9-de1986febea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:12.768672 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa1e6d-7ab4-499b-b3a9-de1986febea3 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:12.781831 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1437/2906] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 17:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 17:02:12.788051 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb277ab-2c2d-4b05-a4ff-a543b625a5a7 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:12.798319 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb277ab-2c2d-4b05-a4ff-a543b625a5a7 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:12.803258 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200602bd-7c59-43e3-8d7c-6cb84db7b794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:12.803912 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200602bd-7c59-43e3-8d7c-6cb84db7b794 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:12.804190 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200602bd-7c59-43e3-8d7c-6cb84db7b794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:12.804464 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200602bd-7c59-43e3-8d7c-6cb84db7b794 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:12.805098 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200602bd-7c59-43e3-8d7c-6cb84db7b794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:12.807572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200602bd-7c59-43e3-8d7c-6cb84db7b794 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:12.920006 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1470/2907] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 17:02:12 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 17:02:12.924606 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa1e6d-7ab4-499b-b3a9-de1986febea3 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:12.936123 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa1e6d-7ab4-499b-b3a9-de1986febea3 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:12.994531 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11045863-acdd-432b-a01f-a55e29160fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:12.995140 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11045863-acdd-432b-a01f-a55e29160fec admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:12.995417 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11045863-acdd-432b-a01f-a55e29160fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:12.995719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11045863-acdd-432b-a01f-a55e29160fec admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:12.996408 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11045863-acdd-432b-a01f-a55e29160fec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:12.998309 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11045863-acdd-432b-a01f-a55e29160fec admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:13.086507 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1438/2908] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 17:02:12 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 17:02:13.090631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200602bd-7c59-43e3-8d7c-6cb84db7b794 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:13.103066 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200602bd-7c59-43e3-8d7c-6cb84db7b794 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:13.107823 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e338b11-352d-4247-961e-fbb87a29405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:13.108428 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e338b11-352d-4247-961e-fbb87a29405e admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:13.108707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e338b11-352d-4247-961e-fbb87a29405e admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:13.108981 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e338b11-352d-4247-961e-fbb87a29405e admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:13.109623 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e338b11-352d-4247-961e-fbb87a29405e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:13.111228 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e338b11-352d-4247-961e-fbb87a29405e admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:13.122603 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1471/2909] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 17:02:13.127919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11045863-acdd-432b-a01f-a55e29160fec admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:13.138937 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11045863-acdd-432b-a01f-a55e29160fec admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:13.143719 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af817a65-2912-4368-961b-ad96948f39c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:13.144326 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af817a65-2912-4368-961b-ad96948f39c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:13.144605 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af817a65-2912-4368-961b-ad96948f39c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:13.144875 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af817a65-2912-4368-961b-ad96948f39c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:13.145512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af817a65-2912-4368-961b-ad96948f39c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:13.147113 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af817a65-2912-4368-961b-ad96948f39c0 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:13.158581 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1439/2910] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 17:02:13.162880 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e338b11-352d-4247-961e-fbb87a29405e admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:13.173865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e338b11-352d-4247-961e-fbb87a29405e admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:13.178875 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a6e62-16e8-47ef-9364-d3c10affb548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:13.179572 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a6e62-16e8-47ef-9364-d3c10affb548 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:13.179855 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a6e62-16e8-47ef-9364-d3c10affb548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:13.180126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a6e62-16e8-47ef-9364-d3c10affb548 admin admin] PATH_INFO: `/v3/projects/49041ce1d5944cba9a62518b66ad76e6/users/9ea6f88dd0a44c8698f86da4fec833ca/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:13.196274 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a6e62-16e8-47ef-9364-d3c10affb548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49041ce1d5944cba9a62518b66ad76e6, user_id=9ea6f88dd0a44c8698f86da4fec833ca, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:13.199213 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a6e62-16e8-47ef-9364-d3c10affb548 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:13.317986 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1472/2911] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 17:02:13 2022] PUT /identity/v3/projects/49041ce1d5944cba9a62518b66ad76e6/users/9ea6f88dd0a44c8698f86da4fec833ca/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 17:02:13.328721 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e7a99-5578-453c-b171-f862e513ac58 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:13.329068 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e7a99-5578-453c-b171-f862e513ac58 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:13.329298 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e7a99-5578-453c-b171-f862e513ac58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:13.361030 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-022e7a99-5578-453c-b171-f862e513ac58 None None] MFA Rules not processed for user `9ea6f88dd0a44c8698f86da4fec833ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:02:13.362253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-022e7a99-5578-453c-b171-f862e513ac58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:13.441760 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1440/2912] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:02:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:02:13.453180 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a6e62-16e8-47ef-9364-d3c10affb548 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:13.455109 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-837a6e62-16e8-47ef-9364-d3c10affb548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:13.480337 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:02:13.529509 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a6e62-16e8-47ef-9364-d3c10affb548 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:13.534015 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6be74c-8440-4ea0-beb4-700c370ed39b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:13.534636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6be74c-8440-4ea0-beb4-700c370ed39b service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:13.534915 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6be74c-8440-4ea0-beb4-700c370ed39b service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:13.535195 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6be74c-8440-4ea0-beb4-700c370ed39b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:13.546009 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6be74c-8440-4ea0-beb4-700c370ed39b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:13.547364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6be74c-8440-4ea0-beb4-700c370ed39b service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:13.557962 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1473/2913] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:02:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 17:02:16.677118 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e7a99-5578-453c-b171-f862e513ac58 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:16.698853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:02:16.749610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e7a99-5578-453c-b171-f862e513ac58 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:16.754195 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2b83f-c901-40ca-ade3-6eec7da6d402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:16.754823 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2b83f-c901-40ca-ade3-6eec7da6d402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:16.755098 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2b83f-c901-40ca-ade3-6eec7da6d402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:16.755393 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2b83f-c901-40ca-ade3-6eec7da6d402 admin admin] PATH_INFO: `/v3/users/9ea6f88dd0a44c8698f86da4fec833ca` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:16.756559 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2b83f-c901-40ca-ade3-6eec7da6d402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea6f88dd0a44c8698f86da4fec833ca)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:16.759105 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2b83f-c901-40ca-ade3-6eec7da6d402 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:16.946103 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-bcf2b83f-c901-40ca-ade3-6eec7da6d402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea6f88dd0a44c8698f86da4fec833ca'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:16.946917 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-bcf2b83f-c901-40ca-ade3-6eec7da6d402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea6f88dd0a44c8698f86da4fec833ca'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:16.954499 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-bcf2b83f-c901-40ca-ade3-6eec7da6d402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea6f88dd0a44c8698f86da4fec833ca'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:16.966856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-bcf2b83f-c901-40ca-ade3-6eec7da6d402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea6f88dd0a44c8698f86da4fec833ca'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:16.967570 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-bcf2b83f-c901-40ca-ade3-6eec7da6d402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea6f88dd0a44c8698f86da4fec833ca'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:17.027963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1441/2914] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 17:02:16 2022] DELETE /identity/v3/users/9ea6f88dd0a44c8698f86da4fec833ca => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:02:17.032803 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49f7b1-f4ad-48de-9a23-a278c590bc19 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:17.034535 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49f7b1-f4ad-48de-9a23-a278c590bc19 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:17.034535 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49f7b1-f4ad-48de-9a23-a278c590bc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:17.053767 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-9e49f7b1-f4ad-48de-9a23-a278c590bc19 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:02:17.054984 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9e49f7b1-f4ad-48de-9a23-a278c590bc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:17.116388 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1474/2915] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:02:17.127133 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2b83f-c901-40ca-ade3-6eec7da6d402 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:17.128604 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-bcf2b83f-c901-40ca-ade3-6eec7da6d402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:17.186019 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2b83f-c901-40ca-ade3-6eec7da6d402 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:17.189761 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab3e0b-dc00-4e6b-8da8-c7c3ab61df5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:17.190365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab3e0b-dc00-4e6b-8da8-c7c3ab61df5b service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:17.190644 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab3e0b-dc00-4e6b-8da8-c7c3ab61df5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:17.190919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab3e0b-dc00-4e6b-8da8-c7c3ab61df5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:17.200167 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab3e0b-dc00-4e6b-8da8-c7c3ab61df5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:17.201639 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab3e0b-dc00-4e6b-8da8-c7c3ab61df5b service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:17.210970 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1442/2916] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:02:17.639956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49f7b1-f4ad-48de-9a23-a278c590bc19 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:17.641403 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-9e49f7b1-f4ad-48de-9a23-a278c590bc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:17.655631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49f7b1-f4ad-48de-9a23-a278c590bc19 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:17.665933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b62dc-f814-42b1-a900-2eb6231c0b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:17.665933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b62dc-f814-42b1-a900-2eb6231c0b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:17.665933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b62dc-f814-42b1-a900-2eb6231c0b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:17.665933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b62dc-f814-42b1-a900-2eb6231c0b0a admin admin] PATH_INFO: `/v3/projects/49041ce1d5944cba9a62518b66ad76e6` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:17.666876 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b62dc-f814-42b1-a900-2eb6231c0b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=49041ce1d5944cba9a62518b66ad76e6)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:17.666876 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b62dc-f814-42b1-a900-2eb6231c0b0a admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:17.771466 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-187b62dc-f814-42b1-a900-2eb6231c0b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49041ce1d5944cba9a62518b66ad76e6', 'request_id': 'req-187b62dc-f814-42b1-a900-2eb6231c0b0a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:17.779031 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-187b62dc-f814-42b1-a900-2eb6231c0b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49041ce1d5944cba9a62518b66ad76e6', 'request_id': 'req-187b62dc-f814-42b1-a900-2eb6231c0b0a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:17.857598 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-187b62dc-f814-42b1-a900-2eb6231c0b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49041ce1d5944cba9a62518b66ad76e6', 'request_id': 'req-187b62dc-f814-42b1-a900-2eb6231c0b0a'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:17.868999 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-187b62dc-f814-42b1-a900-2eb6231c0b0a admin admin] The token cache is being invalidate because project 49041ce1d5944cba9a62518b66ad76e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 17:02:17.869285 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-187b62dc-f814-42b1-a900-2eb6231c0b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:17.869910 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-187b62dc-f814-42b1-a900-2eb6231c0b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:17.871423 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1475/2917] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 17:02:17 2022] DELETE /identity/v3/projects/49041ce1d5944cba9a62518b66ad76e6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:02:17.876240 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506b80a-11c5-4f59-b4d9-70da227795b6 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:17.876731 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506b80a-11c5-4f59-b4d9-70da227795b6 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:17.876840 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506b80a-11c5-4f59-b4d9-70da227795b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:17.896435 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-9506b80a-11c5-4f59-b4d9-70da227795b6 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:02:17.897612 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-9506b80a-11c5-4f59-b4d9-70da227795b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:17.930804 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:02:17.956154 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1443/2918] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:02:17.964756 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276534-a04d-45c6-aa10-4323c0d600f6 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:17.965045 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276534-a04d-45c6-aa10-4323c0d600f6 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:17.965342 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276534-a04d-45c6-aa10-4323c0d600f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:17.985988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-93276534-a04d-45c6-aa10-4323c0d600f6 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:02:17.987219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-93276534-a04d-45c6-aa10-4323c0d600f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:17.996451 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1476/2919] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 17:02:18.001279 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506b80a-11c5-4f59-b4d9-70da227795b6 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:18.011928 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506b80a-11c5-4f59-b4d9-70da227795b6 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:18.017623 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcecfa-f363-48ec-bc1d-a2f0eaf48696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:18.017623 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcecfa-f363-48ec-bc1d-a2f0eaf48696 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:18.017870 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcecfa-f363-48ec-bc1d-a2f0eaf48696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:18.017978 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcecfa-f363-48ec-bc1d-a2f0eaf48696 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:18.018595 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcecfa-f363-48ec-bc1d-a2f0eaf48696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 17:02:18.018891 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcecfa-f363-48ec-bc1d-a2f0eaf48696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:18.020512 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcecfa-f363-48ec-bc1d-a2f0eaf48696 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:18.033424 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1444/2920] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 17:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 17:02:18.037820 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93276534-a04d-45c6-aa10-4323c0d600f6 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:18.047508 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93276534-a04d-45c6-aa10-4323c0d600f6 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:18.052252 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef043626-0468-406d-9bf1-f08ccd1e1221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:18.052844 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef043626-0468-406d-9bf1-f08ccd1e1221 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:18.053120 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef043626-0468-406d-9bf1-f08ccd1e1221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:18.053388 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef043626-0468-406d-9bf1-f08ccd1e1221 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:18.054017 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef043626-0468-406d-9bf1-f08ccd1e1221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:18.056534 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef043626-0468-406d-9bf1-f08ccd1e1221 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:18.140040 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1477/2921] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 17:02:18 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 17:02:18.144600 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcecfa-f363-48ec-bc1d-a2f0eaf48696 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:18.155012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcecfa-f363-48ec-bc1d-a2f0eaf48696 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:18.210262 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d7bcd-ee68-44c4-b468-9ef0bf083935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:18.210866 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d7bcd-ee68-44c4-b468-9ef0bf083935 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:18.211146 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d7bcd-ee68-44c4-b468-9ef0bf083935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:18.211468 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d7bcd-ee68-44c4-b468-9ef0bf083935 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:18.212162 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d7bcd-ee68-44c4-b468-9ef0bf083935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:18.214062 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d7bcd-ee68-44c4-b468-9ef0bf083935 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:18.318399 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1445/2922] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 17:02:18 2022] POST /identity/v3/users => generated 283 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 17:02:18.323366 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef043626-0468-406d-9bf1-f08ccd1e1221 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:18.333741 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef043626-0468-406d-9bf1-f08ccd1e1221 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:18.338504 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a8df6-2a63-4afc-9f10-19380ccc6dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:18.339097 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a8df6-2a63-4afc-9f10-19380ccc6dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:18.339372 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a8df6-2a63-4afc-9f10-19380ccc6dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:18.339682 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a8df6-2a63-4afc-9f10-19380ccc6dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:18.340319 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a8df6-2a63-4afc-9f10-19380ccc6dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:18.341933 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a8df6-2a63-4afc-9f10-19380ccc6dcb admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:18.352003 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1478/2923] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 17:02:18.356203 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d7bcd-ee68-44c4-b468-9ef0bf083935 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:18.366468 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d7bcd-ee68-44c4-b468-9ef0bf083935 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:18.372396 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cadf0-0296-464f-848b-61383c1d1b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:18.384769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cadf0-0296-464f-848b-61383c1d1b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:18.384769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cadf0-0296-464f-848b-61383c1d1b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:18.384769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cadf0-0296-464f-848b-61383c1d1b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:18.384769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cadf0-0296-464f-848b-61383c1d1b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:18.384769 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cadf0-0296-464f-848b-61383c1d1b8d admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:18.387382 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1446/2924] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 17:02:18.393573 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a8df6-2a63-4afc-9f10-19380ccc6dcb admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:18.404865 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a8df6-2a63-4afc-9f10-19380ccc6dcb admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:18.410090 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814f464-c532-4322-ac05-f5ebb6f46846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:18.410861 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814f464-c532-4322-ac05-f5ebb6f46846 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:18.411176 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814f464-c532-4322-ac05-f5ebb6f46846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:18.411576 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814f464-c532-4322-ac05-f5ebb6f46846 admin admin] PATH_INFO: `/v3/projects/ae6aa3ee68984118836674ad96e0e57c/users/cac7696f69fe40a3995e39efb3b8f4c2/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:18.415028 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:02:18.432653 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814f464-c532-4322-ac05-f5ebb6f46846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6aa3ee68984118836674ad96e0e57c, user_id=cac7696f69fe40a3995e39efb3b8f4c2, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:18.435332 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814f464-c532-4322-ac05-f5ebb6f46846 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:18.552707 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1479/2925] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 17:02:18 2022] PUT /identity/v3/projects/ae6aa3ee68984118836674ad96e0e57c/users/cac7696f69fe40a3995e39efb3b8f4c2/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:02:18.565068 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f6267-64a2-4582-a7a2-403eb64a02f4 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:18.565351 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f6267-64a2-4582-a7a2-403eb64a02f4 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:18.565621 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f6267-64a2-4582-a7a2-403eb64a02f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:18.593610 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-896f6267-64a2-4582-a7a2-403eb64a02f4 None None] MFA Rules not processed for user `cac7696f69fe40a3995e39efb3b8f4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:02:18.594825 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-896f6267-64a2-4582-a7a2-403eb64a02f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:18.661096 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1447/2926] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:02:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:02:18.673245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814f464-c532-4322-ac05-f5ebb6f46846 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:18.675202 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-6814f464-c532-4322-ac05-f5ebb6f46846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:18.737843 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814f464-c532-4322-ac05-f5ebb6f46846 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:18.741746 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5385db2-edd2-4ec0-b7c8-dfac3aee527e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52705fc64cd54b1985ef2cb02f6c47fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:18.742532 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5385db2-edd2-4ec0-b7c8-dfac3aee527e service glance] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:18.744024 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5385db2-edd2-4ec0-b7c8-dfac3aee527e service glance] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:18.744562 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5385db2-edd2-4ec0-b7c8-dfac3aee527e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:18.754340 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5385db2-edd2-4ec0-b7c8-dfac3aee527e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:18.755794 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5385db2-edd2-4ec0-b7c8-dfac3aee527e service glance] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:18.765540 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1480/2927] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:02:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:02:28.659931 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:02:28.770085 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:02:35.649125 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f6267-64a2-4582-a7a2-403eb64a02f4 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:35.650663 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-896f6267-64a2-4582-a7a2-403eb64a02f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:35.717597 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f6267-64a2-4582-a7a2-403eb64a02f4 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:35.722120 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ae475-1f96-4548-b569-9963dbb6a96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:35.722752 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ae475-1f96-4548-b569-9963dbb6a96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:35.723033 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ae475-1f96-4548-b569-9963dbb6a96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:35.723307 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ae475-1f96-4548-b569-9963dbb6a96e admin admin] PATH_INFO: `/v3/users/2f4a726edffb4c07b056f254858e26bc` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:35.724618 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ae475-1f96-4548-b569-9963dbb6a96e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f4a726edffb4c07b056f254858e26bc)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:35.726547 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ae475-1f96-4548-b569-9963dbb6a96e admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:35.902752 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-460ae475-1f96-4548-b569-9963dbb6a96e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f4a726edffb4c07b056f254858e26bc'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:35.903491 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-460ae475-1f96-4548-b569-9963dbb6a96e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f4a726edffb4c07b056f254858e26bc'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:35.911045 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-460ae475-1f96-4548-b569-9963dbb6a96e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f4a726edffb4c07b056f254858e26bc'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:35.924971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-460ae475-1f96-4548-b569-9963dbb6a96e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f4a726edffb4c07b056f254858e26bc'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:35.925838 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-460ae475-1f96-4548-b569-9963dbb6a96e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f4a726edffb4c07b056f254858e26bc'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:36.046934 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1448/2928] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 17:02:35 2022] DELETE /identity/v3/users/2f4a726edffb4c07b056f254858e26bc => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:02:36.333205 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5385db2-edd2-4ec0-b7c8-dfac3aee527e service glance] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:36.347147 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5385db2-edd2-4ec0-b7c8-dfac3aee527e service glance] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:36.412384 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33278cac-aae5-4f10-a7f5-36fdd4adc8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:36.412988 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278cac-aae5-4f10-a7f5-36fdd4adc8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:36.413262 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278cac-aae5-4f10-a7f5-36fdd4adc8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:36.413530 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278cac-aae5-4f10-a7f5-36fdd4adc8db admin admin] PATH_INFO: `/v3/projects/639bb2d3141440d9b390daf9105532de` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:36.414630 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33278cac-aae5-4f10-a7f5-36fdd4adc8db admin admin] RBAC: Authorizing `identity:delete_project(project_id=639bb2d3141440d9b390daf9105532de)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:36.416558 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33278cac-aae5-4f10-a7f5-36fdd4adc8db admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:36.545027 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-33278cac-aae5-4f10-a7f5-36fdd4adc8db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '639bb2d3141440d9b390daf9105532de', 'request_id': 'req-33278cac-aae5-4f10-a7f5-36fdd4adc8db'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:36.552069 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-33278cac-aae5-4f10-a7f5-36fdd4adc8db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '639bb2d3141440d9b390daf9105532de', 'request_id': 'req-33278cac-aae5-4f10-a7f5-36fdd4adc8db'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:36.645245 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-33278cac-aae5-4f10-a7f5-36fdd4adc8db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '639bb2d3141440d9b390daf9105532de', 'request_id': 'req-33278cac-aae5-4f10-a7f5-36fdd4adc8db'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:36.658661 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-33278cac-aae5-4f10-a7f5-36fdd4adc8db admin admin] The token cache is being invalidate because project 639bb2d3141440d9b390daf9105532de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 17:02:36.658987 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-33278cac-aae5-4f10-a7f5-36fdd4adc8db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:36.659660 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-33278cac-aae5-4f10-a7f5-36fdd4adc8db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:36.661235 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1481/2929] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 17:02:36 2022] DELETE /identity/v3/projects/639bb2d3141440d9b390daf9105532de => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:02:36.665598 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ae475-1f96-4548-b569-9963dbb6a96e admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:36.667841 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-460ae475-1f96-4548-b569-9963dbb6a96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:36.682237 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ae475-1f96-4548-b569-9963dbb6a96e admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:36.744253 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e309a4-e768-4618-b5fd-7ca03823a069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:36.744877 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e309a4-e768-4618-b5fd-7ca03823a069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:36.745153 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e309a4-e768-4618-b5fd-7ca03823a069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:36.746031 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e309a4-e768-4618-b5fd-7ca03823a069 admin admin] PATH_INFO: `/v3/users/3edfc250419e4f44bf566b9e66f489c8` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:36.747212 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e309a4-e768-4618-b5fd-7ca03823a069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3edfc250419e4f44bf566b9e66f489c8)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:36.749297 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e309a4-e768-4618-b5fd-7ca03823a069 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:36.773560 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:02:37.000577 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-e0e309a4-e768-4618-b5fd-7ca03823a069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3edfc250419e4f44bf566b9e66f489c8'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:37.001296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-e0e309a4-e768-4618-b5fd-7ca03823a069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3edfc250419e4f44bf566b9e66f489c8'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:37.008250 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-e0e309a4-e768-4618-b5fd-7ca03823a069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3edfc250419e4f44bf566b9e66f489c8'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:37.021028 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-e0e309a4-e768-4618-b5fd-7ca03823a069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3edfc250419e4f44bf566b9e66f489c8'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:37.021674 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-e0e309a4-e768-4618-b5fd-7ca03823a069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3edfc250419e4f44bf566b9e66f489c8'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:37.090793 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1449/2930] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 17:02:36 2022] DELETE /identity/v3/users/3edfc250419e4f44bf566b9e66f489c8 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:02:37.383364 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33278cac-aae5-4f10-a7f5-36fdd4adc8db admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:37.385300 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-33278cac-aae5-4f10-a7f5-36fdd4adc8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:37.409840 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33278cac-aae5-4f10-a7f5-36fdd4adc8db admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:37.470604 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aaf99f-4c17-4f7c-b4e1-1a4f26f487f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:37.471243 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaf99f-4c17-4f7c-b4e1-1a4f26f487f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:37.471541 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaf99f-4c17-4f7c-b4e1-1a4f26f487f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:37.471859 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaf99f-4c17-4f7c-b4e1-1a4f26f487f8 admin admin] PATH_INFO: `/v3/projects/7ca2ac17189b4169951e6202405dabe2` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:37.473047 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aaf99f-4c17-4f7c-b4e1-1a4f26f487f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca2ac17189b4169951e6202405dabe2)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:37.474956 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aaf99f-4c17-4f7c-b4e1-1a4f26f487f8 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:37.600661 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:02:37.613148 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c1aaf99f-4c17-4f7c-b4e1-1a4f26f487f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca2ac17189b4169951e6202405dabe2', 'request_id': 'req-c1aaf99f-4c17-4f7c-b4e1-1a4f26f487f8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:37.620734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c1aaf99f-4c17-4f7c-b4e1-1a4f26f487f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca2ac17189b4169951e6202405dabe2', 'request_id': 'req-c1aaf99f-4c17-4f7c-b4e1-1a4f26f487f8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:37.725074 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c1aaf99f-4c17-4f7c-b4e1-1a4f26f487f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca2ac17189b4169951e6202405dabe2', 'request_id': 'req-c1aaf99f-4c17-4f7c-b4e1-1a4f26f487f8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:37.736744 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c1aaf99f-4c17-4f7c-b4e1-1a4f26f487f8 admin admin] The token cache is being invalidate because project 7ca2ac17189b4169951e6202405dabe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 17:02:37.737033 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c1aaf99f-4c17-4f7c-b4e1-1a4f26f487f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:37.737671 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-c1aaf99f-4c17-4f7c-b4e1-1a4f26f487f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:37.739160 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1482/2931] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 17:02:37 2022] DELETE /identity/v3/projects/7ca2ac17189b4169951e6202405dabe2 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:02:42.568129 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e309a4-e768-4618-b5fd-7ca03823a069 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:42.569608 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-e0e309a4-e768-4618-b5fd-7ca03823a069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:42.582666 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e309a4-e768-4618-b5fd-7ca03823a069 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:42.641954 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19efa0-8d7e-441e-a743-b94bcb15bb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:42.642616 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19efa0-8d7e-441e-a743-b94bcb15bb21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:42.642919 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19efa0-8d7e-441e-a743-b94bcb15bb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:42.643189 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19efa0-8d7e-441e-a743-b94bcb15bb21 admin admin] PATH_INFO: `/v3/users/cac7696f69fe40a3995e39efb3b8f4c2` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:42.644342 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19efa0-8d7e-441e-a743-b94bcb15bb21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cac7696f69fe40a3995e39efb3b8f4c2)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:42.646242 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19efa0-8d7e-441e-a743-b94bcb15bb21 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:42.861758 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8d19efa0-8d7e-441e-a743-b94bcb15bb21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cac7696f69fe40a3995e39efb3b8f4c2'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:42.862433 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8d19efa0-8d7e-441e-a743-b94bcb15bb21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cac7696f69fe40a3995e39efb3b8f4c2'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:42.870496 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8d19efa0-8d7e-441e-a743-b94bcb15bb21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cac7696f69fe40a3995e39efb3b8f4c2'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:42.882971 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8d19efa0-8d7e-441e-a743-b94bcb15bb21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cac7696f69fe40a3995e39efb3b8f4c2'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:42.883740 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-8d19efa0-8d7e-441e-a743-b94bcb15bb21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cac7696f69fe40a3995e39efb3b8f4c2'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:42.970902 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1450/2932] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 17:02:42 2022] DELETE /identity/v3/users/cac7696f69fe40a3995e39efb3b8f4c2 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:02:42.975393 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74d15a-4fef-4f98-955f-5245b13c6e80 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:42.975920 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74d15a-4fef-4f98-955f-5245b13c6e80 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:42.976025 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74d15a-4fef-4f98-955f-5245b13c6e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:42.995636 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-5f74d15a-4fef-4f98-955f-5245b13c6e80 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:02:43.000909 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5f74d15a-4fef-4f98-955f-5245b13c6e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:43.058491 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1483/2933] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:02:43.068566 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19efa0-8d7e-441e-a743-b94bcb15bb21 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:43.069993 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-8d19efa0-8d7e-441e-a743-b94bcb15bb21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:43.090975 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:02:43.140295 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19efa0-8d7e-441e-a743-b94bcb15bb21 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:43.144055 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed94b69-2a61-4391-b158-c12f22e3e751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:43.151671 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed94b69-2a61-4391-b158-c12f22e3e751 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:43.151671 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed94b69-2a61-4391-b158-c12f22e3e751 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:43.151671 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed94b69-2a61-4391-b158-c12f22e3e751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:43.156628 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed94b69-2a61-4391-b158-c12f22e3e751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:43.158161 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed94b69-2a61-4391-b158-c12f22e3e751 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:43.168815 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1451/2934] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:02:43.621564 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74d15a-4fef-4f98-955f-5245b13c6e80 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:43.623569 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-5f74d15a-4fef-4f98-955f-5245b13c6e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:43.637215 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74d15a-4fef-4f98-955f-5245b13c6e80 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:43.643018 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4933d-71ee-4158-9135-2c87fbb0ec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:43.643959 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4933d-71ee-4158-9135-2c87fbb0ec56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:43.644230 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4933d-71ee-4158-9135-2c87fbb0ec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:43.644507 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4933d-71ee-4158-9135-2c87fbb0ec56 admin admin] PATH_INFO: `/v3/projects/ae6aa3ee68984118836674ad96e0e57c` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:43.646265 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4933d-71ee-4158-9135-2c87fbb0ec56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6aa3ee68984118836674ad96e0e57c)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:43.648668 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4933d-71ee-4158-9135-2c87fbb0ec56 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:43.786961 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b6c4933d-71ee-4158-9135-2c87fbb0ec56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6aa3ee68984118836674ad96e0e57c', 'request_id': 'req-b6c4933d-71ee-4158-9135-2c87fbb0ec56'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:43.793622 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b6c4933d-71ee-4158-9135-2c87fbb0ec56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6aa3ee68984118836674ad96e0e57c', 'request_id': 'req-b6c4933d-71ee-4158-9135-2c87fbb0ec56'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:43.889631 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b6c4933d-71ee-4158-9135-2c87fbb0ec56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6aa3ee68984118836674ad96e0e57c', 'request_id': 'req-b6c4933d-71ee-4158-9135-2c87fbb0ec56'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:43.901141 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b6c4933d-71ee-4158-9135-2c87fbb0ec56 admin admin] The token cache is being invalidate because project ae6aa3ee68984118836674ad96e0e57c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 17:02:43.901382 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b6c4933d-71ee-4158-9135-2c87fbb0ec56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:43.902912 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-b6c4933d-71ee-4158-9135-2c87fbb0ec56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:43.905110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1484/2935] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 17:02:43 2022] DELETE /identity/v3/projects/ae6aa3ee68984118836674ad96e0e57c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:02:43.910214 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7269fb5-2645-4073-b9b0-f6a7b4e736b4 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:43.910761 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7269fb5-2645-4073-b9b0-f6a7b4e736b4 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:43.910761 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7269fb5-2645-4073-b9b0-f6a7b4e736b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:43.932661 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-a7269fb5-2645-4073-b9b0-f6a7b4e736b4 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:02:43.933883 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-a7269fb5-2645-4073-b9b0-f6a7b4e736b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:44.006468 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1452/2936] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:02:44.015254 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527044d-7e3d-432e-87d4-b3b5bbf5d1a7 None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:44.016071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527044d-7e3d-432e-87d4-b3b5bbf5d1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:44.016071 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527044d-7e3d-432e-87d4-b3b5bbf5d1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:44.036887 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-7527044d-7e3d-432e-87d4-b3b5bbf5d1a7 None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:02:44.038126 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-7527044d-7e3d-432e-87d4-b3b5bbf5d1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:44.046394 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1485/2937] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:02:44.053212 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7269fb5-2645-4073-b9b0-f6a7b4e736b4 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:44.063146 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7269fb5-2645-4073-b9b0-f6a7b4e736b4 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:44.067921 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0121e2-ca93-4762-9280-bb8cbcbd4338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:44.068528 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0121e2-ca93-4762-9280-bb8cbcbd4338 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:44.068802 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0121e2-ca93-4762-9280-bb8cbcbd4338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:44.069071 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0121e2-ca93-4762-9280-bb8cbcbd4338 admin admin] PATH_INFO: `/v3/domains` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:44.069707 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0121e2-ca93-4762-9280-bb8cbcbd4338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 17:02:44.070003 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0121e2-ca93-4762-9280-bb8cbcbd4338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:44.071670 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0121e2-ca93-4762-9280-bb8cbcbd4338 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:44.084536 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1453/2938] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Sep 7 17:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 17:02:44.089025 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527044d-7e3d-432e-87d4-b3b5bbf5d1a7 None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:44.099608 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527044d-7e3d-432e-87d4-b3b5bbf5d1a7 None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:44.104352 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7f71c-c475-4cd5-8620-9f61a3131354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:44.105082 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7f71c-c475-4cd5-8620-9f61a3131354 admin admin] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:44.105231 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7f71c-c475-4cd5-8620-9f61a3131354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:44.105538 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7f71c-c475-4cd5-8620-9f61a3131354 admin admin] PATH_INFO: `/v3/projects` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:44.106128 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7f71c-c475-4cd5-8620-9f61a3131354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:44.108110 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7f71c-c475-4cd5-8620-9f61a3131354 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:44.265040 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1486/2939] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Sep 7 17:02:44 2022] POST /identity/v3/projects => generated 391 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 17:02:44.269296 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0121e2-ca93-4762-9280-bb8cbcbd4338 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:44.279935 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0121e2-ca93-4762-9280-bb8cbcbd4338 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:44.341897 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8274b7-24b5-41d6-8abb-b7ec49c13d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:44.342680 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8274b7-24b5-41d6-8abb-b7ec49c13d64 admin admin] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:44.342963 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8274b7-24b5-41d6-8abb-b7ec49c13d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:44.343231 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8274b7-24b5-41d6-8abb-b7ec49c13d64 admin admin] PATH_INFO: `/v3/users` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:44.343898 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8274b7-24b5-41d6-8abb-b7ec49c13d64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:44.345809 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8274b7-24b5-41d6-8abb-b7ec49c13d64 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:44.457355 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1454/2940] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Sep 7 17:02:44 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 17:02:44.461886 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7f71c-c475-4cd5-8620-9f61a3131354 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:44.473468 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7f71c-c475-4cd5-8620-9f61a3131354 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:44.480869 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77ea27-b314-43c8-9d34-31097e83ef20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:44.481657 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77ea27-b314-43c8-9d34-31097e83ef20 admin admin] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:44.482065 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77ea27-b314-43c8-9d34-31097e83ef20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:44.483415 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77ea27-b314-43c8-9d34-31097e83ef20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:44.484368 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77ea27-b314-43c8-9d34-31097e83ef20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:44.486454 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77ea27-b314-43c8-9d34-31097e83ef20 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:44.503306 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1487/2941] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 17:02:44.507436 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8274b7-24b5-41d6-8abb-b7ec49c13d64 admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:44.518292 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8274b7-24b5-41d6-8abb-b7ec49c13d64 admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:44.523012 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c232f-5111-4ff7-b607-877a08240128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:44.523647 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c232f-5111-4ff7-b607-877a08240128 admin admin] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:44.523922 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c232f-5111-4ff7-b607-877a08240128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:44.524219 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c232f-5111-4ff7-b607-877a08240128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:44.524853 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c232f-5111-4ff7-b607-877a08240128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:44.526446 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c232f-5111-4ff7-b607-877a08240128 admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:44.537881 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1455/2942] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Sep 7 17:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 17:02:44.542207 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77ea27-b314-43c8-9d34-31097e83ef20 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:44.549219 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:02:44.554343 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77ea27-b314-43c8-9d34-31097e83ef20 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:44.559922 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f14bcc-512b-4373-aa7f-6e63e7806822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:44.563458 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f14bcc-512b-4373-aa7f-6e63e7806822 admin admin] REQUEST_METHOD: `PUT` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:44.563458 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f14bcc-512b-4373-aa7f-6e63e7806822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:44.563458 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f14bcc-512b-4373-aa7f-6e63e7806822 admin admin] PATH_INFO: `/v3/projects/9153fcac38f441f38a8eff8872f330ee/users/423be3d439b94af7a3ced712594a86c4/roles/b9c5d282a37c489e83eabbdd2b393dbf` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:44.579297 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f14bcc-512b-4373-aa7f-6e63e7806822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9153fcac38f441f38a8eff8872f330ee, user_id=423be3d439b94af7a3ced712594a86c4, role_id=b9c5d282a37c489e83eabbdd2b393dbf)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:44.581910 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f14bcc-512b-4373-aa7f-6e63e7806822 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:44.697799 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1488/2943] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Sep 7 17:02:44 2022] PUT /identity/v3/projects/9153fcac38f441f38a8eff8872f330ee/users/423be3d439b94af7a3ced712594a86c4/roles/b9c5d282a37c489e83eabbdd2b393dbf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 17:02:44.709546 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52f377-5240-41a1-9ffd-57f99da41d06 None None] REQUEST_METHOD: `POST` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:44.709835 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52f377-5240-41a1-9ffd-57f99da41d06 None None] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:44.710111 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52f377-5240-41a1-9ffd-57f99da41d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:44.741415 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.auth.core [None req-fe52f377-5240-41a1-9ffd-57f99da41d06 None None] MFA Rules not processed for user `423be3d439b94af7a3ced712594a86c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:02:44.742653 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-fe52f377-5240-41a1-9ffd-57f99da41d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:44.756981 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:02:44.813264 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1456/2944] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:02:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:02:44.824813 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f14bcc-512b-4373-aa7f-6e63e7806822 admin admin] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:44.827431 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-51f14bcc-512b-4373-aa7f-6e63e7806822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:44.889022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f14bcc-512b-4373-aa7f-6e63e7806822 admin admin] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:44.892846 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f9a1b-c9ef-440b-9a1b-da99c226dbb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73216eee250744bb9d9b81dd983376ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:44.893451 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9a1b-c9ef-440b-9a1b-da99c226dbb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:44.893725 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9a1b-c9ef-440b-9a1b-da99c226dbb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:44.893998 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9a1b-c9ef-440b-9a1b-da99c226dbb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:44.902868 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f9a1b-c9ef-440b-9a1b-da99c226dbb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:44.904841 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f9a1b-c9ef-440b-9a1b-da99c226dbb3 service cinder] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:44.914253 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1489/2945] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:02:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:02:54.855856 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=20 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:02:54.910085 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=34,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:02:56.984308 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52f377-5240-41a1-9ffd-57f99da41d06 None None] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:57.048085 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52f377-5240-41a1-9ffd-57f99da41d06 None None] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:57.052640 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bacd2-bad1-40cf-b0d3-86cd3a80c3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:57.053272 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bacd2-bad1-40cf-b0d3-86cd3a80c3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:57.053547 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bacd2-bad1-40cf-b0d3-86cd3a80c3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:57.053818 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bacd2-bad1-40cf-b0d3-86cd3a80c3de admin admin] PATH_INFO: `/v3/users/423be3d439b94af7a3ced712594a86c4` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:57.056708 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bacd2-bad1-40cf-b0d3-86cd3a80c3de admin admin] RBAC: Authorizing `identity:delete_user(user_id=423be3d439b94af7a3ced712594a86c4)` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:57.058635 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bacd2-bad1-40cf-b0d3-86cd3a80c3de admin admin] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:57.280991 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cf7bacd2-bad1-40cf-b0d3-86cd3a80c3de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423be3d439b94af7a3ced712594a86c4'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:57.281758 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cf7bacd2-bad1-40cf-b0d3-86cd3a80c3de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423be3d439b94af7a3ced712594a86c4'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:57.289844 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cf7bacd2-bad1-40cf-b0d3-86cd3a80c3de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423be3d439b94af7a3ced712594a86c4'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:57.303699 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cf7bacd2-bad1-40cf-b0d3-86cd3a80c3de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423be3d439b94af7a3ced712594a86c4'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:57.304551 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.notifications [None req-cf7bacd2-bad1-40cf-b0d3-86cd3a80c3de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423be3d439b94af7a3ced712594a86c4'} {{(pid=81877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:57.394164 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1457/2946] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Sep 7 17:02:56 2022] DELETE /identity/v3/users/423be3d439b94af7a3ced712594a86c4 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 17:02:57.399030 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7ca41-2a69-41b4-bc91-21c3c06735fa None None] REQUEST_METHOD: `POST` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:57.399638 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7ca41-2a69-41b4-bc91-21c3c06735fa None None] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:57.399638 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7ca41-2a69-41b4-bc91-21c3c06735fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:57.419343 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.auth.core [None req-bfb7ca41-2a69-41b4-bc91-21c3c06735fa None None] MFA Rules not processed for user `f8a8b3ea701948c68e339fb34dbfff3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81876) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 17:02:57.420723 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-bfb7ca41-2a69-41b4-bc91-21c3c06735fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:57.482268 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1490/2947] 10.222.0.25 () {58 vars in 958 bytes} [Wed Sep 7 17:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 17:02:57.492388 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bacd2-bad1-40cf-b0d3-86cd3a80c3de admin admin] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:57.493968 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-cf7bacd2-bad1-40cf-b0d3-86cd3a80c3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:57.557445 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bacd2-bad1-40cf-b0d3-86cd3a80c3de admin admin] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:57.562375 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef346e8-e30f-4e36-9a49-508ffb7afb12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bac099b78bd04e02b8614c8afce53ab7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:57.562820 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef346e8-e30f-4e36-9a49-508ffb7afb12 service neutron] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:57.563097 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef346e8-e30f-4e36-9a49-508ffb7afb12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:57.563622 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef346e8-e30f-4e36-9a49-508ffb7afb12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:57.575169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef346e8-e30f-4e36-9a49-508ffb7afb12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:57.577401 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef346e8-e30f-4e36-9a49-508ffb7afb12 service neutron] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:57.588273 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1458/2948] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:02:58.085525 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7ca41-2a69-41b4-bc91-21c3c06735fa None None] Authenticating user token {{(pid=81876) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:02:58.087041 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.fernet_utils [None req-bfb7ca41-2a69-41b4-bc91-21c3c06735fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81876) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:02:58.100709 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7ca41-2a69-41b4-bc91-21c3c06735fa None None] Validating token access rules against request {{(pid=81876) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:02:58.105795 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bb870-0417-40c8-9745-1fd6e2deb6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8a8b3ea701948c68e339fb34dbfff3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef7d1dd858dc44ab80c0562c9d3c8b52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81876) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:02:58.106441 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bb870-0417-40c8-9745-1fd6e2deb6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:02:58.106749 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bb870-0417-40c8-9745-1fd6e2deb6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:02:58.107025 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bb870-0417-40c8-9745-1fd6e2deb6d8 admin admin] PATH_INFO: `/v3/projects/9153fcac38f441f38a8eff8872f330ee` {{(pid=81876) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:02:58.109022 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8bb870-0417-40c8-9745-1fd6e2deb6d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9153fcac38f441f38a8eff8872f330ee)` {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:02:58.111212 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8bb870-0417-40c8-9745-1fd6e2deb6d8 admin admin] RBAC: Authorization granted {{(pid=81876) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:02:58.259693 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4e8bb870-0417-40c8-9745-1fd6e2deb6d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9153fcac38f441f38a8eff8872f330ee', 'request_id': 'req-4e8bb870-0417-40c8-9745-1fd6e2deb6d8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:58.266640 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4e8bb870-0417-40c8-9745-1fd6e2deb6d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9153fcac38f441f38a8eff8872f330ee', 'request_id': 'req-4e8bb870-0417-40c8-9745-1fd6e2deb6d8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:58.333734 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4e8bb870-0417-40c8-9745-1fd6e2deb6d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9153fcac38f441f38a8eff8872f330ee', 'request_id': 'req-4e8bb870-0417-40c8-9745-1fd6e2deb6d8'} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:58.345484 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4e8bb870-0417-40c8-9745-1fd6e2deb6d8 admin admin] The token cache is being invalidate because project 9153fcac38f441f38a8eff8872f330ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81876) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 17:02:58.345755 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4e8bb870-0417-40c8-9745-1fd6e2deb6d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:58.347414 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG keystone.notifications [None req-4e8bb870-0417-40c8-9745-1fd6e2deb6d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81876) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 17:02:58.353895 dv-cinder-847732-5-smb devstack@keystone.service[81876]: [pid: 81876|app: 0|req: 1491/2949] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Sep 7 17:02:58 2022] DELETE /identity/v3/projects/9153fcac38f441f38a8eff8872f330ee => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 17:03:07.583498 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:03:08.341623 dv-cinder-847732-5-smb devstack@keystone.service[81876]: DEBUG dbcounter [-] [81876] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 17:03:32.646180 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef346e8-e30f-4e36-9a49-508ffb7afb12 service neutron] Authenticating user token {{(pid=81877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 17:03:32.648704 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-6ef346e8-e30f-4e36-9a49-508ffb7afb12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:03:32.747917 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef346e8-e30f-4e36-9a49-508ffb7afb12 service neutron] Validating token access rules against request {{(pid=81877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 17:03:32.820365 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04082742-6c6e-40f8-9fab-f00fb9932674 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '256e8478e5fb4c01acde0d597bae0b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1180c1ddef2b493f83c41425fd2e7917', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 17:03:32.821224 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04082742-6c6e-40f8-9fab-f00fb9932674 service placement] REQUEST_METHOD: `GET` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 17:03:32.821637 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04082742-6c6e-40f8-9fab-f00fb9932674 service placement] SCRIPT_NAME: `/identity` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 17:03:32.822006 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04082742-6c6e-40f8-9fab-f00fb9932674 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 17:03:32.824169 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.fernet_utils [None req-04082742-6c6e-40f8-9fab-f00fb9932674 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 17:03:32.837049 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04082742-6c6e-40f8-9fab-f00fb9932674 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 17:03:32.842872 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04082742-6c6e-40f8-9fab-f00fb9932674 service placement] RBAC: Authorization granted {{(pid=81877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 17:03:32.850665 dv-cinder-847732-5-smb devstack@keystone.service[81877]: [pid: 81877|app: 0|req: 1459/2950] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Sep 7 17:03:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 17:03:42.845760 dv-cinder-847732-5-smb devstack@keystone.service[81877]: DEBUG dbcounter [-] [81877] Writing DB stats keystone:SELECT=58 {{(pid=81877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}